About this board

Previous discussion was archived at User talk:Smalyshev (WMF)/Archive 1 on 2015-08-21.

Structured Data - computer-aided tagging designs

1
MediaWiki message delivery (talkcontribs)
Reply to "Structured Data - computer-aided tagging designs"
MediaWiki message delivery (talkcontribs)
Reply to "Structured Data - modeling data"

Help with Tora Wikidata:SPARQL federation input

3
Salgo60 (talkcontribs)

Hi you helped me with adding Nobelprize to the federation white list see change


I added TORA in 22 August 2019 and no feedback can you help me also this time?

phabricator T200066


Regards

Magnus Sälgö

Stockholm, Sweden

MisterSynergy (talkcontribs)

Stas has left his position at WMF and his account is globally locked. As far as I know, there is no direct successor for WDQS related matters yet...

Salgo60 (talkcontribs)
Reply to "Help with Tora Wikidata:SPARQL federation input"

Structured Data - computer-aided tagging

1
MediaWiki message delivery (talkcontribs)
The development team is starting work on one of the last planned features for SDC v1.0, a lightweight tool to suggest depicts tags for images. I've published a project page for it, please have a look. I plan to share this page with everyone on Commons much more broadly in the coming days. The tool has been carefully designed to try to not increase any workload on Commons volunteers; for starters, it will be opt-in for auto-confirmed users only and will not generate any sort of backlog here on Commons. Additionally, the tool is highly privacy-minded for the contributors and publicly-minded for the third party being used, in this case Google. The implementation and usage notes contain more information about these and other potential concerns as a starting place. It's really important that the tool is implemented properly from the start, so feedback is welcome. Questions, comments, concerns are welcome on the talk page and I will get answers as quickly as possible as things come up. On the talk page you can also sign up to make sure you're a part of the feedback for designs and prototype testing. -- Keegan (WMF) (talk) 17:57, 17 September 2019 (UTC)
Reply to "Structured Data - computer-aided tagging"
MisterSynergy (talkcontribs)

Hey Stas (again)

There are sometimes changes which for whatever reason do not make it to the WDQS servers. As far as I know, you can somehow manually re-load complete items to the servers, or remove them from the servers if they have been deleted. Can we also do this as regular Wikidata users? If so, how? If not, would it be possible to make a tool that allows us to do this?

Thanks!

Smalyshev (WMF) (talkcontribs)

There's no tool (except for making another edit to the same item) but if you tell me where the problem is I could check it. It's not easy to make a user-accessible tool since it requires access that regular users would not have.

MisterSynergy (talkcontribs)

"Making another edit to the same item" is sometimes not so easy; unfortunately, we do not have "null edits" in Wikidata which one could make instead of actual changes.

There are quite a lot of problems, and I continuously stumple upon new ones. Deleted items which are still listed in the results months after deletion, or changes which are obviously missing on the servers. IMO it is not really feasible if Wikidata users have to contact you each time, thus I am asking for a tool. Would it be possible to provide some kind of an (internal) interface where a tool or gadget could report entity IDs (items, properties, or lexemes), and the actual re-loading process which requires elevated access rights was done somewhere internally on the server?

MisterSynergy (talkcontribs)

As there is no tool right now and it would probably take some time to make one in case it is possible, I report some items which need a purge anyways. They are all items which have been deleted a while ago, but they are listed in query results:

Q59829205, Q63052311, Q61055977, Q62778891, Q2895918, Q55659535, Q25632774, Q63058667, Q62781555, Q61138466, Q62008697, Q62781871, Q62713985, Q31828394, Q63069534, Q13178905, Q31828368, Q63040612, Q63074731, Q63081983, Q13046358, Q62780082, Q31828391, Q62702741, Q5686578, Q62721811, Q31828254, Q62676575, Q62675942, Q62717645, Q63075268, Q63041370, Q62781636, Q57792502, Q25390124, Q62777557, Q62986415, Q62716765, Q63065908, Q31828417, Q62698081, Q60995829, Q62703963, Q13183001, Q57793838, Q62750924, Q62734411, Q31828378, Q12962093, Q62703188, Q62772788, Q62667304, Q62716697, Q62753008, Q62728287, Q63036112, Q63120710, Q19682182, Q61117736, Q63067830, Q60578103, Q31828297, Q62752914, Q56327604, Q63068802, Q31828393, Q62667294, Q62755014, Q63065668, Q62738379, Q56306520, Q25538365, Q62754296, Q4229444, Q63084259, Q62705445, Q62747408, Q62724098, Q31828248, Q4229681, Q5281896, Q31828203, Q62476887, Q62675605, Q63007134, Q62734388, Q61059034, Q18815002, Q62765154, Q20086083, Q30526954, Q61129050, Q62761201, Q31828209, Q62690844, Q62706496, Q12111894, Q61118152, Q63043840, Q63066755, Q4291259, Q61359472, Q61131551, Q31344605, Q62762259, Q62766460, Q62752269, Q62690936, Q62667019, Q31828270, Q56415788, Q5793370, Q61118135, Q63077625, Q62745809, Q63077570, Q31828295, Q62746804, Q31828273, Q62719860, Q63343783, Q63065650, Q61123705, Q63065828, Q31828388, Q62792320, Q31828208, Q10878213, Q19730075, Q62702659, Q62709576, Q56312327, Q5151641, Q62708234, Q62988192, Q22236231, Q62764570, Q62588329, Q31840388, Q22906251, Q31828389, Q62755868, Q62713821, Q62987821, Q20084441, Q12962086, Q62762851, Q63064990, Q25678713, Q63043793, Q62675661, Q61065578, Q62702796, Q61117845, Q31828383, Q16962127, Q31828250, Q63065876, Q31828253, Q62703932, Q56321182, Q16437754, Q62711587, Q63079898, Q62738118, Q62705223, Q62750164, Q48961760, Q62695842, Q30893350, Q63121654, Q7195950, Q61065775, Q62704029, Q61082295, Q25708204, Q61061661, Q15925722, Q62688910, Q39096647, Q63079427, Q31828227, Q62711995, Q63044886, Q62758567, Q62749994, Q17047948, Q62754781, Q62751976, Q4105233, Q62736653, Q25691916, Q13025162, Q63069480, Q56309320, Q56306154, Q30892496, Q63043649, Q62706322, Q62700193, Q59618332, Q63033949, Q31828382, Q62751507, Q62760325, Q31828207, Q20086755

MisterSynergy (talkcontribs)

Something went wrong with this Structured Discussion thread. This post from earlier this evening is not displayed here properly, and it is missing in the topic history.

MisterSynergy (talkcontribs)

Here's a new batch of QIDs which should be reloaded to the WDQS servers (7 redirects and 42 deleted items):

Q20853277, Q28695917, Q32037287, Q32576285, Q32792041, Q33050456, Q37922564, Q2872686, Q16047840, Q25245306, Q31197865, Q56298752, Q60848444, Q60850122, Q60964533, Q63121999, Q64744514, Q65068861, Q65128001, Q65143971, Q65146067, Q65159508, Q65162116, Q65166842, Q65195036, Q65195116, Q65195200, Q65195297, Q65195597, Q65196057, Q65196640, Q65197353, Q65218926, Q65249871, Q65284233, Q65293943, Q65318251, Q65318268, Q65318285, Q65318435, Q65441491, Q65500943, Q65562355, Q65619923, Q65926234, Q65926756, Q65926793, Q65929161, Q65930233

Thanks!

Smalyshev (WMF) (talkcontribs)

Should be OK now, ping me if anything else is missing.

Structured Data - testing other statements

1
MediaWiki message delivery (talkcontribs)

You can now test using other statements for structured data on the file page on Test-Commons. Some datatypes are not yet available, such a coordinates, but further support will be extended soon. You can find more information about testing on the SDC talk page. The team looks forward to your feedback. -- Keegan (WMF) (talk) 16:41, 24 July 2019 (UTC)

Structured Data on Commons - IRC office hours this week, 18 July

1
MediaWiki message delivery (talkcontribs)

The Structured Data team is hosting an IRC office hour this week on Thursday, 18 July, from 17:00-18:00 UTC. Joining information as well as date and time conversion is available on Meta. Potential topics for discussion are the testing of "other statements", properties that may need to be created for Commons on Wikidata soon, plans for the rest of SDC development, or whatever you might want to discuss. The development team looks forward to seeing you there. -- Keegan (WMF) (talk) 18:51, 16 July 2019 (UTC)

Reply to "Structured Data on Commons - IRC office hours this week, 18 July"

Structured Data - testing qualifiers for depicts

1
MediaWiki message delivery (talkcontribs)

As you might have seen, testing is underway for adding qualifiers to depicts statements. If you have not left feedback already, the Structured Data on Commons development team is very interested in hearing about your experience using qualifiers on the file page and in the UploadWizard. To get started you can visit Test-Commons and chose a random file to test out, or upload your own file to try out the UploadWizard. Questions, comments, and concerns can be left on the Structured data talk page and the team will address them as best as they can. Thank you for your time. -- Keegan (WMF) (talk) 19:08, 11 June 2019 (UTC)

Reply to "Structured Data - testing qualifiers for depicts"
MisterSynergy (talkcontribs)

Hey Stas

There is an RDF type wikibase:GeoAutoPrecision used in WDQS which seems to be pretty undocumented wherever I try to find something (mediawiki.org, wikidata.org, phabricator), except for this bit at wikiba.se itself. It seems that it marks statement values of coordinate properties where the user somehow did not specify a geo precision when the statement was added. WDQS always reports 2.7777777777778E-4 for wikibase:geoPrecision in such cases, and this happens to be the case in ~100.000 items . From what I can see, this appears to be kind of a technical legacy, as the coordinates in question were all added in 2013. At some point the validator probably was changed so that coordinates without a user-specified precision were not accepted any longer, probably due to phab:T55796.

The problem now is that these items are not editable via API if no user-specified precision is provided (i.e. I am trying to modify something completely unrelated in these items). When editing with pywikibot, I receive the following error message:

WARNING: API error modification-failed: Missing required field "precision"
Edit to page Q854403 failed:
modification-failed: Missing required field "precision" [messages:[{u'html': {u'*': u'Missing required field "precision"'}, u'name': u'wikibase-validator-missing-field', u'parameters': [u'precision']}]; help:See https://www.wikidata.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce for notice of API deprecations and breaking changes.]

I am not sure what should be done here, thus I ask for your opinion:

  • Add documentation about wikibase:GeoAutoPrecision at appropriate places?
  • Tidy this whole thing, with a bot run that adds "user-specified" precisions for all coordinates in question? This would eliminate wikibase:GeoAutoPrecision completely
  • Change the validator?
  • …? (something else)

Thanks!

Smalyshev (WMF) (talkcontribs)

GeoAutoPrecision is set when the data for whatever reason does not have precision set. You are right, it's a patch for legacy data, null precision is no longer allowed to be entered, and that's the right thing to do. Fixing the legacy data is of course welcome, not sure if the bot is good for it since implied precision might be different, but I didn't research the subject in any detail, so maybe bot-fixing it is ok.

MisterSynergy (talkcontribs)

Thanks.

  • For a bot fix, one would have to seek community consensus anyways via Wikidata:Requests for permissions/Bot.
  • Coordinate precision is one of the least understood feature here at Wikidata. Barely any editor knows what to enter there and just uses the value suggested by the UI; for bots, there are different approaches how to compute values to enter as precision. Coordinate precision is in fact a broken feature anyways, and I don't know whether anyone is using it at all. AFAIR, there are some discussions about the problem around somewhere in WD:PC-archives, phabricator, and maybe some other pages.

As I am busy with another bot job (which surfaced this problem) I will not immediately propose a bot fix to the community, but I think it might be worth to do so at some point in the future when I have more time.

Reply to "wikibase:GeoAutoPrecision"

Structured Data - early depicts testing

1
MediaWiki message delivery (talkcontribs)

The Structured Data on Commons development team has the very basic version of depicts statements available for early testing on Test-Commons. You can add very basic depicts statements to the file page by going into the new “Structured Data” tab located below the "Open in Media Viewer button." You can use the Latest Files link in the left side nav bar to select existing images, or use the UploadWizard to upload new ones to test with (although those images won’t actually show up on the site). The test site is not a fully functional replica of Commons, so there may be some overall problems in using the site, but you should be able to get a general idea of what using the feature is like.

Early next week I will call for broad, community-wide testing of the feature similar to what we did for Captions, with instructions for testing, known bugs, and a dedicated space to discuss the feature as well as a simple help page for using statements. Until then, you're welcome to post on the SDC talk page with what you might find while testing depicts.

Thanks in advance for trying it out, you'll be hearing more from me next week. -- Keegan (WMF) (talk) 22:00, 21 March 2019 (UTC)

Reply to "Structured Data - early depicts testing"