Open main menu

User talk:Pintoch

About this board

Previous discussion was archived at User talk:Pintoch/Archive 1 on 2017-06-21.

Jheald (talkcontribs)

Are there problems with the OpenRefine service?

I was doing a pretty standard reconciliation (Name + Date of Birth + Date of Death), and it's going incredibly slowly. Meanwhile the OpenRefine console is full of messages ending "message": "invalid query", "details": "'time'", "status": "error"} (28638 ms) -- where the final number can go anything up to 259785 ms, all apparently for a standard batch containing a dozen or so names.

Any idea what is going on here?

Pintoch (talkcontribs)

Hi Jheald,

Thanks for letting me know, that seems to be a bug. Could you share an example reconciliation query? Name, type and properties you send to the service.

Jheald (talkcontribs)

Note that I was running 3.2 beta, so possibly I need to upgrade.

A typical message I was getting back on the console was:

21:53:48.407 [ refine-standard-recon] {"arguments": {"lang": "en", "queries": "{\"q0\":{\"query\":\"Joe Milne\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1857 \"},{\"pid\":\"P570\",\"v\":\" 1911\"}],\"type_strict\":\"should\"},\"q1\":{\"query\":\"Tom J. Honeyman\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1891 \"},{\"pid\":\"P570\",\"v\":\" 1971\"}],\"type_strict\":\"should\"},\"q2\":{\"query\":\"Robert Wedderburn\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"c.1510 \"},{\"pid\":\"P570\",\"v\":\" 1556\"}],\"type_strict\":\"should\"},\"q3\":{\"query\":\"James Bell\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1769 \"},{\"pid\":\"P570\",\"v\":\" 1833\"}],\"type_strict\":\"should\"},\"q4\":{\"query\":\"James Murdoch Geikie\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1839 \"},{\"pid\":\"P570\",\"v\":\" 1915\"}],\"type_strict\":\"should\"},\"q5\":{\"query\":\"James Ivory\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1765 \"},{\"pid\":\"P570\",\"v\":\" 1842\"}],\"type_strict\":\"should\"},\"q6\":{\"query\":\"Naomi Mitchison\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1897 \"},{\"pid\":\"P570\",\"v\":\" 1999\"}],\"type_strict\":\"should\"},\"q7\":{\"query\":\"John James Audubon\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1785 \"},{\"pid\":\"P570\",\"v\":\" 1851\"}],\"type_strict\":\"should\"},\"q8\":{\"query\":\"William Douglas\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"c.1425 \"},{\"pid\":\"P570\",\"v\":\" 1452\"}],\"type_strict\":\"should\"},\"q9\":{\"query\":\"Robert Gibb\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1801 \"},{\"pid\":\"P570\",\"v\":\" 1837\"}],\"type_strict\":\"should\"}}"}, "message": "invalid query", "details": "'time'", "status": "error"} (83066ms)

Does that give you enough?

Pintoch (talkcontribs)

yes that's great, thanks a lot! I will investigate.

Jheald (talkcontribs)

(deleted)

Jheald (talkcontribs)

I wondered if it could be odd sorts of text in the births or deaths column (eg "7th C" or "c. 1025"), but even forcing those columns to be four digits, and using P569@year and P570@year for the properties, I'm still getting the same thing. (Error strings now at the top).

14:14:17.323 [ refine-standard-recon] {"status": "error", "details": "'time'", "message": "invalid query", "arguments": {"lang": "en", "queries": "{\"q0\":{\"query\":\"King William I\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1143\"},{\"pid\":\"P570\",\"v\":\"1214\"}],\"type_strict\":\"should\"},\"q1\":{\"query\":\"John Spottiswoode\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1510\"},{\"pid\":\"P570\",\"v\":\"1585\"}],\"type_strict\":\"should\"},\"q2\":{\"query\":\"Henry Balnaves\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1512\"},{\"pid\":\"P570\",\"v\":\"1579\"}],\"type_strict\":\"should\"},\"q3\":{\"query\":\"John Neilson\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1779\"},{\"pid\":\"P570\",\"v\":\"1855\"}],\"type_strict\":\"should\"},\"q4\":{\"query\":\"Lachlan Macquarie\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1761\"},{\"pid\":\"P570\",\"v\":\"1824\"}],\"type_strict\":\"should\"},\"q5\":{\"query\":\"John Campbell\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1680\"},{\"pid\":\"P570\",\"v\":\"1743\"}],\"type_strict\":\"should\"},\"q6\":{\"query\":\"Thomas Peck Hunter\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1923\"},{\"pid\":\"P570\",\"v\":\"1945\"}],\"type_strict\":\"should\"},\"q7\":{\"query\":\"John Anderson\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1796\"},{\"pid\":\"P570\",\"v\":\"1864\"}],\"type_strict\":\"should\"},\"q8\":{\"query\":\"Martin Martin\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1660\"},{\"pid\":\"P570\",\"v\":\"1718\"}],\"type_strict\":\"should\"},\"q9\":{\"query\":\"John Lyon\",\"type\":\"Q5\",\"properties\":[{\"pid\":\"P569\",\"v\":\"1544\"},{\"pid\":\"P570\",\"v\":\"1577\"}],\"type_strict\":\"should\"}}"}} (29960ms)

Pintoch (talkcontribs)

Hi Jheald,

I pushed a fix which is hopefully going to solve the problem. Could you try again if it works on your side? Thanks a lot again for reporting this and apologies for this issue!

Jheald (talkcontribs)

Thank you so much! Just done a new run now, and it was much much happier :-) No errors, altogether quicker, and a much more credible set with no choices. Looks good!

Reply to "OpenRefine problems?"

Ajouter un service standard de réconciliation

3
2le2im-bdc (talkcontribs)

Bonjour @Pintoch,

J'aurais aimé savoir si c'est compliqué d'ajouter un nouveau service de réconciliation dans Openrefine et qu'elle serait la marche à suivre.

En effet, on dispose d'un base de données bibliographiques en ligne (basée sur le logiciel Invenio) avec une interface API RESTful (je crois) qui nécessite des key API et cela serait super de pouvoir travailler avec Openrefine pour nettoyer nos données.

Merci d'avance de tes précisions.

Baptiste

Pintoch (talkcontribs)

Bonjour Baptiste,

Ce n'est pas très compliqué. Il faut implémenter l'API de réconciliation qui est décrite ici: https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-API Ça nécessite de programmer un petit service web qui fait l'interface entre OpenRefine et Invenio (ou alors, de programmer un module Invenio pour que ce service soit réutilisable directement depuis d'autres instances Invenio). Je travaille en ce moment à améliorer la documentation et l'outillage autour de cette API, par exemple en créant une liste de services publics et un banc de test pour ces services: https://reconciliation-api.github.io/testbench/

Si jamais vous cherchez quelqu'un pour implémenter ça, c'est le genre de projet sur lequel je travaille comme contractuel pour d'autres organisations, et j'ai du temps pour en faire un autre dans les semaines / mois qui viennent ;)

Antonin

2le2im-bdc (talkcontribs)

Super! Merci Antonin.

Je vais essayer de voir avec ma cheffe si j'arrive à dégager un budget pour cela! Je te tiens au courant dans tous les cas de sa réponse. Si cela se fait pas cette année, on essayera de le mettre au budget de l'année prochaine.

Merci encore pour tout ton boulot si utile.

Baptiste

Reply to "Ajouter un service standard de réconciliation"
Summary by Pintoch

unicode bug in property proposal script

CptViraj (talkcontribs)
Pintoch (talkcontribs)

Hi!

That is because this unicode character is not supported by Jython, which is one of the building blocks of the script I use to create properties. That change can be reverted after creation (as I have done). That is annoying indeed. Sorry for any inconvenience. If you prefer I can also avoid to create any property you comment on.

CptViraj (talkcontribs)

Nah it's fine, I don't have any problem. I just wanted to know the reason. Thank you!

Pintoch (talkcontribs)

Ok thanks! Please do not hold back from proposals for that reason - I really need to fix that bug.

Reminder: Community Insights Survey

1
MediaWiki message delivery (talkcontribs)

RMaung (WMF) 19:54, 20 September 2019 (UTC)

Reply to "Reminder: Community Insights Survey"
MediaWiki message delivery (talkcontribs)

RMaung (WMF) 17:38, 10 September 2019 (UTC)

Reply to "Community Insights Survey"
Eurohunter (talkcontribs)

Hello. I added Basshunter as example because it is much more detailed example than Ernst Cassirer. It is kinda unique example because has two urls instead just one and also itself it is very developed example so someone who will click at this example will notice many helpfull solutions. Basshunter was added as example to some ids even by other users. In some cases Basshunter has only one id so I refrained from replacing exaples with Basshunter exaple.

Pintoch (talkcontribs)

I see! My advice would still be not to replace existing examples by it - I think the community could treat that as spamming.

Eurohunter (talkcontribs)

It has no bad or neutral but postive value so?

Pintoch (talkcontribs)

I think there is value in diversity - it is good not to reuse the same example too often.

Eurohunter (talkcontribs)

Why not if other examples together offer less?

Eurohunter (talkcontribs)

So?

Pintoch (talkcontribs)

Hi Eurohunter,

I understand you like Basshunter very much, however the entire world does not revolve around this artist so I think it would be great if you could move on and avoid spamming this item on as many properties as you think.

Thank you!

Eurohunter (talkcontribs)

It's not matter who like Basshunter or not but it's just better example.

Pintoch (talkcontribs)

No it is not, and other users have already complained about your obsession with this item. Please do not reopen this thread, I have other things to do. Thank you!

Merci pour la création du P7226

5
Pmartinolli (talkcontribs)

Bonjour Pintoch et merci pour la création du P7226.

Serait-il possible de faire une modification au formatter URL pour avoir la possibilité de saisir des éléments sous cette forme https://rpggeek.com/$1 ?

Avec comme valeurs possibles : rpg/801 ou rpgitem/279037 ou rpgfamily/44793 ou rpgdesigner/1032, etc.

Je suis désolé c'est de ma faute, j'aurai dû mieux soigner la candidature de cet identifiant.

Merci

@Pmartinolli

Pintoch (talkcontribs)

Bonjour Pmartinolli,

Ça ne devrait pas être un problème à mon avis - tu peux le proposer sur Property_talk:P7226 avec un ping pour les gens qui ont soutenu la proposition. S'ils sont d'accord, tu devrais pouvoir changer le formatter URL directement.

Bonne continuation

Pmartinolli (talkcontribs)

Merci c'est fait. Il manque une étape que je ne sais pas faire : allowed values

Il faudrait autoriser toutes les chaînes de caractères sous la forme : [chaîne de lettres commençant au moins par "rpg"]/[chaîne de chiffres]

ex: rpg/001

ex: rpgitem/02548

ex: rpgdesigner/4587

ex: rpgpublisher/123

merci de votre aide,

@Pmartinolli


Pintoch (talkcontribs)

Fait!

Pmartinolli (talkcontribs)

Merci!

Nomen ad hoc (talkcontribs)
Pintoch (talkcontribs)

Dans la liste http://cussenot-fst-nancy.ahp-numerique.fr/cussenot2/gestion/fiche_liste.php, quand on clique sur un nom, on obtient une fiche du genre http://cussenot-fst-nancy.ahp-numerique.fr/cussenot2/fiche_personne.php?ref=279 (d'où l'identifiant numérique "279"). Mais ce n'est pas la même chose que tu proposes puisqu'une seule personne aura plusieurs tels identifiants (l'identifiant numérique correspond à une fiche particulière et il peut y en avoir plusieurs par personne)… donc je ne sais pas trop !

Nomen ad hoc (talkcontribs)

Ah oui, en effet, merci ! Eh bien, je ne sais pas trop ce qui convient le mieux... Parce qu'en dépit de la structure "recherche=X", les URL avec caractères majuscules semblent bien correspondre à des identifiants (il ne semble y avoir d'homonymes dans le corpus, et de fait je n'ai pas vu de doublons)

Reply to "Faculté des sciences de Nancy"
Jura1 (talkcontribs)
Pintoch (talkcontribs)

done, thanks.

Jura1 (talkcontribs)
Pintoch (talkcontribs)

Please do not reopen this thread, thank you. Pings work.

Visite fortuitement prolongée (talkcontribs)

Bonjour,

Êtes vous Q47472131 ? Si oui, acceptez vous que j'indique votre compte Wikipédia dans cette fiche Wikidata ?

Pintoch (talkcontribs)

Bonjour,

Oui ça ne pose pas de problème, même si j'ai des doutes sur l'admissibilité du sujet…

Merci !

Visite fortuitement prolongée (talkcontribs)

Fait.

Reply to "fiche Wikidata"
Return to the user page of "Pintoch".