I added a couple of constraints to better identify HTML tags still present in titles. I found
Current output is at Wikidata:Database_reports/Constraint_violations/P1476
These end up in title and labels. It would be good to strip them before addition, e.g. by your bot at https://www.wikidata.org/w/index.php?title=Q54541874&oldid=687735354
We work with 150k of the 100M scientific papers in CrossRef and we see a couple other "problems" in titles that are much harder to clean
Pass this through a couple of mis-escaped steps and the garbage is horrible.
We had Wikidata:Property_proposal/title_in_TeX as a proposal to solve part of that.
So @Jura1 where is the best forum to discuss this difficult problem? It's first a data recognition and cleaning problem, and only secondarily a data representation problem.
The first list has now reached the maximum number possible for {{Ping project}}. Please therefore add your name to the second list below.
To ping both lists, use {{Ping project|Source MetaData}} and {{Ping project|Source MetaData/More}} in two different posts.
The participants listed below can be notified using the following template in discussions:
{{Ping project|Uq5xbs4ookdl1b6w}}Mattsenate (talk) 13:11, 8 August 2014 (UTC)
KHammerstein (WMF) (talk) 13:15, 8 August 2014 (UTC)
Mitar (talk) 13:17, 8 August 2014 (UTC)
Mvolz (talk) 18:07, 8 August 2014 (UTC)
Daniel Mietchen (talk) 18:09, 8 August 2014 (UTC)
Merrilee (talk) 13:37, 9 August 2014 (UTC)
Pharos (talk) 14:09, 9 August 2014 (UTC)
DarTar (talk) 15:46, 9 August 2014 (UTC)
HLHJ (talk) 09:11, 11 August 2014 (UTC)
Lawsonstu (talk) 15:15, 11 August 2014 (UTC)
Blue Rasberry (talk) 18:02, 11 August 2014 (UTC)
Micru (talk) 20:11, 12 August 2014 (UTC)
JakobVoss (talk) 12:23, 20 August 2014 (UTC)
Finn Årup Nielsen (fnielsen) (talk) 02:06, 23 August 2014 (UTC)
Jodi.a.schneider (talk) 09:24, 25 August 2014 (UTC)
Abecker (talk) 23:35, 5 September 2014 (UTC)
Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 14:21, 24 October 2014 (UTC)
Mike Linksvayer (talk) 23:26, 18 October 2014 (UTC)
Kopiersperre (talk) 20:33, 20 October 2014 (UTC)
Jonathan Dugan (talk) 21:03, 20 October 2014 (UTC)
Hfordsa (talk) 19:26, 5 November 2014 (UTC)
Vladimir Alexiev (talk) 15:09, 23 January 2015 (UTC)
Runner1928 (talk) 03:25, 6 May 2015 (UTC)
Pete F (talk)
econterms (talk) 13:51, 19 August 2015 (UTC)
Sj (talk)
author TomT0m / talk page
guillom (talk) 21:57, 4 January 2016 (UTC)
·addshore· talk to me! 17:43, 18 January 2016 (UTC)
Bodhisattwa (talk) 16:08, 29 January 2016 (UTC)
Ainali (talk) 16:51, 29 January 2016 (UTC)
Shani Evenstein (talk) 21:29, 5 July 2018 (UTC)
Skim (talk) 07:17, 6 November 2018 (UTC)
PKM (talk) 23:19, 19 November 2018 (UTC)
Ocaasi (talk) 22:19, 29 November 2018 (UTC)
The participants listed below can be notified using the following template in discussions:
{{Ping project|Uq5xbs4ookdl1b6w}}LeadSongDog (talk) 21:42, 23 March 2016 (UTC)
RobLa-WMF (talk) 01:24, 25 March 2016 (UTC)
BrillLyle (talk) 04:27, 30 March 2016 (UTC)
Kosboot (talk) 20:45, 30 March 2016 (UTC)
Sydney Poore/FloNight♥♥♥♥ 15:10, 14 April 2016 (UTC)
Peaceray (talk) 18:40, 28 April 2016 (UTC)
PKM (talk) 16:29, 1 May 2016 (UTC)
Aubrey (talk) 12:42, 25 August 2016 (UTC)
Chiara (talk) 12:47, 25 August 2016 (UTC)
Marchitelli (talk) 19:02, 1 September 2016 (UTC)
YULdigitalpreservation (talk) 17:44, 9 December 2016 (UTC)
Satdeep Gill (talk) 14:59, 2 February 2017 (UTC)
Pintoch (talk) 09:44, 28 February 2017 (UTC)
Raymond Ellis (talk) 16:06, 1 April 2017 (UTC)
Crazy1880 (talk) 18:21, 16 June 2017 (UTC)
T Arrow (talk) 07:55, 22 June 2017 (UTC)
GerardM (talk) 08:25, 30 July 2017 (UTC) With a particular interest of opening up sources about Botany and opening up any freely licensed publications.
Clifford Anderson (talk) 18:26, 11 August 2017 (UTC)
Jsamwrites (talk) 07:52, 27 August 2017 (UTC)
Krishna Chaitanya Velaga (talk) 09:52, 19 September 2017 (UTC)
Capankajsmilyo (talk) 18:32, 19 September 2017 (UTC)
Hsarrazin (talk) 20:41, 15 October 2017 (UTC)
Mlemusrojas (talk) 10:15, 6 December 2017 (UTC)
Samat (talk)
Ivanhercaz 
Simon Cobb (User:Sic19 - talk page) 21:20, 21 January 2018 (UTC)
Mahdimoqri (talk) 20:22, 26 March 2018 (UTC)
Maria zaos (talk) 18:45, 9 April 2018 (UTC)
Jaireeodell (talk) 14:07, 23 April 2018 (UTC)
Egon Willighagen (talk) 12:29, 10 May 2018 (UTC)
RobinMelanson (talk) 2:13, 25 November 2018 (UTC)
Vladimir Alexiev (talk) 03:02, 4 December 2018 (UTC) interested, in particular because of TRR project https://m.wikidata.org/wiki/Q56259739
The first list has now reached the maximum number possible for {{Ping project}}. Please therefore add your name to the second list below.
To ping both lists, use {{Ping project|Source MetaData}} and {{Ping project|Source MetaData/More}} in two different posts.
The participants listed below can be notified using the following template in discussions:
{{Ping project|Uq5xbs4ookdl1b6w}}Mattsenate (talk) 13:11, 8 August 2014 (UTC)
KHammerstein (WMF) (talk) 13:15, 8 August 2014 (UTC)
Mitar (talk) 13:17, 8 August 2014 (UTC)
Mvolz (talk) 18:07, 8 August 2014 (UTC)
Daniel Mietchen (talk) 18:09, 8 August 2014 (UTC)
Merrilee (talk) 13:37, 9 August 2014 (UTC)
Pharos (talk) 14:09, 9 August 2014 (UTC)
DarTar (talk) 15:46, 9 August 2014 (UTC)
HLHJ (talk) 09:11, 11 August 2014 (UTC)
Lawsonstu (talk) 15:15, 11 August 2014 (UTC)
Blue Rasberry (talk) 18:02, 11 August 2014 (UTC)
Micru (talk) 20:11, 12 August 2014 (UTC)
JakobVoss (talk) 12:23, 20 August 2014 (UTC)
Finn Årup Nielsen (fnielsen) (talk) 02:06, 23 August 2014 (UTC)
Jodi.a.schneider (talk) 09:24, 25 August 2014 (UTC)
Abecker (talk) 23:35, 5 September 2014 (UTC)
Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 14:21, 24 October 2014 (UTC)
Mike Linksvayer (talk) 23:26, 18 October 2014 (UTC)
Kopiersperre (talk) 20:33, 20 October 2014 (UTC)
Jonathan Dugan (talk) 21:03, 20 October 2014 (UTC)
Hfordsa (talk) 19:26, 5 November 2014 (UTC)
Vladimir Alexiev (talk) 15:09, 23 January 2015 (UTC)
Runner1928 (talk) 03:25, 6 May 2015 (UTC)
Pete F (talk)
econterms (talk) 13:51, 19 August 2015 (UTC)
Sj (talk)
author TomT0m / talk page
guillom (talk) 21:57, 4 January 2016 (UTC)
·addshore· talk to me! 17:43, 18 January 2016 (UTC)
Bodhisattwa (talk) 16:08, 29 January 2016 (UTC)
Ainali (talk) 16:51, 29 January 2016 (UTC)
Shani Evenstein (talk) 21:29, 5 July 2018 (UTC)
Skim (talk) 07:17, 6 November 2018 (UTC)
PKM (talk) 23:19, 19 November 2018 (UTC)
Ocaasi (talk) 22:19, 29 November 2018 (UTC)
The participants listed below can be notified using the following template in discussions:
{{Ping project|Uq5xbs4ookdl1b6w}}LeadSongDog (talk) 21:42, 23 March 2016 (UTC)
RobLa-WMF (talk) 01:24, 25 March 2016 (UTC)
BrillLyle (talk) 04:27, 30 March 2016 (UTC)
Kosboot (talk) 20:45, 30 March 2016 (UTC)
Sydney Poore/FloNight♥♥♥♥ 15:10, 14 April 2016 (UTC)
Peaceray (talk) 18:40, 28 April 2016 (UTC)
PKM (talk) 16:29, 1 May 2016 (UTC)
Aubrey (talk) 12:42, 25 August 2016 (UTC)
Chiara (talk) 12:47, 25 August 2016 (UTC)
Marchitelli (talk) 19:02, 1 September 2016 (UTC)
YULdigitalpreservation (talk) 17:44, 9 December 2016 (UTC)
Satdeep Gill (talk) 14:59, 2 February 2017 (UTC)
Pintoch (talk) 09:44, 28 February 2017 (UTC)
Raymond Ellis (talk) 16:06, 1 April 2017 (UTC)
Crazy1880 (talk) 18:21, 16 June 2017 (UTC)
T Arrow (talk) 07:55, 22 June 2017 (UTC)
GerardM (talk) 08:25, 30 July 2017 (UTC) With a particular interest of opening up sources about Botany and opening up any freely licensed publications.
Clifford Anderson (talk) 18:26, 11 August 2017 (UTC)
Jsamwrites (talk) 07:52, 27 August 2017 (UTC)
Krishna Chaitanya Velaga (talk) 09:52, 19 September 2017 (UTC)
Capankajsmilyo (talk) 18:32, 19 September 2017 (UTC)
Hsarrazin (talk) 20:41, 15 October 2017 (UTC)
Mlemusrojas (talk) 10:15, 6 December 2017 (UTC)
Samat (talk)
Ivanhercaz
Simon Cobb (User:Sic19 - talk page) 21:20, 21 January 2018 (UTC)
Mahdimoqri (talk) 20:22, 26 March 2018 (UTC)
Maria zaos (talk) 18:45, 9 April 2018 (UTC)
Jaireeodell (talk) 14:07, 23 April 2018 (UTC)
Egon Willighagen (talk) 12:29, 10 May 2018 (UTC)
RobinMelanson (talk) 2:13, 25 November 2018 (UTC)
Vladimir Alexiev (talk) 03:02, 4 December 2018 (UTC) interested, in particular because of TRR project https://m.wikidata.org/wiki/Q56259739
Daniel Mietchen DarTar Ppgardne Michael Cochez Alexander Doria Maximilianklein Renepick Lambert Heller Beat Estermann Cornelia Flavia Veja Tobias1984 Silvio Peroni Alastair Dunning Aubrey Snipre Andrew Su Karima Rafes Alen Vodopijevec Henry Rzepa Scott Edmunds Emw Matthiassamwald Missvain Vladimir Alexiev Petermr WiseWoman Jodi.a.schneider NavinoEvans Jan van Oort Andy Mabbett Konrad Foerstner Egon Willighagen Ben Moore Z. Ainali HLHJ Ale Abdo a.k.a. Solstag jibe-b GuZ-MPG Kristina Hettne Lilaroja Runner1928 Almondega lv_ra Finn Årup Nielsen (fnielsen) Rudy Patard ArthurPSmith Diana de la Iglesia Netha Pintoch OdileB YULdigitalpreservation Lozana Rossenova Jonathan Brier a.k.a. wolfgang8741 Jneubert econterms T0mpr1c3 Vladimir Alexiev Ivanhercaz Trilotat Benjamenta Nomen ad hoc Tris T7
I don't think we should start adding html with P1476. As for other formats, the tex proposal was a good start.
Rather than assuming a single format would it not be better to create Wikidata:Property_proposal/formatted_title and Wikidata:Property proposal/title format so that multiple formats can be supported?