Wikidata:WikiProject 20th Century Press Archives/Tools & Tasks/Log

2017

August 2017

Property Pressemappe 20. Jahrhundert IFIS proposed (by User:YMS)

October 2017

purl.org persistent URIs for PM20 folders introduced

Property PM20 folder ID (P4293) for person/company/wares/subject headings folders introduced, based on purl.org URIs

M-n-m catalog PM folder ID (created by User:Magnus_Manske)

Added PM20 folder ID (P4293) to items identified via GND ID (P227) (from PM20 Beacon lists)

2018

March 2018

DFG-Viewer folder view for all PM20 folders (spin-off from P20-LOD)

June 2018

Example application Map of economists in PM20 by place of birth

Pattern for inexactly matching companies introduced

July 2018

CC0 license assigned to 20th Century Press Archives (Q36948990) metadata

SPARQL endpoint http://zbw.eu/beta/sparql/pm20/query, for now with labels and document counts

August 2018

Qualifier number of works accessible online (P5592) introduced

number of works (P3740) and number of works accessible online (P5592) for 5508 items added via QS (#3316 - #3319)

October 2018

doc counts (including 0/unknown) for 4550 items added (QS #4815 - #4817)

Github repo for Coding da Vinci Rhein-Main 2018, persons and companies folders (dataset download)

Extended SPARL endpoint

Alpha vocabs in Skosmos

November 2018

Bot request for adding items from PM20

Batch pm20 add class 1 157 organization classes (wikidata/results/missing_class_via_pm20.2018-11-29.qs.txt)

Batch pm20 doc count 10 for 91 items (pm20/results/folder_doc_counts.2018-11-29.qs.txt)

December 2018

Unnamed batch "companies" for 20 items (companies_missing_in_wikidata.2018-12-04.qs.txt)

2019

February 2019

Batch pm20 doc count 11 for 471 items (pm20/results/folder_doc_counts.2019-02-26.qs.txt)

Unnamed batch "named as" for 26 (+3) (+9) subject items (pm20/results/folder_names.2019-02-26.qs.txt)

Batch pm20 doc count 12 for 543 items (wikidata/results/folder_doc_counts.2019-02-28.qs.txt)

March 2019

Wikidata:WikiProject 20th Century Press Archives created

June 2019

Batch pm20 via gnd 2 for 100 items ../wikidata/results/missing_pm20_id_via_gnd.2019-06-13.qs.txt

Batch pm20 folder name for 9 items ../wikidata/results/pm20_folder_names.2019-06-13.qs.txt

Batch pm20 doc count 13 for 42 items ../wikidata/results/pm20_folder_doc_counts.2019-06-13.qs.txt (33 errors, vanished with re-run)

Tests with generated new items

All missing pm20 person items - Batch pm20 person add for 346 items ../pm20/results/persons_missing_in_wikidata.2019-06-13.qs.txt (77 errors, vanished all but 1 with "Try to reset errors")

Batch enhance P569/P570 (one item) and P227 pm20 enhance P227 for 60 items ../pm20/results/P227_property_missing_in_wikidata.2019-06-13.qs.txt

Batch pm20 doc count 14 for 356 items ../wikidata/results/pm20_folder_doc_counts.2019-06-14.qs.txt

Batch pm20 occupation economist for 64 items ../pm20/results/P106_wd_occupation_economist.2019-06-14.qs.txt

July 2019

Batch pm20 family 1 for 42 items ../pm20/results/P53_wd_person_family.2019-07-16.qs.txt

September 2019

Mix-n-Match catalog for newspapers

October 2019

Batch pm20 occupation social|earth scientist for 9 items ../pm20/results/P106_wd_occupation_economist.2019-10-03.qs.txt

Batch pm20_company_founder_1 for 54 items ../wikidata/results/P112_pm20_company_person.2019-10-05.qs.txt

Batch pm20_company_advisory_board_1 for 56 items ../wikidata/results/P5052_pm20_company_person.2019-10-05.qs.txt

Batch pm20_company_board_1 for 749 items ../wikidata/results/P3320_pm20_company_person.2019-10-05.qs.txt

Batch pm20 doc count 15 for 27 items ../wikidata/results/pm20_folder_doc_counts.2019-10-17.qs.txt

Batch pm20 pe folder names 1 for 9471 items ../pm20/results/folder_names_qs.2019-10-18.qs.txt

Batch pm20 via gnd 3 for 13 items ../wikidata/results/missing_pm20_id_via_gnd.2019-10-18.qs.txt

2020

April 2020

Batch pm20 pe folder name 2 for 120 items ../pm20/results/folder_names_qs.2020-04-02.qs.txt

Batch pm20 doc count 16 for 54 items ../wikidata/results/pm20_folder_doc_counts.2020-04-02.qs.txt

Batch folder name 3 for 25 items ../pm20/results/folder_names_qs.2020-04-21.qs.txt

Batch doc count 17 for 15 items (errors resolved by re-run) ../wikidata/results/pm20_folder_doc_counts.2020-04-21.qs.txt

Created Germany : Individual diseases and their control (Q91257808) as example item for subject folders, with according PM20 folder classes

May 2020

Batch pm20 economist 2 for 5 titems ../pm20/results/P106_wd_occupation_economist.2020-05-25.qs.txt

June 2020

Mapping of the PM20 geographic categories to WD created

July 2020

Properties PM20 geo code (P8483) and PM20 subject code (P8484) introduced

Data model for country/subject archives finalized

August 2020

Batch pm20 sh geo code 1 for 146 items. Large number of errors with almost all qualifiers, resolved by 4 re-runs ../pm20/results/add_category_code.2020-08-13.qs.txt

Batch pm20 geo doc count 1 for 145 items. Errors with all number of works (P3740) values - had to be repeated in a separate job with statements with only this property ../pm20/results/add_category_doc_counts.2020-08-14.qs.txt

September 2020

Batch pm20 subject folders 1 for 156 items ../pm20/results/subject_folders_for_wikidata.2020-09-16.qs.txt

Batch pm20 subject category 1 for 155 items ../pm20/results/subject_categories_for_wikidata.2020-09-17.qs.txt

Batch pm20 subject category P361 1 for 131 items ../pm20/results/P361_wd_category_partof.2020-09-18.qs.txt

Batch pm20 subject folder 2 for 20 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_a.qs.txt

Batch pm20 subject folder 3 for 50 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_b.qs.txt

Batch pm20 subject folder 4 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_c.qs.txt

Batch pm20 subject folder 5 and pm20 subject folder 6 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-24.qs.txt

Batch pm20 subject folder 6 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-28.qs.txt

Run "pm20 subject folder 7" for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_a.qs.txt

Run "pm20 subject folder 8" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_b.qs.txt

Run "pm20 subject folder 9" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_c.qs.txt

Run "pm20 subject folder 10" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_d.qs.txt hanging after 315 items, aborted

Run "pm20 subject folder 11" for 839 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_e.qs.txt

December 2020

Preparations for deeper nested subject categories and folders (English labels, proper hierarchy, etc.)

2021

January 2021

Run "pm20 subject category 2" for 100 items ../pm20/results/subject_categories_for_wikidata.2021-01-06a.qs.txt

Run "pm20 subject category P361 2" for 117 items ../pm20/results/P361_wd_category_partof.2021-01-06a.qs.txt

Batch pm20 subject category 3 for 99 of 100 items ../pm20/results/subject_categories_for_wikidata.2021-01-06b.qs.txt

Batch pm20 subject category 4 for 296 of 300 items ../pm20/results/subject_categories_for_wikidata.2021-01-06c.qs.txt

Batch pm20 subject category 5 for 300 items ../pm20/results/subject_categories_for_wikidata.2021-01-07a.qs.txt (including formerly erronous, after making labels unique)

Batch pm20 subject category 6 for 443 items ../pm20/results/subject_categories_for_wikidata.2021-01-07b.qs.txt

Run "pm20 subject category 7" for 55 items ../pm20/results/subject_categories_for_wikidata.2021-01-07c.qs.txt (missing folderCount=0)

Run "pm20 subject category 8" for 3 items ../pm20/results/subject_categories_for_wikidata.2021-01-07d.qs.txt (missing folderCount=0)

Manual cleanup of ~ 50 duplicates produced by QS in batch mode

Batch pm20 subject category P361 2 for 1174 items ../pm20/results/P361_wd_category_partof.2021-01-07a.qs.txt

Batch pm20 subject category P8484 1 for 1451 items ../pm20/results/P8484_wd_category_partof.2021-01-07a.qs.txt

Run "pm20 subject category 9" for 5 of 6 items ../pm20/results/subject_categories_for_wikidata.2021-01-07e.qs.txt (more hierarchy fixes)

Batch pm20 subject category P361 3 for 23 items ../pm20/results/P361_wd_category_partof.2021-01-07b.qs.txt (hierarchy fixes)

Run "pm20 geo category P8483" for 152 items ..//pm20/results/P8483_wd_geo_category_longnotation.2021-01-08.qs.txt

Run "pm20 subject folder" for 20 items ../pm20/results/subject_folders_for_wikidata.2021-01-08a.qs.txt

Run "pm20 subject folder" for 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08b.qs.txt

Run "pm20 subject folder" for 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08c.qs.txt

Run "pm20 subject folder" for 468 of 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08d.qs.txt

Run "pm20 subject folder" for 2000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08e.qs.txt

Run "pm20 subject folder" for 939 items ../pm20/results/subject_folders_for_wikidata.2021-01-08f.qs.txt

Batch pm20 folder name 4 for 211 items ../pm20/results/folder_names_qs.2021-01-20.qs.txt

Batch pm20 doc count 18 for 2000 items ../pm20/results/folder_doc_counts.2021-01-20a.qs.txt 559 errors (for P3740 "somevalue") after multiple tries to reset

Run "pm20 doc count" for 200 items ../pm20/results/folder_doc_counts.2021-01-21a.qs.txt

Run "pm20 doc count" for 2000 items ../pm20/results/folder_doc_counts.2021-01-21b.qs.txt aborted after c. 700 items

Run "pm20 doc count" for 1000 items ../pm20/results/folder_doc_counts.2021-01-21c.qs.txt aborted after c. 300 items

Batch pm20 doc count 19 for 1000 items ../pm20/results/folder_doc_counts.2021-01-21d.qs.txt multiple errors, most resetable

Batch pm20 doc total count 1 for 1000 items ../pm20/results/folder_doc_total_count.2021-01-21a.qs.txt 42 errors, reset to 34

Batch pm20 doc total count 2 for 5223 items ../pm20/results/folder_doc_total_count.2021-01-21b.qs.txt 243 errors -> reset 182 -> reset 182 (all "somevalue")

Batch pm20 doc online count 1 for 100 items ../pm20/results/folder_doc_online_count.2021-01-21a.qs.txt

Batch pm20 doc online count 2 for 6122 items ../pm20/results/folder_doc_online_count.2021-01-21b.qs.txt

February 2021

Batch pm20 via gnd 4 for 172 items ../wikidata/results/missing_pm20_id_via_gnd.2021-02-19.qs.txt

March 2021

Run "pm20 via gnd 5" for 5 items ../wikidata/results/missing_pm20_id_via_gnd.2021-03-26.qs.txt

Run "pm20 company founder 2" for 4 items ../wikidata/results/P112_pm20_company_person.2021-03-26.qs.txt

Batch pm20 company board 2 for 25 items /opt/sparql-queries/wikidata/results/P3320_pm20_company_person.2021-03-26.qs.txt - Required some retries

April 2021

Github repo for Coding da Vinci SH 2021, updated persons and companies folders (dataset download)

Map company/institution types to Wikidata (per query)

Mix-n-Match catalog PM20 companies nl

Run "companies 2 (nl)" for adding 164 items ../pm20/results/companies_missing_in_wikidata.2021-04-30.qs.txt

For companies nl, in total: ~ 50 linked, 166 added

May 2021

Batch pm20 id via wp link 1 for 573 items ../wikidata/results/missing_pm20_id_via_wplink.2021-05-03.qs.txt

Mix-n-match catalog PM20 companies en

Run "companies 3 (en) adding 33 items /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-05-07.qs.txt

Multiple small batches and manual insertions, up to adding the last 93 items for companies en /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-05-27.qs.txt

For companies en, in total: ~ 750 linked, 1454 added

At start of Wikilang de (2021-05-27), 2737 not linked (RT does not count here) - first newly created Q107013760

For Wikilang und, 125 not linked; for Wikilang fr, 1022 not linked

Mix-n-Match catalog PM20 companies de

June 2021

Multiple small batches and manual insertions, up to adding the last 231 items for companies de /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-06-10.qs.txt

For companies de, in total: 244 linked, 2493 added

Mix-n-Match catalog PM20 companies fr (initially: 257 manually, 24 automatically, 985 not matched)

Multiple small batches and manual insertions, up to adding the last 20 items for companies fr /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-06-17.qs.txt

For companies fr, in total: 141 linked, 868 added

Mix-n-Match catalog PM20 companies div (initially: c. 75 manually, 0 automatically, c. 110 not matched)

For companies div, in total: c. 35 linked, 75 added

Batch pm20 folder name 6 for 3000 items ../pm20/results/folder_names_qs.2021-06-18a.qs.txt

Batch pm20 folder name 7 for 3000 items ../pm20/results/folder_names_qs.2021-06-18b.qs.txt

Batch pm20 folder name 8 for 3271 items ../pm20/results/folder_names_qs.2021-06-18.qs.txt

Batch pm20 doc count 20 for 3500 items ../pm20/results/folder_doc_total_count.2021-06-21a.qs.txt

Batch pm20 doc count 21 for 3647 items ../pm20/results/folder_doc_total_count.2021-06-21.qs.txt

plus interactive run for the remaining errors (in particular, somevalue entries)

Batch pm20 doc online count 3 for 2999 items ../pm20/results/folder_doc_online_count.2021-06-21a.qs.txt

Batch pm20 doc online count 3 for 3965 items ../pm20/results/folder_doc_online_count.2021-06-21.qs.txt

Various cleanups

Batch pm20 folder name 9 for 176 items ../pm20/results/folder_names_qs.2021-06-28.qs.txt

Batch pm20 doc total count 22 for 144 items ../pm20/results/folder_doc_total_count.2021-06-28.qs.txt

Batch pm20 doc online count 4 for 138 items ../pm20/results/folder_doc_online_count.2021-06-28.qs.txt

Batch pm20 fr labels for 848 items ../pm20/results/wd_french_labels.2021-06-28.qs.txt

Batch pm20 co inception for 310 items ../pm20/results/P571_property_missing_in_wikidata.2021-06-28.qs.txt

Batch pm20 co demolition for 205 items ../pm20/results/P576_property_missing_in_wikidata.2021-06-28.qs.txt

Batch pm20 co add gnd for 880 items ../pm20/results/P227_property_missing_in_wikidata.2021-06-28.qs.txt

Batch pm20 co add P31 for 167 items ../pm20/results/P31_property_missing_in_wikidata.2021-06-29.qs.txt

Batch pm20 co founder for 43 items ../wikidata/results/P112_property_missing_in_wikidata.2021-06-29.qs.txt

Batch pm20 co board for 80 items ../wikidata/results/P3320_property_missing_in_wikidata.2021-06-29.qs.txt

Batch pm20 co advisory board for 29 items ../wikidata/results/P5052_property_missing_in_wikidata.2021-06-29.qs.txt

July 2021

Batch pm20 co parent for 954 items (+ inverse) ../wikidata/results/P749_pm20_company_parent.2021-07-01.qs.txt

Batch pm20 co predecessor for 760 items (+ inverse) ../wikidata/results/P749_pm20_company_predecessor.2021-07-02.qs.txt

Batch pm20 company location 1 for 2000 items ../wikidata/results/P159_pm20_company_location.2021-07-05a.qs.txt

Batch pm20 company location 2 for 2268 items ../wikidata/results/P159_pm20_company_location.2021-07-05.qs.txt

Run "pm20 co country 1" for 198 items (NL) ../wikidata/results/P159_pm20_company_country.2021-07-09a.qs.txt

Batch pm20 co country 2 for 1608 items (GB) ../wikidata/results/P159_pm20_company_country.2021-07-09b.qs.txt

Batch pm20 co country 3 for 2000 items (DE) ../wikidata/results/P159_pm20_company_country.2021-07-09c.qs.txt

Batch pm20 co country 4 for 246 items (DE) ../wikidata/results/P159_pm20_company_country.2021-07-09d.qs.txt

Batch pm20 co country 5 for 1833 items (div) ../wikidata/results/P159_pm20_company_country.2021-07-09e.qs.txt

Batch pm20 co nace 1 for 2000 items /opt/sparql-queries/wikidata/results/P452_pm20_company_nace.2021-07-20a.qs.txt

Batch pm20 co nace 2 for 2258 items /opt/sparql-queries/wikidata/results/P452_pm20_company_nace.2021-07-20.qs.txt

Batch pm20 co nace 1 method for 1995 items ../wikidata/results/P452_pm20_company_nace_method.2021-07-20a.qs.txt

Batch pm20 co nace 2 method for 2258 items ../wikidata/results/P452_pm20_company_nace_method.2021-07-20.qs.txt

Batch pm20 co industry 1 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21a.qs.txt

Batch pm20 co industry 2 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21b.qs.txt

Batch pm20 co industry 3 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21c.qs.txt

Batch pm20 co industry 4 for 2943 items ../wikidata/results/P452_pm20_company_industry.2021-07-21d.qs.txt

2022

July

Property PM20 ware ID (P10890) created

August

Batch pm20 ware id for 83 items (matching from OpenRefine) ../pm20/results/wd_waren_links.qs.txt

Run "pm20 ware categories" for 5 special category items ../pm20/results/ware_categories_for_wikidata.2022-08-01.qs.txt

Batch pm20 create ware folder items 2 for 1520 items ../pm20/results/ware_folders_for_wikidata.2022-08-04.qs.txt

Batch pm20 doc total count 6 for 1808 items ../pm20/results/folder_doc_online_count.2022-08-04.qs.txt - 175 errors remaining ("{ "type": "somevalue", "value": "somevalue" }"), fixed by running the statements interactively

Batch pm20 doc online count 6 for 1763 items ../pm20/results/folder_doc_online_count.2022-08-04.qs.txt

Dezember

Batch pm20 sh geo code 2 (should be wa geo code) for 154 items ../pm20/results/add_category_code.2022-12-28.qs.txt

Batch pm20 create ware folder items 2 for 1333 items ../pm20/results/ware_folders_for_wikidata.2022-12-28.qs.txt

Batch pm20 doc total count 7 for 1364 items ../pm20/results/folder_doc_total_count.2022-12-28.qs.txt

Batch pm20 doc online count 7 for 1462 items ../pm20/results/folder_doc_online_count.2022-12-28.qs.txt

Run "create ware folder items 3" for 36 missing items ../pm20/results/ware_folders_for_wikidata.2022-12-29.qs.txt

Run "pm20 doc total count 8" for 79 items ../pm20/results/folder_doc_total_count.2022-12-29.qs.txt

Batch pm20 doc online count 8 for 1462 items ../pm20/results/folder_doc_online_count.2022-12-28.qs.txt

Batch pm20 ware name 1 for 95 items (ware categories) ../pm20/results/ware_names_qs.2022-12-30.qs.txt

2023

January

Batch pm20 category partof qualifier for 1437 items ../pm20/results/P361_wd_category_partof.2023-01-10.qs.txt

Run "wd category haspart" for 1428 items ../pm20/results/P527_wd_category_haspart.2023-01-10.qs.txt

Batch pm20 folder subject remove 1 for 53 items ../pm20/results/folder_subject_remove_qs.2023-01-11.qs.txt

Batch pm20 folder subject add 1 for 54 items ../pm20/results/folder_subject_add_qs.2023-01-11.qs.txt

July

temporary Batch load film section, 1st filming co for 2283 items

November

Full-text search function https://pm20-search.toolforge.org added

2024

February

Batch add film sections h1_co 2 for 5 items ../data/wd_input/add_film_sections_h1_co_2.qs.txt

Batch add film sections h2_co for 625 items ../data/wd_input/add_film_sections_h2_co.qs.txt

April

Batch add filmsections h1_co for 2 items ../data/wd_input/add_film_sections_h1_co.2024-04-08.qs.txt - apparently duplicate to prior runs

Batch add filmsections h2_co for 164 items ../data/wd_input/add_film_sections_h2_co.2024-04-08.qs.txt