Wikidata:WikiProject COVID-19/tabular data
This is a subproject page to discuss how to fix and automate tabular data for COVID, building on a presentation by Mxn:
- first in .tab files on Commons (allowing fast syncing of many updates at once, per source)
- then syncing w/ any less-fresh claims in WD
- then using the above data to generate/update tables on WP
Todo?
edit- Get a bot-family set up that knows how to interface with: Commons, Wikidata
- Keep current all claims like "cases" in Q87455852
- Write up what's needed to generalize mxn's work on SF Bay tables (in notes below)Generaliz
- document en:wp specific mappings, use pt:wp example as a test case for a generalization
- note other dependencies: modules - TabularData + MapFrame
- use Thiago as benchmark for whether this works ;)
- what sorts of bots could then help maintain entire WP tables, or sets of tables?
- For instance: how can we remove most overhead for maintaining tables such as COVID-19 pandemic medical cases in California by county (en:wp)?
Notes 6/1
editRelated Commons pages:
- Category of tabular COVID data on commons (ex: in SF specifically)
- These are used to render some of the tables here: en:COVID-19_pandemic_in_the_San_Francisco_Bay_Area (en:wp)
- Compare with manual effort at w:Template:COVID-19 pandemic data/California medical cases by county
- Related module: w:en:Module:Medical_cases_data/San_Francisco_Bay_Area (en:wp module)
- These are used to render some of the tables here: en:COVID-19_pandemic_in_the_San_Francisco_Bay_Area (en:wp)
Related Phab tasks and tools
- WYSIWYG editor efforts
- conversion to/from G! spreadsheets (see Vera's work and more)
Related bots:
- mxn's "external-data-bot"
- calls SF's open data portal. goes to a clipboard. pasted as a json row in commons/.tab
- NB - counties revise historical days. using a script updates the whole table. !
- --> does it update refs to indicate the change? MINI TODO: standard for this.
- save after the paste: data updates.
- NB - counties revise historical days. using a script updates the whole table. !
Next steps: hook up to cron job and bot on Toolforge; also update Wikidata statements using QuickStatements
Related external tools:
: CoronaDataScraper -- doesn't get all the counties /right/ but could be fixed to. :: Hope to update those projects to get things right, for all counties.