Conversation

I've created an example script for parsing data from Wikipedia tables. This script parses out city / state data for the top cities in the U.S. by population. The goal is to eventually parse out Coronavirus tweets by locations mentioned in the tweet.

github.com

GitHub - pushshift/parse_wiki_tables: Simple Example to parse out data from Wikipedia tables using...

Simple Example to parse out data from Wikipedia tables using selectolax - GitHub - pushshift/parse_wiki_tables: Simple Example to parse out data from Wikipedia tables using selectolax

2:21 AM · Mar 30, 2020Twitter Web App

Replying to

Have you looked at Wikidata?

Replying to

Yeah -- that's probably the ideal source to grab this kind of data.

Replying to

The Geonames dumps are great for this kind of thing. Having done this before, I'd suggest cities15000.zip and population filtering. alternateNamesV2.zip is also useful. download.geonames.org/export/dump/re

Replying to

and

concur; have used Geonames for similar stuff and works well