Does anyone think there would be any benefit for me ingesting this entire site and making a massive json dump of the data?
forum.officer.com
This is a forum for police officers to discuss things and there's been a lot of activity in the forums.
Conversation
That said, I have some pre-existing Python code to scrape forums similar to this one. Would any software engineers be willing to help lend a hand on this project?
Mainly the core of the code is reusable, it's just a matter of matching DOM elements and extracting specific fields
Replying to
Developing the code would probably take around 4-6 hours if you already have experience with Python and HTML Dom elements. The bulk of the time will be actually running the code and walking through every forum topic -> post -> comments.
1
1