Does anyone think there would be any benefit for me ingesting this entire site and making a massive json dump of the data?
forum.officer.com
This is a forum for police officers to discuss things and there's been a lot of activity in the forums.
Conversation
Replying to
That said, I have some pre-existing Python code to scrape forums similar to this one. Would any software engineers be willing to help lend a hand on this project?
Mainly the core of the code is reusable, it's just a matter of matching DOM elements and extracting specific fields
1
2
3
Developing the code would probably take around 4-6 hours if you already have experience with Python and HTML Dom elements. The bulk of the time will be actually running the code and walking through every forum topic -> post -> comments.
1
1
Working title:
Black and Blue: black lives matter discourse on policing forums
Replying to
Yes. Here's a similar project with facebook posts if you haven't seen it:
plainviewproject.org
6
