Pushshift will be adding a full 4chan API in the next several weeks as well as creating daily / monthly dumps for 4chan data for researchers to use.
Since 4chan has a lot of controversial posts, we cannot provide media dumps along with the textual data. If you are doing ...
Conversation
Replying to
... research that necessitates the inclusion of media, please reach out to me for some options. The biggest issue is the legal exposure surrounding the storage / dissemination of media that could possibly contain illegal content, etc.
2
7
Replying to
Can you make sure to preserve the id/flag fields in forums like /pol/?
4chan has an annoying habit of tossing that information from the JSON once the thread locks. My existing collection notebook needs a scraper module as a fallback. 4plebs isn't that friendly to API requests.
1
2
Replying to
Thanks so much for helping with this. Can you give me more info on the flag fields? What exactly are in these fields?
1
1
Show replies
