I need assistance from people involved in academic research (especially those who use my datasets for research purposes). Before I release the next version of the Pushshift API, I need to create procedures and a privacy statement that deals with users who request to be removed
Conversation
from the data dumps and API. I need help in creating cogent disclosure statements that let researchers know that data was removed at the request of a user while retaining some metadata within the datasets. If anyone can assist me with this, it would be greatly appreciated.
1
2
My thoughts on this are censoring out the author name first and foremost -- but I don't know if the body content itself should also be removed. I would also need to create addendums along with the monthly data dumps detailing how data was modified to keep researchers informed.
2
1
This Tweet was deleted by the Tweet author. Learn more
This Tweet was deleted by the Tweet author. Learn more
This Tweet was deleted by the Tweet author. Learn more
Replying to
Your suggestion to research ethics dealing with publishing data is a great one. I'm going to do a crash course and get a feel for the technical, ethical, legal and moral implications when dealing with these type of requests.