I'm trying to find an automatic way to get all the non accessible websites for EU users due to #GDPR. Let's do that together! 1/n
-
-
It's not really working the output is only: http://google.com 301 http://youtube.com 301 http://facebook.com 301 http://wikipedia.org 301 http://reddit.com 301 http://yahoo.com 301 Any suggestions guys? 4/n
Show this thread
End of conversation
New conversation -
-
is that CSV updated regularly? As somewhere amazon said they have stopped giving this data for free.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
You also need to instruct curl to pretend to be a browser using headers and capture the provided cookies from these sites and use them when following redirects. Otherwise they will think you are a crawler (which often triggers other behaviours).https://stackoverflow.com/questions/28760694/how-to-use-curl-to-get-a-get-request-exactly-same-as-using-chrome?utm_medium=organic&utm_source=google_rich_qa&utm_campaign=google_rich_qa …
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.