You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
1. There is turbodbc with arrow support http://turbodbc.readthedocs.io/en/latest/pages/advanced_usage.html#apache-arrow-support … though unsure of the write support (definitely has bulk read just using basic select that’s fast)
2. Use this binary parser/writer I made for this exact use case! https://github.com/spitz-dan-l/postgres-binary-parser … It uses cython for the binary bits. Only supports a few of the datatypes, also uses an idiosyncratic DSL for schema specification rather than eg SQLAlchemy
I did look at turbodbc but there didn't seem to be much info on how well executemanycolumns with a dataframe worked.
That parser is very neat! I thought of embarking down that road but I read this in the docs and it scared me: "a binary-format file is less portable across machine architectures and PostgreSQL versions" - what has been your experience here, esp across versions?
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
