i like to read with pandas and write to whatever format needed using dictionaries
-
-
-
love to read json and parse to dicts too
End of conversation
New conversation -
-
-
Read from whatever you're given... Often CSV. Write to binary dataframe format (parquet or feather) to save yourself/others the pain of having to (re)convert datetimes etc into native types.
-
Oh yes, using pandas
End of conversation
New conversation -
-
-
Super vanilla answer but almost always pandas. For an ad-hoc thing I tend to use csv’s, in prod and staging it’s redshift through read_sql Visidata for command line browsing
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Library: pandas Format: feather, or csv if needed to be human readable
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Gel biro
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
an old russian man preferably with an advanced degree in computer science focusing on information storage and retrieval
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
csv if at all possible. But European accents f**k with that. Hoping Brexit will get rid of the accents. Not in the phone though. Love those British accents, and sometimes French. I don’t go to libraries much so I can’t state a real preference there, aside from “Public”
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Parquet for everything nontrivial. Reading/Writing with pyarrow/pandas (which uses pyarrow under the hood anyway). My datasets contain text fields far too often for csv to be a robust choice...
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.