Best practice for saving a value that applies to whole dataframe? A column with the same value repeating — a separate file — something else?
-
-
I want to ideally save as a text file be it csv or json, both of which I am aware geopandas allows me to. Metadata is important but like
-
others have mentioned it's not really supported for my case even though there is some mention of metadata in pandas it seems sketchy.
- 3 more replies
New conversation -
-
I took your concern to be about storage on disk. I would just add a constant column to the DF, and save it with compression.
-
but if you want something more robust, write your own class that specifies how to load/save the DF (appending/removing the extra columns)
-
Yes, that is one of the things I considered and currently my code does that but was going to switch to separate file. No concern for disk
-
space at all I think I have upwards of 5TB at disposal locally and more on server probably. Not an issue though at all neither is RAM.
-
So you think adding a column is best given I want plain text?
-
yes, I see no downside at all
-
excellent this is also the least amount of work as I had it as sep file moved to extra column instead and so now can stay this way — haha
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.