Thanks, if I saw this before I'd forgotten. It's nice to see how widely accepted many of these ideas are, nine years on. I'm also glad to see major software initiatives coming from people capable of talking about them philosophically.
-
-
Arrow is a tool for sticking your data into an array buffer that lives somewhere else. It also then gives you tools to perform data frame operations over your data a la pandas. This is powerful because multiple applications can share the same arrow buffers.
-
I'd need to be able to at least append data to it over time. But a mmap'ed column store is definitely where I've assumed we're headed. We're currently using SQLite, which is fine for now.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.