JS friends: @ApacheArrow [JS] is an A++ lib when you work with data tables, CSVs, etc.: Accelerated storage & compute, types, streaming, data interop, & more. The high-level data APIs matured, so I wrote up an intro tutorial: https://observablehq.com/@lmeyerov/rich-data-types-in-apache-arrow-js-efficient-data-tables-wit … cc @BrendanEich @wesmckinn
-
-
Yes and no. The core is the in-memory format. E.g., how to represent a table of nested json. Surrounding IO ecosystem has helpers for stuff like csv, e.g., in node, we use a GPU-accelerated csv parser and push around results via Arrow. Think protobuf all grown up.
-
*GPU accelerated csv->arrow parser. And others have optimized csv->arrow CPU parsers (guessing dremio + modin are doing coolest there.)
- 7 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
& Web Standards TL; Blink API OWNER
Named PWAs w/
DMs open. Tweets my own; press@google.com for official comms.