TIL spreadsheet risk is a whole subfield of what probably should be called bitrot studies ht eusprig.org/horror-stories
Conversation
Spreadsheets are one of those things where the risk seems ordinary if you just use an isolated one individually for a problem, but turns into a WMD at an exponential rate as you add more people and data connections
6
3
16
Is there a standard scaling regimes sequence? Something like
Paper
PDF
Text file/word doc
Spreadsheet
Spreadsheet++ on cloud
No code db thing like knack
Quick and dirty web app db like SQLite
Proper db and warehouses
Big data nosql/newsql db
Big cloud distributed db things
3
1
17
Been a while since I last caught up with this tech. What’s the generally available state of the art for creating and managing very large data stocks/flows?
Redis?
Replying to
Redis is more of a cache with some persistence features. I'd say BigQuery or RedShift for very large datasets that you plan to run relatively simple queries over.
1
Replying to
Stocks: BigQuery or Redshift but some get sticker shock.
Flows: Streaming systems like Kafka or RabbitMQ.


