Claire Xen  🏳️‍⚧️ 🏳️‍🌈 🧙🏻‍♀️ BLM  🏴 🚩

What’s an efficient way of storing matrix data (ascii values at each M_ij) on server side for web applications - any ideas? Plain text, csv, blobs in db, local text or binary files with db refs instead of blobs? @oe1cxw @Night_Lynx @VolkerGoebbels help please!

"ascii values" .. does that mean an arbitrary ASCII string or just a single byte? If string: are the strings unique or is the same string used many times?

Single byte is enough. Data is available as numeric values initially, before storage. It’s a limited subset like [0-255] so same strings repeatedly.

You said 100x100? I'd just store that as 10kB binary blob in a database table. (But let's ask someone who really knows this stuff. @MarkusWinand: Is this a good idea? I guess his first question will be which database you are using.. :)

Oh, so it's at most 100 MB data? That's not too wild.. If you know you don't need to scale beyond that then you can even keep the entire DB in memory. What language are you using? Even a 100x100x10000 numpy array would possibly do the trick..https://twitter.com/JuleRiede/status/1042812032859480064 …