What’s an efficient way of storing matrix data (ascii values at each M_ij) on server side for web applications - any ideas? Plain text, csv, blobs in db, local text or binary files with db refs instead of blobs?
@oe1cxw @Night_Lynx @VolkerGoebbels help please!
-
Show this thread
-
"ascii values" .. does that mean an arbitrary ASCII string or just a single byte? If string: are the strings unique or is the same string used many times?
1 reply 0 retweets 1 like -
Single byte is enough. Data is available as numeric values initially, before storage. It’s a limited subset like [0-255] so same strings repeatedly.
1 reply 0 retweets 1 like -
You said 100x100? I'd just store that as 10kB binary blob in a database table. (But let's ask someone who really knows this stuff.
@MarkusWinand: Is this a good idea? I guess his first question will be which database you are using.. :)3 replies 0 retweets 2 likes -
Replying to @oe1cxw @JuleRiede and
Claire Xen 🏳️⚧️ 🏳️🌈 🧙🏻♀️ BLM 🏴 🚩 Retweeted Dr. Julia Riede
Oh, so it's at most 100 MB data? That's not too wild.. If you know you don't need to scale beyond that then you can even keep the entire DB in memory. What language are you using? Even a 100x100x10000 numpy array would possibly do the trick..https://twitter.com/JuleRiede/status/1042812032859480064 …
Claire Xen 🏳️⚧️ 🏳️🌈 🧙🏻♀️ BLM 🏴 🚩 added,
2 replies 0 retweets 3 likes
(Not sure how numpy arrays are stored in memory. Might be better to have 10000 as first dimensional instead of last.)
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.