Back on my "essays as commit messages" shithttps://github.com/rust-lang/crates.io/pull/2203 …
Show this thread
-
For http://lib.rs I had to give up on using a database for downloads. Now I use an in-memory equivalent of HashMap<version_id, Gzip<[u32; 366]>> for processing the download counts.
-
-
What do download counts even mean for http://lib.rs ? I didn't think you served crates directly?
-
Based on the 366, I'm guessing it's an in memory cache of 1 year of (upstream) daily download counts. As you said, since we have multiple servers updating the counts we can't cache much in process (plus Heroku can terminate us before we can write data out).
- 5 more replies
New conversation -
-
-
Check out Citus, can also scale horizontally by sharding by crate (for example). I can help with a good automatic HA setup on Kubernetes, or you can use Azure Hyperscale for PostgreSQL.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.