The next two big things to tackle are crate upload and yanking. Both perform the git operations to update the index in-band which is a major problem. Needs to be a background job.
Show this thread
I think the high traffic endpoints for http://crates.io are finally "fast enough". Even when our heaviest crawlers hit is (spike towards the right), we don't go over 200ms. Now for the lower traffic endpoints...pic.twitter.com/Q2eSmK4AH2
-
-
-
Crate upload is even worse. Your crate goes to our servers before we proxy to S3. This actually puts a hard upper limit on the size of crate you can upload, based on connection speed. Needs to go direct to S3 (this requires cargo changes, so will be farther out)
Show this thread
End of conversation
New conversation -
-
-
One other thing to mention -- this is with no caching of any kind. Just 2 web servers and some reasonably well tuned queries to a bottom tier PG database
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.