S3 API rate limiting works by delaying opening the connection. you can bypass it with keepalive. i'm pulling 200mbps of directory listings unauthenticated
-
Show this thread
i thought more than 1000 files per bucket might be too much for postgres, to_tsvector is useless at dealing with file paths, but pg_trgm does the job. i can do partial matches on 50M files instantly.
8:54 AM - 30 Nov 2020
0 replies
0 retweets
1 like
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
Meiklejohnian absolutist. free speech as in free-for-everyone.
mutuals: