is there an efficient way, in python, to read many (10^5) small files to memory? using sequential open() -> major IO bottleneck, even w/ SSD
-
-
jc, *I'm*. anyway hope was that there might be a way to mass-access drive data rather than repeated, maybe-colliding reads.
-
cool. In that case I probably got nothing, except, you should be able to beat 24 w thread parallelism
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.