Maybe wrong but I don't think what I was doing can be done using dask wi/out 1st writing to disk actually... @seaandsailor @usethespacebar
I will give it a go but since everything has to be either from disk or cast to a numpy array/pandas df first it actually seems way slower!
-
-
So far I have tried the latter and it's super slow. I will try writing the pairs of items to disk though and doing delayed loading.
- End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.