Anybody know #multiprocessing and can explain what we're doing wrong? Obviously I'm ignorant of something terribly important! #python 
https://twitter.com/usethespacebar/status/851546720110432256 …
also just FYI you might wanna fork @usethespacebar's fork as it's tidier than mine by far: https://github.com/GrantRVD/pairwise_distance …
-
-
Righto! We'll poke around at it.
-
Can't wait to hear back! The irony is of course that given you are experienced you probably will be able to figure this out super fast.
-
I bet I made a super rookie mistake.

-
Also since you are going to parallelise a dist function — you might want to reach out to dask ppl as they probably need one themselves!

-
Sounds like a fun problem. We're poking around in there now. Stay tuned.
-
very very tuned
@dimpase probably knows a lot on this and opened a few issues on gh -
To confirm: Time performance of the parallel versions (dask & non-dask) are fine - you just want to reduce memory usage?
-
Time performance is appalling in all cases but yes, it also runs out of memory. Ideally I want it to not run out of memory.
- 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
