Are any tweeps good at parallelising w/ #multiprocessing #Python? I'm doing something 100% wrong cos it's slower. 
https://github.com/oliviaguest/pairwise_distance/blob/master/pairwise_distance.py …
-
-
Here's a faster version: https://gist.github.com/jfsantos/8184653991558e30a9eab8613a6ea20f …. The trick is to create a list with all combinations at once and use Pool.map.
-
It's still not faster than the others, but not far from the loop. You'll see more performance gains when the function is more complicated.
-
Maybe a better question to ask is this — I need this function or something similar to actually run in a reasonable about of time without
-
stealing all of my 64GB of memory?
-
Also thank you so so so much this is really cheering me up — been having a bad day.

End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
