I think the problem with this function if I recall correctly is it tried to load the distance matrix in memory and I have 50mil data points!
-
-
50 million data points by 50 million data points does not fit in my RAM even though I have 128 and 64 on the two computers I use.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
aren't you trying to build that matrix (~20GB of data, assuming 8 bytes per entry) anyway? What info do you need to get from it?
-
I need the pairwise distances ideally with a customisable distance metric.
-
Do you want to switch to another medium for conversation that allows more characters?
-
we can surely discuss in your github repo issues
-
Thank you so much!
- End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.