"tl;dr: Multiprocessing in Python is crippled by pickle's poor function serialization." @mrocklin http://matthewrocklin.com/blog/work/2013/12/05/Parallelism-and-Serialization/ …
-
-
@avibryant@posco@tdhopper@mrocklin this is true – Julia's closure serialization "just works" -
@StefanKarpinski@posco@tdhopper@mrocklin how do you avoid capturing the whole world? -
@avibryant@posco@tdhopper@mrocklin local state is capture but global state isn't; you have to arrange for global state to match -
@StefanKarpinski@posco@tdhopper@mrocklin global state meaning the top level? Any thoughts of delimiting it more explicitly? -
@avibryant@StefanKarpinski@posco@tdhopper@mrocklin why, delimited dynamic binding, of course ;-) http://okmij.org/ftp/Computation/dynamic-binding.html#DDBinding … -
@msimoni@StefanKarpinski@posco@tdhopper@mrocklin well, this is about closures, not continuations. What I want is delimited lexical scope -
@avibryant@StefanKarpinski@posco@tdhopper@mrocklin I suspect there's no good solution; Kali had to do dist. GC http://www.cs.purdue.edu/homes/suresh/papers/toplas95.ps.gz … -
@msimoni@avibryant@StefanKarpinski@tdhopper@mrocklin haskell takes a rigid, but statically verifiable, approach: http://research.microsoft.com/en-us/um/people/simonpj/papers/parallel/remote.pdf … - 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.