"tl;dr: Multiprocessing in Python is crippled by pickle's poor function serialization." @mrocklin http://matthewrocklin.com/blog/work/2013/12/05/Parallelism-and-Serialization/ …
@msimoni @StefanKarpinski @posco @tdhopper @mrocklin well, this is about closures, not continuations. What I want is delimited lexical scope
-
-
@avibryant@StefanKarpinski@posco@tdhopper@mrocklin I suspect there's no good solution; Kali had to do dist. GC http://www.cs.purdue.edu/homes/suresh/papers/toplas95.ps.gz … -
@msimoni@avibryant@StefanKarpinski@tdhopper@mrocklin haskell takes a rigid, but statically verifiable, approach: http://research.microsoft.com/en-us/um/people/simonpj/papers/parallel/remote.pdf … -
@msimoni@avibryant@StefanKarpinski@tdhopper@mrocklin see chap. 5: closures.
End of conversation
New conversation -
-
-
@avibryant@msimoni@StefanKarpinski@posco@tdhopper@mrocklin -- first, ask yourself why you think you need to replicate environments... -
@coreload@avibryant@msimoni@StefanKarpinski@tdhopper@mrocklin because map reduce programs usually have map and reduce closures. -
@posco@avibryant@msimoni@StefanKarpinski@tdhopper@mrocklin -- that's not enough to get *me* to replicate environments at runtime. YMMV.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.