@seiflotfy Thanks for publicizing PMC. I'm very interested in the benchmarking blogpost you mentioned on HN that compares CMS, CML, PMC etc.
@seiflotfy @seiflotfy yeah, more or less what PMC does. Do you benchmark the error on infrequent elements? Is CML best there? (CMS is awful)
-
-
@avibryant Count-min-log is also great but it tends to shit it pants with 8 bit "registers" when numbers get too high. -
@seiflotfy count-min-log also doesn't seem to be as easy to compute distributed as the others (because updates depend on current values). -
@avibryant yeah. I don't think that is possible. PMC actually allows merging (compering the bitmaps with and and-or). There is a paper ... -
@seiflotfy yeah PMC should be trivially mergeable right? Just OR two bitmaps. -
@avibryant yep exactly
End of conversation
New conversation -
-
-
@avibryant From the top of my head I would say PMC does the best job. But benchmarks should be the best proof.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant PMC is great with keeping track of infrequent elements. It has a hit-count estimator. https://github.com/seiflotfy/pmc/blob/master/pmc.go#L122 …Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant PMC tires to roll the dice every time you increment the flow. vHLL actually doesn't do that. It keeps track of the leading 0'sThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.