A run length encoded bloom filter. Would that work?
-
-
@avibryant@lemire Hmm interesting, I haven't benchmarked them yet for that purpose.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant@lemire I just thought up the idea, glad I'm not the first one or else I'd think it's probably flawed :PThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant@kellabyte@lemire Update? Since when does that work? Or do you mean build? -
@zimdo@kellabyte@lemire build, or really combine in this case. Code here: https://github.com/twitter/algebird/blob/develop/algebird-core/src/main/scala/com/twitter/algebird/BloomFilter.scala … -
@avibryant@kellabyte@lemire Ooho ok. But that essentially implies a memcpy... wouldn't it be nicer to decompress (partially) ? -
@zimdo@kellabyte@lemire yes, could be. Haven't spent any time trying to optimize this past the "good enough" state it's in. -
@avibryant@kellabyte@lemire it probably works very well in cases where the compression is high... but can be expensive otherwise.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.