What are some A/B testing frameworks that have been open sourced by startups? I know about Etsy's feature. What else's out? (cc/ @avibryant)
@fredbenenson @johnmyleswhite ... and the experiment name makes a convenient salt.
-
-
@avibryant@fredbenenson Yeah, this hashing strategy is the approach that Eytan at FB's been advocating for most web experiments. -
@johnmyleswhite@avibryant@fredbenenson I've never worked on an experiment that *wasn't* implemented this way. The only sane way to do it. -
@seanjtaylor@avibryant@fredbenenson I'm not sure it's the only sane way. Any tolerable RNG should work, no? -
@johnmyleswhite@avibryant@fredbenenson Big advantage is no storage/retrieval of treatment status. Must GET/SET on every exposure with RNG. -
@seanjtaylor@avibryant@fredbenenson Why? Isn't the hash just one form of RNG? -
@johnmyleswhite@avibryant@fredbenenson Hash can be computed from data already at hand in requests. If you draw a RN, must store/retrieve. -
@seanjtaylor@avibryant@fredbenenson Why draw a RN? Just pass user ID as seed to RNG. Simple RNG may do fewer ops than hash function. -
@johnmyleswhite ... I would call that a hash function :) /cc@seanjtaylor@fredbenenson - 9 more replies
New conversation -
-
-
@fredbenenson there's an open source implementation of that idea in over here https://github.com/etsy/feature/ /cc@johnmyleswhite@avibryant - 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.