@venusatuluri @peterseibel yeah, which is fine. But you frequently see assertions that "bayesian exp design doesn't have that problem".
-
-
@venusatuluri@peterseibel so I'm trying to understand what that actually means, and how I can empirically demonstrate it. -
@avibryant@peterseibel Rather the point is to estimate the effect size and the uncertainty there, instead of giving a binary decision. -
@venusatuluri@avibryant So how do you run an experiment so you can stop as soon as you reach a certain acceptable level of uncertainty. -
@peterseibel@venusatuluri presumably by modeling the EV of doing so, and doing it only when it seems worthwhile. -
@peterseibel@venusatuluri ... but really this feels like you will always end up at something like bayesian bandits. - 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.