This is a really interesting question, and of massive practical importance if you are managing systematic strategies. To generalize a bit -- someone tells you they have a strategy with a Sharpe of S. What questions should you be asking about the strategy to verify that it's real?https://twitter.com/o_wutang/status/1359686542466445312 …
-
-
The simplest explanation for a Sharpe 5 backtest is look-ahead. Many variants of this but essentially it means the backtest assumes some data is available before it would be in reality, i.e. the strategy is allowed to see the future.
Show this thread -
Another mistake is to assume that you can observe a signal and instantly trade on it at the observed market price. In reality there is a lag between observing a signal and trading on it, and the market moves in that time. If the signal is good, the move is normally against you.
Show this thread -
You are also likely to experience slippage which is correlated with your alpha, i.e. conditional on your signal being large, you will have a lower fill rate and will get filled further from mid than if you traded randomly. If not modeled, this inflates backtest performance.
Show this thread -
Third I want to know about the style of the strategy, e.g. number of markets trading, average holding period, whether it is simulated using daily data, minute bins, L2 tick data etc.
Show this thread -
It's simply not plausible to have a strategy with a > 1 day holding period that has a Sharpe of 5. It's not even plausible to have a >1 hour holding period with a Sharpe of 5, this is the realm of high frequency trading.
Show this thread -
Obviously can't cover anywhere close to everything in ~10 tweets but these are the 2-3 most important questions to ask about any simulated strategy, **especially one that you came up with yourself**
Show this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.