With some additional robustness checks and careful implementation of a simulator for fill prices, commissions etc you are well on your way to launching your first quant strategy.
-
Show this thread
-
Only problem is that the price series is one I generated using 100% random noise, it is completely unpredictable by any signal. Congratulations, you now know how to overfit a backtest. Welcome to quant research.
30 replies 11 retweets 348 likesShow this thread -
Replying to @macrocephalopod
This is awesome, I like the idea of plotting sharpe as a function of parameter setting to find the sweet spot... good to bet on multiple settings tho for robustness. Since this series randomm,Any xtra steps u do to scrutinize whether it works bc of luck? Or is that always a risk
2 replies 0 retweets 2 likes -
Replying to @M1tchRosenthal @macrocephalopod
1. Don’t do any of these steps
1 reply 0 retweets 1 like -
Replying to @InfoRatioed @macrocephalopod
Are you saying, dont try to find simple tendencies like this? I think maybe it's worth exploring, bc if the asset remains stable you can make money in theory
1 reply 0 retweets 0 likes -
Replying to @M1tchRosenthal @macrocephalopod
1. Don’t look for the thing you’re testing 2. Don’t overfit parameters based on the thing you’re targeting 3. Don’t simply select the best parameter value from one historical test 4. Understand max theoretical sharpe ratio for a given strategy (# indie bets)
2 replies 1 retweet 7 likes -
Replying to @InfoRatioed @macrocephalopod
Never tried 4, how do you calculate that? For 2&3, isnt it true that you have to pick parameters at a certain pt to run the strat? If so, may as well optimize w history, avg bets betw top 3 parameterVals, check sensitivity to param not too high. For 1, what should we do instd?
2 replies 0 retweets 0 likes -
Is number 4 related to Grinold & Kahn IR = IC x sqrt (breadth)
1 reply 0 retweets 2 likes -
Yup
1 reply 0 retweets 1 like -
So this is what not to do, instead do we need to start from an economic thesis and try to linearly model some future excess returns based on particular input variables? Is there truly no pt in testing the consistency of certain simple/naive tendencies/patterns 1/2
2 replies 0 retweets 0 likes
You have two options -- 1. Only look at signals that have some fundamental rationale, design them with the fewest # of parameters possible (ideally 0), test them over as many different time periods, assets and asset classes as you can.
-
-
Replying to @macrocephalopod @M1tchRosenthal and
2. Build an incredibly robust machine learning pipeline for testing non-economic signals, suitably regularized, training/test/validation sets, being careful to avoid information leakage from training set into test sets (easy to do if using forward returns e.g.)
1 reply 0 retweets 3 likes -
Replying to @macrocephalopod @M1tchRosenthal and
If you aren't absolutely certain of your ability to do 2. properly, then only do 1.
1 reply 0 retweets 2 likes - Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.