people like unit tests because they're an excuse to do work that you don't have to think too hard about, but they give you no guarantees whatsoever
13
31
314
Conversation
integration and generative testing get closer to giving you guarantees and require writing way less code but they require actually understanding your problem domain
1
5
90
really what you want is to sample from a statistical estimator fit to real world log data but afaik nobody does this
3
49
also unit testing frameworks give you a coverage number so you can have number go up in meetings
3
50
you can get number go up doing more rigorous modeling, but programmers aren't used to thinking in terms of state spaces and transfer functions
1
1
30
your sytem model that you test against has an error (some loss function, mse or something) and your system has a failure rate wrt the model
1
16
maybe if we call this "adversarial testing" or something people will think it's ~AI~ and want to do it
3
4
30
Replying to
something like support vector machines: find the tests that actually matter