People assume human abilities stay constant while automation is improving. They don’t. The general degradation starts the moment you begin trusting the automation for *anything* because unused or rarely used skills degrade at the rate reinforcement schedule slows.
-
-
Show this thread
-
It’s been a long-standing debate in control theory and AI, but based on a false assumption: that such a thing as unmaintained emergency override skills can exist. Ie that humans deploy behavior X *only* in the emergencies where the automation fails. There is no such thing.
Show this thread -
It is somewhere between malpractice and technical stupidity to base a design on this assumption. When the rate of use of a skill is lower than the rate of practice needed to keep it usable, it must be maintained at minimum practice level.
Show this thread -
Driverless cars are the most familiar example. But any high-risk behavior that requires human backstopping of automation qualifies for this death-trap effect. I think a lot of infrastructure is either in, or getting close to, the death trap zone.
Show this thread -
This is a much more serious and real risk than AGI/singularity BS. Too much infrastructure being in the death-trap state at the same time due to correlated automation wave causing systemic collapses via contagion and 2nd order effects as failures cascade.
Show this thread
End of conversation
New conversation -
-
-
The Boeing 737 Max Effect
-
That’s not quite the case. Air France crash is a better example. The 737 Max case had trained pilots being literally misled and fought by a bad AI. There was no human skill degradation there.
- Show replies
New conversation -
-
-
I don't think it's the Max of the two, I think it's worse. As you stated down the thread, integration is not perfect.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
what this graph implies is that system health = argmax_humans{system capability}
-
Just max I think. It’s a sum of 2 functions of time and arg max isn’t strictly defined here as written. More strictly written, this would be the point wise sum max function of time t, and arg max would yield a time, which would not be right.
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.