

Definitely a component of these safety systems needs to be actually effective driver monitoring. You have cars now doing gaze tracking, and tracking things like whether the person seems drowsy. Even while driving unassisted they will nag you if it can’t confirm your attention (I would get dinged sometimes on steep ramps because my arms would block the cameras while turning the wheel, it frankly trained me to reposition hands earlier just to not get the nag).
I used the lane centering to help my kid get used to the sense of correct positioning in the lane. Of course turning it off to make them do it manually, but kind of like training wheels when the kid was tending to push it almost over the passenger line.
Already happened in my work. People swearing an API call exists because an LLM hallucinated it. Even as the people who wrote the backend tells them it does not exist