Their reactions may be a complex combination of instant reflexes, input from past driving experiences, and what their eyes and ears tell them in that moment.
And a lot of times I was, honestly, too lazy to learn how to read the notes and play the notes, so I would play by ear, I would just listen to something and then I would try to play it back myself.