Thanks for that explanation. I was wondering the same thing Torhal posted.
However, it still begs the question of what's the difference between the person on the other end still talking and the ultra-jittery passenger going nuts because of perceived danger.
Of course, I guess yelling 'shut up' to said jittery passenger takes care of the issue, but you're still dividing your attention.