For me visual distractions (even if it is just people walking) are a lot worse than noise. I can tune out the chatter but whenever I feel or see movement around me, my head snaps to attention to find out what it is. Some evolutionary thing most likely