Yes, of course there is danger, but the probability of a really hazardous event, which you may avoid by hearing, is very very low for most modern civilised environments where people spent prolonged periods of time, like sitting in plains/trains, or being in city rooms together with other people.

I would not consider reasonable using earplugs while walking in a jungle, or standing in a road/open space, or when driving a car myself :-) .