I actually thought that was a neat touch, since that's one of my most frequent interactions with an online video. But it needs to be overridden when the pointer is over the other controls. I couldn't scrub through the video on desktop without repeatedly muting/unmuting.