Sounds reasonable to me. People have high expectations for video. They've been conditioned on DVDs or traditional subscription television services. One very simple technique that would help is to fade the audio out when the buffer is empty and fade it back in to resume. If not completely then just enough to smooth out the jarring stop/start of audio. To me this is the digital version of nails on a chalk board. I can't stand it.