I don't think so. In that state, video will jump and stutter wildly, run very fast, and audio will be very broken. It's not just the sound that's affected.
Which all could be caused by a broken HDMI implementation (refresh, synchronization and audio are all encoded and synchronized).
But of course I could be wrong and every M1 Mac has severe issues connecting to HDMI TV's.
I've tried a recent LG OLED, and a bunch of other TVs at friends and it happens every time if the laptop has been sleeping previously. If it's a fresh boot it never happens. That leads me to believe it's something on the laptop side.