Interesting problem. It would be partly solved by the look-and-look-back protocol, because then it's obvious that you are speaking to a single person. But then, it could still happen that you accidentally avert your gaze and drop back to the common chatroom, making what you are saying audible to everyone.