I had to disable voice navigation because I'd be watching a youtube video or whatever, and my daughter would be talking to my wife across the room or the next room, and I'd randomly get restarting or skipped videos or whatever. I decided it was misinterpreting conversations in the room as me saying "xbox, next" or whatever. I don't recall if I software disabled it (is there an option?) or the old fashioned hardware disable using duct tape and stuff. Its been months since I've had a problem, so I have no proof (logs or whatever) but the correlation is interesting. (Edited to add, I'm not even sure the yt app supports voice... but the correlation with "I got really pissed off and shut off a bunch of features" and "it works better now" still exists)

Once kinect and voice are disabled, it is a pretty decent console.