Sure, that stuff "should" work and there are set ups that one "should" do, but one can say the same thing about how these things work as well: The manufacturer "shouldn't" be requiring things to work this way and "shouldn't" be forcing this software on everyone.
This isn’t what I’m experiencing at all. I have a Sony Bravia TV. The TV works flawlessly with HDMI CEC and the Apple TV port set to default. It never opens Android TV, I haven’t seen that interface in months. I also never even set up Google TV or logged in with a Google account, which is optional.