You could geofence the robot with indoor positioning so that even if the operator tries to open a window or a door for accomplices, the robot would not be able to reach any doors and windows. You could also have separately controlled curtains and blinds, and before the operator connects to your robots all of those are closed. Now the remote human has no way to even see out of the windows to tell where your house is at.
Vs a real life human stranger in your house that could steal stuff and let accomplices into the house.
Far easier to have activity monitoring and logging, alerting and pausing on anything suspicious. The rogue operator will then be investigated and terminated, or even arrested, if need be.
Vs a real life human stranger in your house that could steal stuff and let accomplices into the house.