The humans have probably been learning how to negotiate the physical world for a decade or more. Also humans have evolved to be good at that stuff. That self driving tech also has to be designed and trained is sort of a similar deal.