If you watch this video you can see that Google's cars doe exactly this. You even see the car pick up on hand signals. https://www.youtube.com/watch?v=dk3oc1Hr62g Realistically you would have to modify the software to pass the test for stupid reasons, for example the vehicle might refuse to function at all without it's LIDAR, insisting on slowing to stop and pulling over, where the video wants to continue driving.
Came here to link to theis same video. It would be interesting to watch the Google algorithm run through a similar test (not the actual video, which lacks depth and so won't make a decent model). The chattering classes would be much enlightened.
