Hitting a barrier in highway speeds is quite dangerous, even without hitting a car in the oncoming lane.
As the recent Tesla crash showed, even on a divided highway there are plenty of opportunities to cause death and mayhem to the autonomous car and the surrounding vehicles.