Personally, I think the company selling the car with self-driving abilities should be responsible. In turn this requires a clear understanding of what the responsibility is: what is expected from a self-driving car; what situations should it handle; what kind of documentation is needed of their development process.
Like anything else which involves safety and environmental damage.
At what cost do we need the supposed improved performance of self-driving cars?