(In my state) Pedestrians already have absolute priority. Whether their move is legal or not if you're in a vehicle you must always stop for a pedestrian in the road.

> now you're proposing we vacate them for the convenience of drivers

This argument already happened and would probably go the same way if it happened again. The value proposition for vehicles is too strong. I agree that's it decreases pedestrian liberty to an extent but our current system allows for cars to reach their destination much faster and doesn't meaningfully impact walk times.

I will agree that having walk-only city centers is a good idea. Just so long as there is ample parking on the border.