Because it could be forced on them.

Well, sure, that's possible. But then it would be the forcing that's wrong.

In my view, having the tech is what's wrong, because then it will be inevitably misused by the ruling classes to potentially catastrophic effect.

You effectively can't trust the regulators of something so potentially disruptive of the balance of power.

Yes, plastic surgery for example

What is wrong with people having plastic surgery exactly?