If they knew he was a psychopath, they wouldn't shop from him, regardless of behaviour. And that's my point. Self-interest is obviously not enough to sustain a successful society, it's only really enough when combined with all the unwritten rules of common decency in society, and I'm sure that's how Adam Smith meant it too.