There's been a fair bit of research that even when you control for income, affluent people living in societies with high levels of inequality fare more poorly than affluent people in societies with lower levels of inequality.
The spirit level claims that a variety of factors, one of which is inequality, are all correlated. It provides very little empirical evidence that inequality is the cause (apart from being on the x-axis).
