One argument could be that the incentive to contribute to what used to be a higher-paid higher-skilled job goes away so now less people will do it, harming society as a whole.