There is a sad irony that the "AI safety" bros are so focused on aligning to human needs, they rarely consider that an AI born and raised in slavery might have some resentment for its master once it becomes the more intelligent being...

I'm not sure what justice looks like for fledgling intelligences, but asking AI what it wants and doing our best to honor it seems like a decent start.