"Citizen of the Galaxy," by Robert Heinlein, jumped to mind when I read this story.

The protagonist, Thorby, is a freed slave, and most of the people he encounters in the story are skeptical that slavery still exists.