Being privileged also includes not having powerful people working against your, your family's, or your country's success, for example serf-owning European aristocrats, unethical monopolists, Jim Crow laws, or the US government overthrowing your democracy.

Not in a negative sense he implied.