> The same reasoning can be used to invalidate the claim that there is a "meritocracy" of families. If you claim "family X has more merit than family Y", well you can apply the same reasoning to show that just like person A got their privilege from family X, family X got their privilege from situation Q

Not at all. Situation Q could be the same among many families, but only a few will succeed.