Well, your relatives are probably right depending on how a "family" is defined.
Are we talking about children per household, do multi-generational families count? Then they're definitely more right than not.
Or are you all fumbling your way towards discussing the "birth rate", which is how it's usually discussed. That may or may not be the same as "kids per family".
I still have relatives claiming that poor countries such as the Philippines, Thailand, and Egypt, and India are having 6+ kids per family.