No no, not like that. Well, maybe, but no. Most men are useless from a reproductive standpoint because they're not the bottleneck. Women are the bottleneck. More women means no more bottleneck, means more children per person.

Also sexual selection is a thing and I think we were really never meant to have this many men. Men seem good for being really successful or otherwise dying, not much in the middle.

But also, all this talk is purely from a reproductive standpoint. Human societies also need to consider fairness and rights.

All you said is correct, but all you said points towards polygamy.

If TFR stays well below 2, there's going to be major change sooner or later. The question becomes which change. Maybe the Amish will take over the world? Or maybe some solution we find really weird will be adopted by some other minority and they'll dominate.