Ok, that's true, and could potentially have the side effect that matches presented to women are more random (more noise in the data).

Even then, it seems like the effect would be kinda weak, no? And no individual guy loses out, except possibly to someone who was just about as attractive as him anyway (and he's equally as likely to gain).