I'd say it's more akin to learning vim, where there's a fairly steep learning curve at the outset, with huge rewards down the line.
Yes, initial install can take a while. Yes, system updates take longer when built than from binaries - but modern hardware makes that a fairly trivial difference. Most people who have a problem with Gentoo either only used it decades ago when build time were a lot longer, or because they heard it takes long, which is way more common than the former.
Unfortunately the binary packages are still only available upto x86-64-v3, so users on x86-64-v4 (which I reckon what majority of "advanced" users would be using) and even more so AMD Zen 4/5 users would be missing out on advanced instructions and other compile optimisations.
Luckily Arch/CachyOS users don't have to worry about this as CachyOS offers optimised packages for modern CPUs. Until Gentoo offers an equivalent - without manual compiling needed - I won't consider it.