I moved (back) to sway exactly for these reasons. Sure there should be integration between different part of the systems, but each part should be compartmentalized. Both gnome and kde are fine environments but only if you subscribed to the whole thing. XFCE is more modular than both.