Bad UX in an Apple component is not a "dark pattern". It's just, well, bad UX.
Knowing Apple, knowing its history and people that work there and the things they care about, I think Apple is incapable of deliberately producing a bad UX. When it happens, it's caused by other factors rather than being an explicit decision. In the case of App Store discovery being broken, I think it's caused by the fact that the App Store seems to be run largely the way the Music Store is run (with the addition of app review), and nobody complains about search / discovery in the Music Store, but it just so happens that the infrastructure and design around the music store doesn't work quite so well when applied to apps.
Because the people that care about design don't really care about the App Store (they care about products instead), and the people that run the App Store don't really have an incentive to try and make dramatic changes in something that, from their perspective, is wildly successful. Change might break things, especially when operating on the scale that Apple is (just think of what the load must be on the App Store).
That's true. And if you care about this issue, you could try appealing to Apple executive leadership (emailing tim cook, or running a PR campaign designed to get Apple executive leadership to see your arguments).