If it went away entirely, as in also from laptops, desktops and Raspberry Pis, without adapters being available, maybe.

But you're not going to be driving a speaker with a phone anyways. You'll need an amplifier, and if the aux port goes away, the amp will likely have whatever-alternative-input-there-is.