>I've been training ML models with millions of data points and millions of features on CPUs for a decade now

That is why it is taking a decade to train your models. If you upgraded to a GPU, you could train them much faster :)