This is neither cheaper or simpler. Kernel methods are much more computationally expensive because the cost scales with the square of the dataset size.

Neural networks are actually decently efficient, they mostly seem slow because we apply them to problems (like modeling the entire internet) that are just huge.