Nope, Spectre type attacks work on ARM too: https://www.pcgamer.com/intel-amd-and-arm-cpus-hit-by-new-sp...

Now the existing discovered ones may not, but I'm sure in time there will be ones for Apple Silicon too. Just like how people for the longest time thought AMD was safer than Intel in this regard, or that ARM wasn't vulnerable.