You could MITM Signal if you control the cell towers on either end. It would be visible, because the security number would change. But in my experience helping people set it up, very few users understand what those numbers are for, and what it means when they change. Most just mark them as verified immediately.
It is a long running rumor in Russian internet that Russian spies managed to tap UK politician phones with fake roaming requests in 2016.