You could MITM Signal if you control the cell towers on either end. It would be visible, because the security number would change. But in my experience helping people set it up, very few users understand what those numbers are for, and what it means when they change. Most just mark them as verified immediately.
