It's checking to see if the button is high, not the led. "blinky" is a slightly misleading name. It doesn't cycle the led automatically, it turns the led on when you press a button

It is a busy loop though, and in a real scenario you'd want to use interrupts instead of a loop like this.