The new UI changes were introduced in tech preview 126, but that one is only available for macOS 12. The download page at https://developer.apple.com/safari/download/ says "macOS 11 - coming soon".

I have tech preview 125 from earlier and no software updates are available in system preferences.

So how do you have the new 126 UI changes on Big Sur already?