Had a similar experience with the Rift and it made me buy a different VR headset.
The software stack is critical to these devices not being painful or pleasant.
Devices that are steamvr native have been so much nicer to use, just plug&pay.
I'm assuming Apple isn't going to make their headset SteamVR compatible so I wonder how things will shake out a few years from now - is Apple going to be in their own little world or will existing software really support it?