For different definitions of "very far away". We're only talking about 15 years since we started getting proper video recording in phones, and only about 4 since the big players started focusing on software enhancements.
that's a fair point, but vision is such a high-dimensional and dynamic input that my feeling is the last 20% of super-fast autofocus, auto color balancing, high dynamic range, removing motion-blur, etc. will be very difficult to improve upon. it seems that just increasing brightness/fov by making better waveguides or MEMS will be much easier. that being said, magic leap's lack of success doesn't bode well.