> Do these models actually learn a 3D representation or do they just learn "something" that is good enough to produce a very convincing impression of 3D ?
The second, but at the limit it's the same thing of course.
> Subquestion: if they don't learn 3D, can we say that models learning a 3D representation first will lead to even better productions ?
Generally speaking manual feature engineering almost always turns out to be a waste of time if you can just make the model bigger; this is called "the bitter lesson".
The second, but at the limit it's the same thing of course.
> Subquestion: if they don't learn 3D, can we say that models learning a 3D representation first will lead to even better productions ?
Generally speaking manual feature engineering almost always turns out to be a waste of time if you can just make the model bigger; this is called "the bitter lesson".