> Either their competition is incompetent or OpenAI is doing something right.
Yeah - I'd say a bit of both. Google certainly seem to have dropped the ball, and now seem to be desperately trying to play catch up.
OpenAI certainly seem to be doing a lot right though, in addition to being all-in and laser focused on this tech. It seems there's a lot more to improving these models than just scaling them up. Altman said "there's a lot of understanding went into building GPT-4", and they've invested a lot of effort into the "alignment" aspect - how to control these models to modify behavior - which is what makes the difference between a neat tech demo and something actually useful.
Yeah - I'd say a bit of both. Google certainly seem to have dropped the ball, and now seem to be desperately trying to play catch up.
OpenAI certainly seem to be doing a lot right though, in addition to being all-in and laser focused on this tech. It seems there's a lot more to improving these models than just scaling them up. Altman said "there's a lot of understanding went into building GPT-4", and they've invested a lot of effort into the "alignment" aspect - how to control these models to modify behavior - which is what makes the difference between a neat tech demo and something actually useful.