The Transformer LLM came from Google's NLP research and input method(phone keyboard) development. Prompt processing and next word prediction is exactly what CJK keyboard software always did for past 30+ years, only datacenter sized now.
Doesn't ring a bell that very few, if any, of "AGI achieved" people seem to have backgrounds with or exposures to either classical NLP, or Google, and/or cultures that make heavy use of IME? To me the situation looked like that Googlers "have seen that trick" previously, and are doing bare minimum to defend the company from losing presence in this AGI hype storm.
Doesn't ring a bell that very few, if any, of "AGI achieved" people seem to have backgrounds with or exposures to either classical NLP, or Google, and/or cultures that make heavy use of IME? To me the situation looked like that Googlers "have seen that trick" previously, and are doing bare minimum to defend the company from losing presence in this AGI hype storm.