You should check out the WaPo article that originally published his concerns. He frequently makes many errors audibly with a reporter who is trying rather hard to see his point of view. I’m not trying to be rude, but he came off like kind of a sucker that would fall for a lot of scammer tactics. There were usually some form of strangeness such as him deciding when the content limit of the conversation began and ended. Further, he asks only leading questions, which would be fine if transformers didn’t specifically train to output the maximum likelihood text tokens from the distribution of their training set, which was internet text created by humans.
He was frequently cited as an engineer but I don’t think he actually had a strong background in engineering but rather in philosophy.
He was frequently cited as an engineer but I don’t think he actually had a strong background in engineering but rather in philosophy.