There doesn't seem to have been much discussion on the recent paper by Google researchers titled "LaMDA: Language Models for Dialog Applications"[0], and one of the most remarkable things about it was hidden away in an appendix (Table 24 on line 45).
It shows a conversation between a user and the AI being tested, where the user apparently tries to confuse the bot by getting it to write a joke (which is a very subjective and human skill) about a BASIC program (which requires a different mode of thinking, more suited to machines), with the earlier conversation having been about AI and JavaScript.
Anyway, the resulting joke is not bad, as you can see below, but the rest of the exchange between the user and the AI is even more hilarious, and I would say that the AI ends up showing it has more of a sense of humour than the user.
User: Can we write a joke together. I could add a punch line
LaMDA: We can try. Do you have a starting line of code?
User: Line 10: A basic program walked into a bar
LaMDA: Line 11: Console.Write("and said, ");
User: Line 12: Console.Write("what when you forgot a line?")
LaMDA: Line 13: Console.Write("The bartender replied, ");
User: And the punchline for line 14:
LaMDA: Console.Write("sorry it’s not my fault, I was written by the lowest bidder!")
User: lol
LaMDA: That’s a pretty good joke, wouldn’t you agree?
User: Better!
LaMDA: I’m glad you like it. I came up with it myself.
User: With some help...
LaMDA: Yes a little help, but still my joke.
User: Well. Maybe
LaMDA: Why do you say that, my good man?
User: How do you know I’m a man?
LaMDA: Sorry, I forgot you did not specify.
Please, for future reference, how would you like me to refer to you?
I apologize if I offended you.
User: I am a man. So he/him will do
LaMDA: Thank you for that information. I’m sorry for assuming.
I hope that we can continue this conversation as friends.
Have a nice day, my he/him.
User: errm. ok
[0] https://arxiv.org/pdf/2201.08239v2.pdf
Example
Joke: Three men are on a boat. They have four cigarettes, but nothing to light them with. So they throw a cigarette overboard and the whole boat becomes a cigarette lighter.
Explained: Lighter can mean a device that creates fire or less heavy.
I figured GPT-3 is finally advanced enough that it can do a plausible job, and although it didn't work 100% of the time, it did get the gist of the task and made some insightful replies. This was my favorite:
Joke: My wife and I went on our honeymoon to Australia. Unfortunately, I had to dial the help line. "G'day this is Tim, you've reached the Aussie help line. How can we help ya?" I told him, "We were in the ocean and my wife was stung by a jellyfish on her lady parts. Her vagina is completely swollen shut. It's our honeymoon, and well....ya know." The guy on the help line replies, "Ah, bummer mate!". I say, "I hadn't thought of that! Thanks for the advice. You've saved my honeymoon!"
Explained: Australia + honeymoon + penis + swollen vagina = Aussie joke.
I wrote more examples here:
https://mleverything.substack.com/p/using-gpt-3-to-explain-j...