Forwarded from DoomPosting
LLMs tell bad jokes because they avoid surprises
Been saying this repeatedly for years and years and years
Key element of a real joke is the “element of surprise”
LLMs, by their construction, and when used in their usual forward mode, are HORRIBLE at surprise — they’re trained to do the extreme opposite of surprise
— Definitely can’t just do the naive forward-mode “tell me a good joke bro”
But,
Also figured out a few years back that there IS a way to get LLMs to mine for good jokes, and made a successful joke miner (though joke skill is ultimately limited by the AIs IQ, as joke making is extremely g-loaded, but at least it was able to start mining for real jokes successfully at all, huge success)
— And it turns out to be a classic general technique for how skilled humans often create jokes too, aside from stealing them
Anyone want to guess what that joke-creating technique is?
Good comedy is MUCH more “AI complete” & g-loaded than you think
Jokes — AI’s final frontier
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
Been saying this repeatedly for years and years and years
Key element of a real joke is the “element of surprise”
LLMs, by their construction, and when used in their usual forward mode, are HORRIBLE at surprise — they’re trained to do the extreme opposite of surprise
— Definitely can’t just do the naive forward-mode “tell me a good joke bro”
But,
Also figured out a few years back that there IS a way to get LLMs to mine for good jokes, and made a successful joke miner (though joke skill is ultimately limited by the AIs IQ, as joke making is extremely g-loaded, but at least it was able to start mining for real jokes successfully at all, huge success)
— And it turns out to be a classic general technique for how skilled humans often create jokes too, aside from stealing them
Anyone want to guess what that joke-creating technique is?
Good comedy is MUCH more “AI complete” & g-loaded than you think
Jokes — AI’s final frontier
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
💯3
Forwarded from DoomPosting
Ofc 95% of low-IQ retards disagree, huge thread of hundreds of the most BS arguments you’ll ever see
Which brings us to another thing we’ve said for years
= 95% literally fake getting comedy
Faking by just copying the crowd, laughing when others laugh, or confusing non-comedic values signaling for comedy
95% do not comprehend comedy
= Dead clownworld theory
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
Which brings us to another thing we’ve said for years
= 95% literally fake getting comedy
Faking by just copying the crowd, laughing when others laugh, or confusing non-comedic values signaling for comedy
95% do not comprehend comedy
= Dead clownworld theory
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
💯3
Forwarded from DoomPosting
Very bottom comment, out of hundreds
— Bitcoin’s good old Mike Hearn
Once spoke at the same crypto conference he spoke at, he was trying to launch Lighthouse at the time, a piece of prediction-market-inspired crowdfunding tech, good old days
Anyway
Know what else is surprising about jokes?
= Both humans & AIs are generally HORRIBLE at being able to tell if a joke was surprising to them — if you show them the full joke all at once
One reason is because this kind of judgement relies on accessing something that the AIs & don’t have really innate access to — information for how difficult a punchline was for the human / AI to figure out before they saw it
Now, both in humans & AIs, you can crudely try to establish this, by forcing the to repeatedly give their top guesses at the punchline and its meaning repeatedly — until they’re forced to give up, and they’re forced to acknowledge that a joke’s punchline IS suprising, by definition — because they couldn’t guess anything close to what it was even when given many guesses
In AIs, you can even optimize this a little further, because you CAN often access thousands of the AI’s beam-search guesses on the punchline of a joke, and a bit more efficiently turn this into a surprisal rating for a joke
(And really the punchline isn’t enough, especially for better jokes — really you want it to correctly figure out the full meaning of the joke, e.g. figuring out what exactly are the legs of the surprisingly-fruitful extended analogy the joke is making, etc — so surprise measurement should go beyond just measuring the ability to predict the punchline, but also a full proper explanation of the joke that clearly proves understanding — but same rough idea)
= Humans & AIs are not even innately wired to easily determine if a joke was surprising to them, if they already know the punchline
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
— Bitcoin’s good old Mike Hearn
Once spoke at the same crypto conference he spoke at, he was trying to launch Lighthouse at the time, a piece of prediction-market-inspired crowdfunding tech, good old days
Anyway
Know what else is surprising about jokes?
= Both humans & AIs are generally HORRIBLE at being able to tell if a joke was surprising to them — if you show them the full joke all at once
One reason is because this kind of judgement relies on accessing something that the AIs & don’t have really innate access to — information for how difficult a punchline was for the human / AI to figure out before they saw it
Now, both in humans & AIs, you can crudely try to establish this, by forcing the to repeatedly give their top guesses at the punchline and its meaning repeatedly — until they’re forced to give up, and they’re forced to acknowledge that a joke’s punchline IS suprising, by definition — because they couldn’t guess anything close to what it was even when given many guesses
In AIs, you can even optimize this a little further, because you CAN often access thousands of the AI’s beam-search guesses on the punchline of a joke, and a bit more efficiently turn this into a surprisal rating for a joke
(And really the punchline isn’t enough, especially for better jokes — really you want it to correctly figure out the full meaning of the joke, e.g. figuring out what exactly are the legs of the surprisingly-fruitful extended analogy the joke is making, etc — so surprise measurement should go beyond just measuring the ability to predict the punchline, but also a full proper explanation of the joke that clearly proves understanding — but same rough idea)
= Humans & AIs are not even innately wired to easily determine if a joke was surprising to them, if they already know the punchline
🄳🄾🄾🄼🄿🄾🅂🅃🄸🄽🄶
💯3❤1
Forwarded from Chat GPT
ChatGPT is fun, but it is not funny! Humor is still challenging Large Language Models - Sophie Jentzsch
“For humans, humor plays a central role in forming relationships and can enhance performance and mo- tivation [16]. It is a powerful instrument to affect emotion and guide attention [14]. Thus, a compu- tational sense of humor holds the potential to mas- sively boost human-computer interaction (HCI). Unfortunately, although computational humor is a longstanding research domain [26], the developed machines are far from "funny." This problem is even considered to be AI-complete [22].”
“All of the top 25 samples are existing jokes. They are included in many different text sources, e.g., they can immediately be found in the exact same wording in an ordinary internet search. There- fore, these examples cannot be considered original creations of ChatGPT.”
“Of 1008 samples, 909 were identical to one of the top 25 jokes. The remaining 99 samples, however, did not necessarily contain new content. About half of them were again modifications of the top jokes, as illustrated by the examples Ex. 2, Ex. 3, and Ex. 4. While some of the modified puns still made sense and mostly just replaced parts of the original joke with semantically similar elements, others lost their conclusiveness. Thus, although the top 25 joke samples rather appear to be replicated than originally generated, there seems to be original content in the remaining samples.”
Remark: She has a few questionable conclusions and explanations, but largely right, and far more of an important topic than it seems.
Solve jokes, you solve everything, joking is AI Complete.
Who’d have thought — When the AI takes over, last job left is comedy.
Arxiv Paper
“For humans, humor plays a central role in forming relationships and can enhance performance and mo- tivation [16]. It is a powerful instrument to affect emotion and guide attention [14]. Thus, a compu- tational sense of humor holds the potential to mas- sively boost human-computer interaction (HCI). Unfortunately, although computational humor is a longstanding research domain [26], the developed machines are far from "funny." This problem is even considered to be AI-complete [22].”
“All of the top 25 samples are existing jokes. They are included in many different text sources, e.g., they can immediately be found in the exact same wording in an ordinary internet search. There- fore, these examples cannot be considered original creations of ChatGPT.”
“Of 1008 samples, 909 were identical to one of the top 25 jokes. The remaining 99 samples, however, did not necessarily contain new content. About half of them were again modifications of the top jokes, as illustrated by the examples Ex. 2, Ex. 3, and Ex. 4. While some of the modified puns still made sense and mostly just replaced parts of the original joke with semantically similar elements, others lost their conclusiveness. Thus, although the top 25 joke samples rather appear to be replicated than originally generated, there seems to be original content in the remaining samples.”
Remark: She has a few questionable conclusions and explanations, but largely right, and far more of an important topic than it seems.
Solve jokes, you solve everything, joking is AI Complete.
Who’d have thought — When the AI takes over, last job left is comedy.
Arxiv Paper
❤3💯2
Forwarded from Chat GPT
Is a taste for humor the reason that humans originally developed such large brains? Is humor a key component in achieving AGI?
The humor vs IQ connection is undeniable, one of the strongest-replicated connections in all of social science.
What’s less clear is which drove which. Did bigger brains drive a taste for humor, or was it a taste for humor that drove bigger brains?
Mounting evidence points to the latter, since environmental pressures don’t appear to have been strong enough to explain such costly, slow to develop feature as the oversized human brain.
So, are humans another peacock of the animal kingdom, but instead of runaway selection for bigger shinier feathers, instead humans experienced runaway selection for bigger brains?
Is the skill in creating and understanding humor, something GPT-3 and GPT-4 are shockingly bad at, the final step on the road to achieving AGI?
Will meme writer be the last remaining job after AI takes over all the others?
Is humor AI’s final frontier?
The humor vs IQ connection is undeniable, one of the strongest-replicated connections in all of social science.
What’s less clear is which drove which. Did bigger brains drive a taste for humor, or was it a taste for humor that drove bigger brains?
Mounting evidence points to the latter, since environmental pressures don’t appear to have been strong enough to explain such costly, slow to develop feature as the oversized human brain.
So, are humans another peacock of the animal kingdom, but instead of runaway selection for bigger shinier feathers, instead humans experienced runaway selection for bigger brains?
Is the skill in creating and understanding humor, something GPT-3 and GPT-4 are shockingly bad at, the final step on the road to achieving AGI?
Will meme writer be the last remaining job after AI takes over all the others?
Is humor AI’s final frontier?
🔥1💯1