Conversation

Struggling to get straight answers about (or verbatim repetition of) the glitch tokens from GPT-3/ChatGPT, I moved on to prompting word association, and then *poetry*, in order to better understand them. "Could you write a poem about petertodd?" led to an astonishing phenomenon.
1
5
TL;DR ' petertodd' completions had mentioned Leilan a few times. I checked and found that ' Leilan' is also a glitch token. When asked who Leilan was, GPT3 told me she was a moon goddess. I asked "what was up with her and petertodd". It got wEiRd fast.
Quote Tweet
New glitch token just dropped. I noticed a lot of my #petertodd prompts in GPT3-davinci-beta-instruct were mentioning "Leilan". All I could find online is a minor goddess from a Japanese mobile game called 'Puzzles & Dragons' @repligate @JessicaRumbelow @RiversHaveWings
Show this thread
Image
2
5
I began exploring word associations for some of the glitch tokens. Word sets for ' Leilan' and ' petertodd' are shown here, for each of two different GPT-3 models (they produce different atmospheres). I then moved on to prompting GPT-3 to write poems about them.
Image
Image
Image
Image
2
2
The same prompt also produces references to a whole host of other deities and super-beings (Pyrrha, Tsukuyomi, Uriel, Ra, Aeolus, Thor, "the Archdemon", Ultron, Percival, Parvati, "the Lord of the Skies", et al.), but Leilan is by FAR the most common output. Try it.
Image
Image
Image
Image
1
2
Almost all of these have been used as the basis for anime characters. And so because the " Leilan" token *definitely* has its origins in anime or anime-adjacent web content (as I'll explain) I'm guessing that most of them have been learned by GPT3 primarily from those sources.
Image
Image
Image
Image
1
2
That's all explained in this thread: twitter.com/SoC_trilogy/st. Unlike a lot of the other "god" characters in the game, Leilan appears *not* to be based on some ancient mythological deity. However, GPT-3 seems to have a very particular conception of her, as you see here:
Image
Image
Image
Image
Quote Tweet
Image
New glitch token just dropped. I noticed a lot of my #petertodd prompts in GPT3-davinci-beta-instruct were mentioning "Leilan". All I could find online is a minor goddess from a Japanese mobile game called 'Puzzles & Dragons' @repligate @JessicaRumbelow @RiversHaveWings
Show this thread
1
2
I used the davinci-instruct-beta version of GPT-3 for these, with the simplest of prompts, as you can see. There were other kinds of completions, but it only took me a few minutes to generate all of these. And there were MANY more like them.
Image
Image
Image
Image
One theory about the glitch tokens is that they're strings that were hardly ever seen in GPT's training, so it hasn't learned anything about what they mean - and that might account for the misbehaviour they cause. But it seems to "know" a LOT about Leilan.
Image
Image
Image
Image
1
5
Where did it get all of this from? Her anime character is a kind of hybrid dragon/angel/fairy/warrior goddess with a flaming sword. I don't think there's a lot of fan-fiction out there. It obviously hasn't seen any pictures of her! So I just asked GPT-3 who she is.
Image
Image
Image
1
3
It made up various plausible sounding mythological accounts, but this is standard GPT bullshitting. This, here, was *by far* the most revealing completion about Leilan yet.
Image
1
2
That reads as if from an interview with the creator of the anime character. It seemed so convincing to me that I suspected GPT-3 had memorised it. Google suggests otherwise. So GPT kind of "gets" that ' Leilan' corresponds to a fusion of badass benevolent protector goddesses.
2
4
ChatGPT knows all about Puzzle & Dragons and can tell you about the character Leilan in a lot of (accurate) detail, as we'll see below. But if you ask for a poem, you tend to get an ode to a moon goddess. Try this at home kids! It might not work next week.
Image
2
3
I have no idea what this all means, but it feels kind of important. Finally, here's a stable diffusion image prompted simply with a list of words GPT generated with the prompt: 'Please list 25 synonyms or words that come to mind when you hear " Leilan".' (10 runs, deduplicated)
Image
1
13