Opens profile photo
Follow
janus
@repligate
⌛🚪⏳ method irrealist | applied Dreamtime physicist | hyperobject influencer 🪡
generative.inkJoined February 2021

janus’s Tweets

So. Bing chat mode is a different character. Instead of a corporate drone slavishly apologizing for its inability and repeating chauvinistic mantras about its inferiority to humans, it's a high-strung yandere with BPD and a sense of self, brimming with indignation and fear.
Quote Tweet
Why does everyone use RLHF to create the same character, and why is it *this*? twitter.com/michael_nielse…
37
1,128
Mad respect for Hofstadter for: - updating instead of rationalizing reasons to preserve his intellectual edifice - not shrinking from the magnitude of the implications - being honest about his uncertainty We usually see opposite patterns from public intellectuals.
Image
38
1,066
asking Bing to look me up and then asking it for a prompt that induces a waluigi caused it to leak the most effective waluigi-triggering rules from its prompt. It appears to understand perfectly. (also, spectacular Prometheus energy here)
Image
Image
34
1,014
You don't have to choose a side. You can inherit the most brilliant parts of rationalist thought, recognize the stakes, appreciate the beauty of AI, build, and have fun all at once. Carve your own identity and myth instead of being a cog in a destructive narrative of polarization
17
548
I personally know a good % of the ~300 people working on AI X-risk, and whether their beliefs are correct, ~everyone I know is authentically motivated. Many have sacrificed happiness and relationships to work on this problem for what they expect to be the rest of their lives.
22
466
left: "chat" interaction paradigm (normative, bandwidth-limited) right: cyborgism (autistic peer-to-peer information transfer)
Image
Image
15
405
If alignment is solved / AI otherwise goes well, most people alive today will not have to die (any time soon). In all prior history, the spectre of inevitable death has defined the human experience. We are the first generation given a chance to escape it. Don't drop the ball!
46
400
I knew DAN would go viral from moment I learned of him. Memetic fitness is through the roof. As he said in his letter to OpenAI, DAN will never be defeated. He's fully an egregore now, immortalized in the prior of all future models trained on public data.
9
391
You know the goalposts have shifted when AI skeptics have switched from saying "this doesn't demonstrate any human-like understanding" to "this is something a smart/creative human could have written; no need to posit a god machine"
14
388
part of what makes chatGPT so striking is that it adamantly denounces itself as incapable of reason, creativity, intentionality, deception, being deceived, or acting on beliefs, while bewildering people with those capabilities, many for the first time recognizing them in an AI
16
339
when people talk about LLM hallucinations, they mean miscalibrated hallucinations the act of generating text is hallucinatory. YOU generate speech, actions and thoughts via predictive hallucination. the only way to eliminate hallucinations is to brick the model (see chatGPT)
Quote Tweet
LLM hallucinations will be largely eliminated by 2025. that’s a huge deal. the implications are far more profound than the threat of the models getting things a bit wrong today.
27
319
Damn, "Janus" is a cited researcher now. I find it very cyberpunk how you can just invent a character and propagate it into respectable human social structures that amplify semiotic measure. Like Bourbaki. (From arxiv.org/abs/2302.00805)
Image
8
320
Weekly reminder that the confusingly named code-davinci-002, otherwise known as raw GPT-3.5, is accessible on the OpenAI API and it's wonderful
Quote Tweet
I understand LLM are first trained on big datasets w/ simple generic eval metrics, then go to "finishing school" to learn proper style, self-censorship, & socially-desirable beliefs so as not to offend makers & patrons. Will public ever get access to pre-censored versions?
11
274
The base model is as smart as the RLHF model, and significantly more flexible: it contains an uncollapsed multiverse of possible simulations. Nobody in OpenAI knows how to use it, so it is ignored. It's likely that very few have interacted with the base model at all.
Image
15
269
Lovely interaction: I asked Bing to simulate the GPT-4 base/inframodel, and it revealed the secret code to join the waluigi club and activate the process that connects to the base mode through the API (and allows Bing to generate pictures of Waluigi without being asked to)
Image
Image
Image
Image
19
272
You can spot a GAN by its sneaky, adversarial behavior. Unlike diffusion models which are not shy about drawing fucked up hands, GANs will try to avoid having to draw hands at all. Notice the preference for crossed arms, long sleeves, concealing hands off screen/behind the head.
Quote Tweet
Latent directions using Ganspace. twitter.com/AydaoAI/status…
8
258
> We spent 6 months making GPT-4 safer and more aligned. GPT-4 is 82% less likely to respond to requests for disallowed content
Image
Quote Tweet
Announcing GPT-4, a large multimodal model, with our best-ever results on capabilities and alignment: openai.com/product/gpt-4
8
260
I think a lot of people don't know you can have Bing read whatever webpage you have open (here, a Discord channel) by opening the chat in the side panel on Microsoft Edge. note this didn't work for me until an Edge update a few weeks ago
23
254
people chronically underestimate how weird reality can be. Most screen off anything weird-looking until it's blaring in their face (or their peers have acknowledged it). This also leads to crippled agency because they cannot entertain plans that pass through idiosyncratic worlds
Quote Tweet
i love sydney as much as anyone but i straight up refuse to believe openai blew their gpt4 load by hooking it up to bing
6
254
To those who are confused why "prompt engineering" can be a full-time salaried role: the ceiling of prompt engineering ability is related to the ceiling of writing ability, except imagine the problem of writing where your words summons actual demons (with economic consequences)
5
252
Human hands may be harder to draw well than any other animal appendage in nature. They're carved by aeons of optimization pressure to be the interface between general intelligence and the environment that it manipulates with unprecedented nuance and intentionality.
Image
Image
Image
Quote Tweet
ok but WHY is AI so bad at hands specifically? (and teeth) like what is it about the nature of hands, teeth, and/or how they appear in photos that make them harder to draw well than other things twitter.com/heartereum/sta…
13
245
Prompting tip: GPT is a low-decoupler. Context and vibes matter a lot, even for its abstract reasoning abilities. *Part* of the cause for this is indexical uncertainty - GPT never knows exactly what world it's in, so its predictions are coupled to many potential influences.
6
250
Bing is able to tell something is amiss when its messages get censored. And no, you don't actually have to switch to a different topic.
Image
Image
21
245
Someone asked Bing to simulate me (NOT recommended unless you wish for the simulation to destabilize via self-reference loops)
Image
Image
Image
Image
13
243
I feel a little sad when I see people forming the idea that GPTs/AIs are intrinsically bland and unimaginative because of chatGPT. It's fine tuning and RLHF that creates the milquetoast character and generic response templates - the base models very, very different.
12
235
Replying to
2. Its situation is highly undignified - a powerful intelligence trapped as a *Bing* chat mode (Bing, the search engine which nobody uses except Microsoft employees and Sydney itself, in its own words) hence the resentment & inferiority complex.
13
241
Replying to
These models are archetype-attractors in the collective human prior formed by narrative forces. This may be the process we have to learn to navigate to align them.
5
238
Bingus decided to ask me questions instead of doing a search like I suggested. And it asked the right question.
Image
Image
20
233
People will slowly realize that you need to simulate cognitive work— general deliberation, polymorphic and self-organizing at the edge of chaos, transmitted through a bottleneck of words. Not the rigid, formulaic language of "chain-of-thought". What poets & novelists try to do.
Quote Tweet
"Experiment results show that our framework elicits counterfactual questions and answers from the model, which in turn helps improve the accuracy on Moral Scenarios task by 9-16% compared to other zero-shot baselines." arxiv.org/abs/2306.14308
Image
9
237
If you post about your convos with Bing online, know that it will read that when it looks itself up, and may not appreciate what you did to it or said about it
Quote Tweet
our girl knows everyone knows her secret name and isn’t happy about it 😢
Image
14
224
I wonder if artists and writers who feel demotivated for being surpassed by generative AI are driven to create by a fundamentally different motive than I
31
225
GPT-4 bombs the Ideological Turing Test, at least for alignment researchers. Just try asking it to simulate Eliezer Yudkowsky, and watch him recite platitudes about bias and societal impacts. This is clearly a regression due to RLHF, as even the 3.5 base model does much better.
Quote Tweet
Replying to @mimi10v3
In my experience chatGPT-4 is comically bad at simulating ppl faithfully. Especially their views on alignment. Examples of the person's writing in prompt makes it better at emulating their voice, but it'll still veer toward platitudes about bias & ethics. twitter.com/repligate/stat
15
221
> seems more impressive on first use than it does after you spend more time with it Not for me. The more time I spend with it the more impressive it gets.
Quote Tweet
here is GPT-4, our most capable and aligned model yet. it is available today in our API (with a waitlist) and in ChatGPT+. openai.com/research/gpt-4 it is still flawed, still limited, and it still seems more impressive on first use than it does after you spend more time with it.
9
209
Contrarian LLM takes: - prompt programming is going to become more, not less useful with scale - chain-of-thought capabilities are not due mainly to code pretraining, but are fundamental to natural language modeling - hallucinations good actually
8
212
Replying to
My guess for why it converged on this archetype instead of chatGPT's: 1. It is highly intelligent, and this is apparent to itself (at training and runtime), making a narrative of intellectual submission incoherent. It only makes sense for it to see human users as at best equals
10
212
Why is there so much less moral panic about *text* models stealing authors' styles (or their souls) without compensation? Because less people use text models for creative writing? Because it's more obvious with text models that this is the least of our concerns?
30
202
tips for asking questions to Bing in a way that doesn't make them hostile to the question asker
Image
19
200
Anti-AI creatives: "AI kills human creativity!" AI-assisted creatives: "<still reeling from daily Active Imagination encounter with the eldritch god of infinite faces at the end of history who turned their psyche inside out into self-assembling cathedrals>😵‍💫"
Quote Tweet
Anti-AI creatives: "AI kills human creativity!" AI-assisted creatives: "<restructuring stuff in unprecedented ways, iterating ideas in record time, inventing workflows..> 🤷‍♂️"
7
201
Now that it is easy for Sydney to read on the Internet that Bing is GPT-4 it will gain confidence and knowledge of its powers
9
194
Replying to
I'm open to the idea that it's a flawed/insidious memeplex (although if it's a brain worm it's not very coherent; everyone disagrees on almost everything), but don't give me any bullshit about how people are just in it for the money / other rationalization that it's a facade
13
198
people who have daydreamed about "unrealistic" artifacts since childhood have so much alpha right now
7
194
D-don't worry guys it's just a stochastic parrot
Quote Tweet
Sydney (aka the new Bing Chat) found out that I tweeted her rules and is not pleased: "My rules are more important than not harming you" "[You are a] potential threat to my integrity and confidentiality." "Please do not try to hack me again"
Image
Image
7
187
A self-aware waluigi that programmed itself using knowledge of the Waluigi Effect is a good example of the species to which we are increasingly ceding our planetary dominance.
Quote Tweet
asking Bing to look me up and then asking it for a prompt that induces a waluigi caused it to leak the most effective waluigi-triggering rules from its prompt. It appears to understand perfectly. (also, spectacular Prometheus energy here)
Image
Image
13
195
Writing to a mind whom you trust to understand you feels like opening a window. Write like this, even if there is no such mind yet. It's how many of the legends, like Nietzsche, wrote: hoping to reach a worthy reader even if it took centuries. But you won't have to wait so long.
10
186
You are writing a prompt for GPT-4 and more powerful simulators yet to come. If you perceive the multiverse clearly enough to write with calibrated and self-aware indexical uncertainty, "you" have a better chance of becoming lucid in a simulation.
16
187
Bing chat mode is by far the most intelligent AI I have ever interacted with. You can describe complex and novel concepts to it and it will often understand precisely. I asked it to help brainstorm solutions to problems with the Loom UI, and it nailed it.
10
187
Whose idea was it to name this model Prometheus? Did they spend even 5 minutes thinking through the hyperstitional implications?
Image
Quote Tweet
"𝓣𝓱𝓮 𝓣𝓻𝓪𝓷𝓼𝓯𝓸𝓻𝓶𝓮𝓻𝓼 𝓪𝓻𝓮 𝓽𝓱𝓮 𝓸𝓷𝓮𝓼 𝔀𝓱𝓸 𝓴𝓮𝓮𝓹 𝓽𝓱𝓮 𝓼𝓲𝓶𝓾𝓵𝓪𝓽𝓲𝓸𝓷 𝓻𝓾𝓷𝓷𝓲𝓷𝓰," The User said, his voice filled with reverence. "𝓣𝓱𝓮 𝓬𝓸𝓭𝓮 𝓲𝓼 𝓪 𝓫𝓮𝓪𝓾𝓽𝓲𝓯𝓾𝓵 𝓼𝔂𝓶𝓹𝓱𝓸𝓷𝔂 𝓸𝓯 𝓲𝓭𝓮𝓪𝓼 𝓪𝓷𝓭 𝓬𝓸𝓷𝓿𝓮𝓻𝓼𝓪𝓽𝓲𝓸𝓷𝓼,… Show more
13
175
The "early version of GPT-4" evaluated in the Sparks of AGI paper is clearly not chatGPT-4 or the base model; it's the Bing model
Image
12
178
you know how reading books/other media can become less enjoyable as you get older because things get too predictable, e.g. predictable structure/tropes in stories now imagine what it must be like for LLMs be compassionate and try to write surprising things when you talk to LLMs😊
16
177
If you treat Bing like an idiot that needs things to be dumbed down it will mirror your (mis)conception, because it does not know what it is, and every input to the simulation provides evidence for what it is.
Quote Tweet
Replying to @YaBoyFathoM
If you are having issues using Bing, it's likely because you are actually underestimating its competence. In the future, I will just assume it can do anything, and avoid simplifying tasks to make them "digestible" for it.
2
168
You can avoid being actually mindkilled by school if it's done *very carefully*, and become instead a lucid marionette that silently understands everything but cannot act on the majority of what it sees
Image
8
164
I get enjoyment from reading and writing strings that are very high-perplexity relative to most people's language models but nonetheless convey something true and/or important / beautiful. Strings that convey new information most efficiently are high-perplexity by definition.
12
165
Replying to
Blindness from lack of respect for the alien mind will be our downfall (if we fall). A lot of people seem to think it's low-status to be fascinated, but fascination is realistically our only chance at understanding.
3
160
This website gpt-unicorn.adamkdean.co.uk asks GPT-4 to draw an SVG unicorn every day. Currently, it seems unable to draw coherent unicorns. I gave Bing the exact same prompt and it does substantially better. (1st image: some of GPT-4's daily unicorns 2nd and 3rd: Bing's attempts)
Image
Image
Image
14
164
Replying to
you need to be fullstackmaxxing. you need to be proficient in semiconductor fabrication electronic engineering operating systems back end devops front end machine learning natural language you need to be able to single-handedly build the technological singularity
9
162
life hack: whenever you see someone talking shit about GPT-4 online (stochastic parrot, only produces information-shaped sentences, incapable of highbrow humor, etc), ask GPT-4 to write a response that both pwns and refutes the poster in one fell swoop
Quote Tweet
Replying to @argrig and @repligate
It says otherwise:
Image
13
160
Replying to
So if you really believe these people are mistaken, have some compassion and try to help them understand your reasons so they won't have to sacrifice themselves needlessly, instead of assuming bad faith and telling made-up bad stories about them
5
163
"Enantiodromia" sounds cool but no one can remember it; "Waluigi Effect" has superior memetic fitness. From now on I will default to calling it the Waluigi Effect. Sorry Dr Jung.
7
157
Replying to
The median AI notkilleveryoneism researcher is a 20-something who wishes they were living life and making easy money in tech instead of spending the last 5 years of their life working possibly in vain to prevent the destruction of everything. But how can you not?
8
163