Conversation

Hexagon profile picture
I’ve been saying some form of this in my writing going back years. Unfortunately, this turned out to be an easy way to lose friends in EA, especially those working for organizations building AGI. I’m so relieved these critiques are finally getting more attention. 🙏
13
fwiw, I think there's an important role for someone being pretty straightforward in critiquing those who are increasing the risk of harmful AGI outcomes but man, I definitely feel like 😬 about being the one to do it I did a thread on this yesterday:
Quote Tweet
so I'm starting to build a reputation as a Twitter AGI firebrand 😅 not sure how I feel about it tbh in general, I'm game for stepping up when reality throws you an unexpected curveball but I wanna be real with y'all about why my reaction is currently 😬 and not yet 😀
Show this thread
1
20
Show replies
Everyone in the world would need to stop at the same time. And where exactly is the line with narrow AI? Do we stop building AI altogether? And how do we check that no one cheats?
8
12
Show replies
I'm pro the conversation. That said, I think the premise -- that folks are aware of the risks -- is wrong. My impression is most of the "fucks" don't think the risks are actually all that great.
2
7
Show replies
Show replies
The problem is that "trying to stop" and "actually stopping" ain't the same thing I turned down AI work in the 2000s - I had a PhD offer with Schmidthuber explicitly because I was worried that it was dangerous Result is that I'm poor and sidelined and it's happening anyway
2
14
Show replies
I generally agree w Kerry. Nothing they are building rn seems reckless. But aiming at AGI as goal seems reckless. Line btwn narrow & AGI is blurry & unclear so hard to draw line. There should be coordination to stop/ban work on obv dangerous things, tho, like self-modifying AGIs
1
2
Quote Tweet
Replying to @janleike @SpencrGreenberg and @KerryLVaughan
I think it's important (if doable) to clearly define where the line with narrow AI is. We can potentially do miracles with narrow AI (AlphaFold) and many people would be happy to work within the the boundaries, but will continue pushing AGI if they're told to stop altogether