Conversation

Very nice & inspiring, "no-gradient architecture" for high-level skills/learning. LLM here is the "prefrontal cortex" orchestrating the lower-level mineflayer API via code generation++. Meta-comment is that I remember how hopeless it felt to work on agents in environments like Minecraft around ~2016, feeling stuck on how RL at the time would ever randomly explore their way into performing long-horizon tasks from super sparse rewards. This block has now to a very large extent been lifted - the correct thing was to forget all that, first train LLMs that learn (1) world knowledge, (2) reasoning and (3) tool-use (esp writing code) all from internet text, then point them back at the problem in this kind of a way. TLDR If I had read about this "no-gradient" approach to agents in 2016 my mind would certainly be blown. Also haha @ source code in the voyager/prompts/*.txt directory :D
Quote Tweet
What if we set GPT-4 free in Minecraft? ⛏️ I’m excited to announce Voyager, the first lifelong learning agent that plays Minecraft purely in-context. Voyager continuously improves itself by writing, refining, committing, and retrieving *code* from a skill library. GPT-4 unlocks… Show more
Show this thread
Embedded video
1:35
638.4K views
Andrej, if u see this maybe u can help answer something . Since my obsession w/ ChatGPT, it’s made 1 thing abundantly clear.. old/legacy smart assistants (Siri/Alexa), feel utterly ancient/inadequate in comparison. ChatGPT feels light years ahead. Can u guys make a smart speaker?
3
23
Show replies
Show replies
Well my mind is blown today. I’m only seven years behind! 😂 Thanks for sharing these updates. These are highly valuable insights.
1
9
my first thought was tokens and 💰💰💰 on fire🔥🔥🔥 after seeing the contents under voyager/prompts/*.txt, 🤪
1
5
Show replies