Conversation

This is a great article/thread that illustrates how you can chain together prompts + API calls to allow a large language model (LLM) to create robust task-specific workflows When you prompt an LLM directly, you rely on what it can do "from memory", but this is limiting 🧵
Quote Tweet
The intelligence of generative LLMs is surprising. But people often overestimate it in areas while underestimating it in others. Key concepts: 1- It's important to augment their information with the right sources. So it's not Human: Question GPT: Factual answer. It's more
Show this thread
Image
5
Bookmarks
In the near future, language-aware ML-powered software will be created by connecting multiple modules and leveraging language as an interface By specifying a sequence of operations using language, each step will be implemented using an LLM or an external API (e.g. a web search)
1
Right now creating step-by-step LLM-powered workflows feels academic, but that's only because 1. LLMs are still a bit expensive to run 2. We don't have great tools for easily chaining together prompts This is about to change as more startups/researchers attack this problem
1
Once better tools are in place, the entire ecosystem will snowball. Why? 1. There will be more and more predefined modules which can automatically execute each step of a language-defined workflow 2. There will be tools for automatically decomposing tasks in to a series of steps
1
The exciting part is that once task decomposition can be automated (meaning high level tasks get composed in to a series of steps), it will be possible to preemptively create libraries of tasks in order to identify what step-specific modules already exist vs need to be created
1
This will result in an explosion of activity Researchers/engineers will start "filling in" modules, confident that the work they are doing will be automatically pulled in to the workflows where it's relevant (no one wants to create a module if it won't be used)
1
Long story short, in 2023, we can expect to go from one-off prompts to language-defined workflows From there, we'll see much better tools for 1. Step-by-step task execution 2. Automated workflow creation 3. Automatically identifying/creating the modules need to perform tasks
1
Thanks, I think the big three are 1. Easy step-by-step prompt execution 2. Semi-automated workflow creation (i.e. going from high level task descriptions to inferred step-by-step breakdowns) 3. Automatically identifying/creating the modules needed to perform tasks
1
Show replies