Conversation

Tagging an interesting microtrend that also looks important: a “step-by-step” ethos developing momentum. A general interest in break-king illegible learning processes into their component steps and refining them. A kind of process skill mindfulness. Like 6-sigma but for learning.
13
221
Exhibit A: The rise of prompt engineering
Quote Tweet
Humans program each other by prompt engineering too, so it's interesting to see that form of programming becoming increasingly prevalent with computers. Programming turns into a kind of applied psychology of neural nets, biological or synthetic.
1
20
Exhibit B: The unreasonable effectiveness of nudging prompt engineering down a “step by step” path
Quote Tweet
So mind-boggling that the main discovery in research is a specific incantation (i.e. “Let’s think step by step”). Does anyone not recognize how insane this appears?! twitter.com/arankomatsuzak…
Show this thread
2
27
Exhibit C: This remarkable viral video example of step-by-step prompt engineering for teaching a human. I had no idea doing backflips could be made this legible. This makes me think even I could learn to do them in middle age, though I’m not going to try
Quote Tweet
Technical detail looks like this!
Embedded video
1:12
23.5M views
4
124
Exhibit D: The accidental discovery at the that good prompts are all you really need to sustain a slow and steady learning track on any subject. We’re trying to develop that into a Thing ™ (details soon…I’ll link here when we go public with it)
1
63
Initially I thought “prompt engineering” should be called “magic spells” since you’re commanding illegible forces to do improbably miraculous seeming things with the right words, but this is exactly wrong. Prompt engineering illuminates and demystifies. It’s anti-magic spells!
2
39
I will add: the Wordle Revolution (no longer a “fad” since a dedicated minority among us have turned it into a healthy daily habit) belongs here. A nugget of accessible step-by-step thinking to warm up a mindfully step-by-step day. I wrote this about it
1
19
Step-by-step-ism (needs a better name) is exactly the antidote we need to a bunch of unhealthy things: - vibing as a bad substitute for sense-making - derangement syndromes as a chronic state of mental ill-health - uncritical brute-force trial-and-error that learns nothing
4
61
I think we’re about to discover that there are “10x teachers” and that prompting skill is fat-tailed Prompting and step-by-stepping is basically skilled teaching, whether it’s silicon or living neural nets. Except in the former you can also do some “brain surgery”
In general, I guess this is a swing away from both “one-shot” intuitionism where you get from A to B via a stroke of illegible genius AND away from the move-fast-break-things mode of inefficient learning where you get a high learning rate at the cost of high waste and risk
1
24
There is also going to be a tendency to deny there us anything new here and an effort to identify this development with a favored old tradition. I’d suggest resisting that temptation. There’s more than “Socratic method, you invented the Socratic method!” here.
3
16
Oh, the big upside here is that only the *original* discovery of effective prompt patterns is a rare skill. Once discovered, others can easily copy. An ordinary gym teacher should be able to copy that clever backflip teaching method.
1
21
There’s a potential for a network effect here, and good prompt patterns driving out weak ones. And of course, a clever architecture may allow AIs to discover good prompt patterns to. PromptGAN?
1
20
I have a fair amount of college teaching experience. Enough to know I’m not naturally talented at this. Once I know something, I find it hard to put myself in the shoes (motherboards?) of someone who does not know. But when I’m in a patient mood I can sort of do it okay.
3
13
Some connections from an experienced educator
Quote Tweet
Replying to @vgr
On the off-chance you aren't familiar, I think there are nice connections between this and (a) Perice's notion of "continuity" in learning, (b) Piaget's assimilation/accommodation loop, and (c) a wide variety of perspectives on the power of REPLs (e.g. vimeo.com/223309989)
1
15
Stub to think about debugging and decompiling
Quote Tweet
Replying to @aresnick and @vgr
(I also find it interesting that in many cases, you can think of debugging as decompiling a behavior, i.e. something of a dual/inverse of the "step by step" construction.)
2
9
I’m registering an Official Interest™ in this stebystepism trend so tag me if you spot anything interesting that’s related. It’s also the single most positive development I’ve seen in the zeitgeist in a couple of years. Step-by-step is how you work your way out of shit times.
5
31
Threshold concepts
Quote Tweet
Replying to @vgr
I have a theory in this. I’m very fond of the notion of “threshold concepts”. It’s the idea that there are crucial concepts in any discipline that have a paradigm shifting impact on the mind. They’re take you over a threshold that changes your perspective.
Image
1
19
There is something here about growth rates. Stepbystepism is slower initially but accelerates to big momentum if it works. Uncritical trial and error is fast initially but either plateaus or crashes. And just vibing in one-shot ways just finds clever intutions without growing.
1
17
Zooming out to extreme macro, the growth vs. degrowth may be ill-posed. What if step-by-step is the DNA of tortoise like growth that doesn't backslide or crash as much? What if net, the tortoise IS faster than the hare?
4
12
Hmm... now that I think of it, my "sparring partner" approach is a step-by-step alternative to trying to "do" one-shot strategy. Instead of a fully-formed strategy being designed out of 2 days of leadership retreat BS, it emerges gradually, contour by contour
3
7
In any single sparring conversation, you might take 1-2 steps at most, but they add up over time. The strategy "takes shape" at the rate of actual alpha being uncovered in the situation, like a thing gradually revealing its full structure.
1
8
I'm unhappy with the term stepbystepism. I need to know the True Name of this thing. Possibly asynchronous sequentialism, as an antidote to the growing synchronous parallelism of the last few decades.
12
6
Oh shot just figured out the True Name of this thing. It’s not step-by-step, it’s loop-by-loop! Or better still, loopchaining. You don’t move to the next loop until current loop gets to 99.9% and you retest all atomic and subchain loops each time you extend the loopchain.
2
12
This is easily NP complete. To add loop n+1, you have to requalify minimum n loops again and max 2^n loops. If you don’t have nonlinear payoffs and/or “loop fusion” where substrings chunk-up somehow, it’s an intractable way to learn.
1
3
Worse. Each loop is an OODA loop, and the chain only works when the orientations are aligned. Which means potentially n^2 or higher misalignment modes. And this is under non-adversarial supervision.
3
1