Conversation

Replying to

Sorry, I got the earlier thread on Accelerated Expertise wrong, see here instead:

Quote Tweet

1/ Let's talk about accelerating expertise. You want to get good. You want to get good fast. How do you do this? In 2008 and 2009 the US Department of Defence convened two meetings on this very topic. Here's what they found. (Hint: the answer is NOT deliberate practice).

Show this thread

1

6

42

Also see

’s article on adapting the US Marine’s Tactical Decision Games to product management training.

Decision-Forcing Cases: Gaining experience without the hurt

Learning about learning from the USMC, applied to product teams

1

4

39

And check out these shadowbox training exercises: shadowboxtraining.com/news/2022/02/0 shadowboxtraining.com/news/2022/04/2

1

18

What do all of these resources have in common? The answer: they’re drawn from the Naturalistic Decision Making branch of applied psychology. NDM does a lot of work for the military and healthcare. The researchers overlap quite a bit with human factors and resilience engineering.

1

1

24

So my first piece of advice is to look at NDM. The single resource that’s probably the most fruitful to dig into is The Oxford Handbook of Expertise:

The Oxford Handbook of Expertise (Oxford Library of Psychology)

The study of expertise weaves its way through various communities of practice, across disciplines, and over millennia. To date, the study of expertise has been primarily concerned with how human...

2

5

47

But really the general recommendation to look at training systems or training research that’s been funded by the military is probably a good heuristic.

1

11

For instance: the DARPA digital tutor. Millions of dollars. Result: 16 weeks of technical training -> students outperformed practitioners with years of experience in the field.

DARPA Digital Tutor: Four Months to Total Technical Expertise? - LessWrong

DARPA spent a few million dollars around 2009 to create the world’s best digital tutoring system for IT workers in the Navy. I am going to explain their results, the system itself, possible limitatio…

1

4

44

But of course military funded research doesn’t just result in better training methods in the military. Sometimes it funds results in sports science. Like Peter Fadde’s work on accelerating pitch recognition in baseball (later applied to tennis): peterfadde.com/projectspitchb

2

1

16

Quick summary: - You show tennis players video of a serve. - You black out the serve right before it connects. - You ask the player to identify the serve - Repeat 100s of times. - The tennis player gains expert level serve recognition quickly. - They can do this on iPhone.

Serve Serena Williams GIF by Australian Open

GIF

read image description

ALT

1

26

Anyway, my main point: - Want to learn how to learn in your career? Don’t pay as much attention to classroom based education research. - Unless it’s been applied in vocational training settings - Focus mostly on research that’s been done in applied domains

2

3

36

- The military has funded a huge amount of work into better training methods. - And they tend to not care as much about performance on tests. (They really care about transfer to real world performance) - So that’s one fruitful area to dig for ideas.

4:09 PM · Jul 9, 2022Twitter Web App

Replying to

But perhaps my biggest point: When you next read a meta-analysis or paper, ASK: “What context is this technique intended for? What context was this research performed in?” Many articles and threads on ‘learning to learn’ tend to draw on classroom-based research.

1

5

42

There’s nothing bad or wrong about classroom-based education research. But you should be very careful when applying it to vocational skills training. Whereas there may be more useful, easier to apply ideas elsewhere. Ok that’s all I have to say for now. The end.

2

2

17

Minor correction: I searched for funding sources for Fadde’s pitch recognition research and I don’t think the military directly funded it. I regret the error.

Quote Tweet

But of course military funded research doesn’t just result in better training methods in the military. Sometimes it funds results in sports science. Like Peter Fadde’s work on accelerating pitch recognition in baseball (later applied to tennis): peterfadde.com/projectspitchb

Show this thread

6

15

Replying to

The transfer point is similar to how combine tests in football don't seem to correlate to how successful you'll be in the NFL You can always optimize for the test. It's difficult to optimize in the field

1

1

Replying to

Exactly this!