In April, '17, of reached out & said he wanted to do a small profile of me & my longtime colleague Sanjay Ghemawat, watch us work for a few hours, maybe dinner, etc.
It came out today. I think it captures our working style really well.
Follow
Jeff Dean (@
)
)@JeffDean
Senior Fellow & SVP, Google Research and AI. Co-designer/implementor of software systems like , MapReduce, Bigtable, Spanner, .. (he/him)
research.google.com/people/jeffJoined September 2017
Jeff Dean (@🏡)’s Tweets
A good but depressing visualization.
Quote Tweet
This image charts the variation in daily Arctic sea-ice extent, 1979-present (JAXA data). Each day's extent is compared to the 44-year average extent for that same day, and colored a shade corresponding to the difference.
Blue = above average
White = average
Red = below average
Show this thread
3
6
45
I love what and are doing to improve diversity in STEM. Although I've been trying to go metric, so I affectionately refer to them as the Last Kilometer Fund.
Quote Tweet
Our Founder and CEO, @ruthef, is looking forward to sharing her ‘Spark Talk’ with attendees at the 2023 #InfyXRoads and collaborating around new ideas and insights, all while “Decoding #PassionforCS "! @InfyFoundation
1
4
17
Part 3 in the series is out, by Mangpo Phothilimthana and , covering the intersection of ML and computer systems (distributed systems, compilers, hardware design, energy-efficient and low emissions computing, etc).
4
25
98
Show this thread
Part 3 in the series is out, by Mangpo Phothilimthana and , covering the intersection of ML and computer systems (distributed systems, compilers, hardware design, energy-efficient and low emissions computing, etc).
4
25
98
Show this thread
This has the smell of something exciting!
Quote Tweet
Osmo is on a mission to digitize smell to improve the health and wellbeing of human life.
Show this thread
15
6
70
Part 2 in the series is out. This one, by on behalf of many, highlights the work we've done in the responsible use of AI, both advancing fundamental research in this area as well as applying these approaches to many of our products.
2
12
67
Show this thread
Part 2 in the series is out. This one, by on behalf of many, highlights the work we've done in the responsible use of AI, both advancing fundamental research in this area as well as applying these approaches to many of our products.
2
12
67
Show this thread
Sanjay and I did indeed work on this fast hash table implementation a while back, but I'd never seen 's talk about it. Nice clear talk, Matt!
Quote Tweet
Replying to @AllanDeutsch and @trashh_dev
I'm also reminded @JuvHarlequinKFM's talk about building a faster hash map at google, where whenever they have a REALLY hard problem @JeffDean and Sanjay Ghemawat appear from out of nowhere with a brilliant and elegant solution. check out a min from 24:24 youtu.be/ToTKJqCiSwo?t=
5
8
125
We've just released the first version of our Deep Learning Tuning Playbook! This is our attempt to distill our process for actually getting good results with deep learning. We emphasize hyperparameter tuning since it has been a large pain point.
36
800
3,496
Show this thread
In my opinion, this is one of the most spectacular images from the Cassini mission. It is a close-up of the edge of Saturn's B ring, and shows shadows on the rings from tall structures in the rings! solarsystem.nasa.gov/resources/141/
226
3,621
26.3K
Show this thread
I'd forgotten I wrote this up in the Google+ days and I guess it somehow ended up on Quora. I enjoyed working with Monika Henzinger on this.
(Paper: infoscience.epfl.ch/record/99350?l)
Quote Tweet
This story about how @JeffDean and Monika Henzinger independently came up with a way to use the link graph to find related pages while at DEC/AltaVista and the engineer they sent it to not knowing how to open a .tar file is wild.
bit.ly/3QXrHZp
3
12
93
A huge thanks to all of the community whose great work is represented in this post as well as the subsequent posts in the series. 🙏
2
4
51
Show this thread
Excited to share the first of a series of blog posts summarizing our research work from 2022. This covers language & multimodal models, computer vision, and generative models. We'll have ~7 posts covering other areas over next few weeks!
ai.googleblog.com/2023/01/google
27
320
1,483
Show this thread
Congrats to all the newly named ACM Fellows! Great to see the well-deserved recognition of so many great computer scientists!
Quote Tweet
Meet the 2022 ACM Fellows! 57 of the ACM members have been selected for their wide-ranging and fundamental contributions in the #computing field. Please join us in congratulating these new inductees!
Learn more about their achievements here: bit.ly/3CXulZz
#ACMFellows
2
5
36
Happy birthday, NeRF! I love these little behind-the-scenes peeks at the research process. Thanks for sharing, , Matt Tancik, , and .
Quote Tweet
Three years ago today, the project that eventually became NeRF started working (positional encoding was the missing piece that got us from "hmm" to "wow"). Here's a snippet of that email thread between Matt Tancik, @_pratul_, @BenMildenhall, and me. Happy birthday NeRF!
2
11
91
Thanks, glad you liked "The Tail at Scale", ! and I had fun writing it.
I'm attaching an image relevant to long tails that I usually use if I give a talk about this topic (always nice to be able to use ones' vacation photos!).
Quote Tweet
"The Tail at Scale" by @JeffDean and @labarroso (CACM, vol 56, 2003) is one of my absolute favourite articles on the impact of tail latency and how to tame it. 
1/
1/Show this thread
1
12
131
🧬 🤖 TECHBIO BOOM! to buy for £342M in cash + up to £200M more.
In Feb ‘21, I wrote “I see exciting ways that ML can be integrated into rational and predictive AI-first mRNA vaccine design”
Thx for delivering 😉
investors.biontech.de/news-releases/
5
58
217
Show this thread
Let the race for the quettaflops era begin! That quite-a-lotta flops.
Quote Tweet
Woah, I had no idea that new SI prefixes dropped last year
Show this thread
8
24
136
Bridges represent some of the greatest achievements of human engineering and architecture. Here are 12 of the most extraordinary:
1. Millau Viaduct, France (2004) - the world's tallest bridge.
2,787
41.2K
352.5K
Show this thread
Here is our largest database of PhD fellowships yet: we found 195 fellowships and funding opportunities.
For each fellowship, this searchable database lists description, deadline, amount, and eligibility criteria.
Download it here: research.jhu.edu/rdt/funding-op
34
1,390
3,075
This was a long but really good article:
From the article:
“This is my kryptonite, but this is her rocket fuel,” Jill says. “We’re like comic book superheros that are just as divergent as can be. I mean, her body has found a way around it somehow.”
Quote Tweet
“It seemed absolutely crazy. The idea that an Iowa housewife, equipped with the cutting-edge medical tool known as Google Images, would make a medical discovery about a pro athlete who sees doctors and athletic trainers as part of her job?” propublica.org/article/muscul
Show this thread
7
18
171
I am delighted to announce that the "real" camera-ready version of my new book, "Probabilistic Machine Learning: Advanced Topics", is now available. It will appear in print this summer, but it is already freely available online at probml.github.io/book2.
21
486
2,316
Show this thread
Happy New Year to all! May you all have health, happiness, and enthusiasm for everything great that you do!
20
11
544
If I wanted to talk about the mathematics of board games in a course what should I include?
162
64
630
Show this thread
If you installed PyTorch-nightly on Linux between Dec. 25 and Dec. 30, uninstall it and torchtriton immediately and use the latest nightly binaries.
Read the security advisory here: pytorch.org/blog/compromis
15
615
822
Vision transformers have taken the field of computer vision by storm, but what do vision transformers learn?
ViTs have fewer inductive biases than CNNs. However, it turns out that they learn inductive biases (or features) similar to CNNs!
1/2
13
102
755
Show this thread
As a former pitcher, I found this interesting..
Quote Tweet
#MachineLearning to improve Baseball strategies? Let me share my student's master's thesis @mit: SmartPitch: Applied Machine Learning for Professional Baseball Pitching Strategy.
dspace.mit.edu/handle/1721.1/
Yes that's right, @MIT_CSAIL graphs w/ @MLB headshots. What's it about? 1/n
Show this thread
4
6
38
Quote Tweet
Delighted to share our new @GoogleHealth @GoogleAI @Deepmind paper at the intersection of LLMs + health.
Our LLMs building on Flan-PaLM reach SOTA on multiple medical question answering datasets including 67.6% on MedQA USMLE (+17% over prior work).
arxiv.org/abs/2212.13138
Show this thread
4
65
Show this thread
Delighted to share our new paper at the intersection of LLMs + health.
Our LLMs building on Flan-PaLM reach SOTA on multiple medical question answering datasets including 67.6% on MedQA USMLE (+17% over prior work).
arxiv.org/abs/2212.13138
37
461
2,055
Show this thread
*FlexiViT: One Model for All Patch Sizes*
by
Tip: train a ViT with multiple patch sizes, then deploy based on the desired comp budget.
arxiv.org/abs/2212.08013
2
31
181
Quote Tweet
Large Language Models Encode Clinical Knowledge
Flan-PaLM achieves SotA accuracy on the proposed MultiMedQA MCQ dataset (MedQA, MedMCQA, PubMedQA, MMLU clinical topics), including 67.6% on USMLE questions, surpassing prior SotA by over 17%.
arxiv.org/abs/2212.13138
12
130
849
Show this thread
Following years of research featuring thousands of people who recorded over a million speech samples, we released Project Relate in beta. This Android app uses machine learning to offer personalized speech recognition for non-standard speakers.
19
151
488
Aaaand the special innovation award goes to...
1
10
69
4
31
60
Show this thread
Introducing RT-1, a robotic model that can execute over 700 instructions in the real world at 97% success rate!
Generalizes to new tasks✅
Robust to new environments and objects✅
Fast inference for real time control✅
Can absorb multi-robot data✅
Powers SayCan✅
🧵👇
64
683
2,400
Show this thread
Nice to see the relatively steep slopes on wind and solar. Wish the negative slopes on coal and gas were more vertical.
Quote Tweet
The @IEA’s bombshell new report on renewables has incredibly good news.
For example, solar is undergoing a mega boom & may surpass coal by 2027
Below is a 
on genuinely good news on green energy from the IEA & beyond (1/22)
Cc: @Noahpinion @JesseJenkins @ramez @dwallacewells
on genuinely good news on green energy from the IEA & beyond (1/22)
Cc: @Noahpinion @JesseJenkins @ramez @dwallacewellsShow this thread
10
15
109
How to write a letter of recommendation for your PhD student
43
619
3,571
Show this thread
Thank you to everyone on the organizing and steering committee for putting together a great ML for Systems workshop at NeurIPS!
Quote Tweet
As a 4th time organizer, I must say we have an amazing program this year at ML for Systems at NeurIPS.
Before I forget —
Organizers @martin_maas @Azade_na @BenoitSteiner Neel Kant @DZhang50
Steering @annadgoldie @Azaliamirh @jonathanrraiman @miladhash @kswersk
+ PC.
Show this thread
4
43
Tough loss for Team USA vs the Dutch. But now we have to replace our highways with bike lanes. Sorry, those are just the rules of the World Cup.
16
277
2,034
Show this thread