Opens profile photo
Follow
Click to Follow GiorgioPatrini
Giorgio Patrini
@GiorgioPatrini
founder ex univ of amsterdam and australian federal govt ~ phd at ANU
Amsterdamgiorgiop.github.ioJoined April 2013

Giorgio Patrini’s Tweets

Pinned Tweet
We have released *dot* (aka Deepfake Offensive Toolkit), an extensible library for injecting real-time deepfakes in virtual cameras. At no training cost. 🚀 First time at the the top of Hacker News news.ycombinator.com/news 👍 Congrats to team!
3
34
Show this thread
Why so many people exited OpenAI for their own gig? How is that financially sensible given the company trajectory? A downside of its initial non-profit structure (no employee equity)? e.g. Anthropic is a "public benefit" but for-profit company Image credits
Image
2
13
Show this thread
no current research surveys can be any better than 's
Quote Tweet
🦖Large Transformers are powerful but expensive to train & use. The extremely high inference cost is a big bottleneck for adopting them for solving real-world tasks at scale. Check out my new post on some ideas on inference optimization for Transformers: lilianweng.github.io/posts/2023-01-
5
I was inspired by
Quote Tweet
Turns out they might already😆 Can LLMs be few-shot *image* classifiers? While prepping notes for cs324.stanford.edu, I revisited the idea... by turning images into ASCII Check out the notebook here: colab.research.google.com/drive/1I4RCsJ6
Show this thread
Question: With a few examples, can we prompt GPT-3 to classify images?

Main barrier: GPT-3 processes text. Images are images. 

Dumb idea: Convert images into ASCII art. 

For each sample, linearize these “features” into a prompt template paired with the target label. 

To classify an image, leave a final ASCII image without a ground-truth label (a “blank”). 

Finally, prompt GPT-3 to fill in the blank.
1
Show this thread
Given the many suprising emergency properties of GPT-like models, I am puzzled that ASCII images seem to be that hard to understand. A 5yo can understand ASCII art, while python is likely too hard for most people at that age.
1
Show this thread
At this point, we may assume that this is a play: - gpt doesn't know how to solve the problem, and RLHF has taught it well to be conservative under uncertainty - when pushed, it will try to provide an answer anyway, and sometimes the answer is OK
1
Show this thread
I ask more specific questions, perhaps easier than elaborating a full description. For humans, it seems easy to guess gender, or an approximate age, for example. chatGPT is being conservative again, and avoid an answer, at first. you can see a pattern
Image
1
Show this thread
I ask more specific questions, perhaps easier than elaborating a full description. For humans, it seems easy to guess gender, or an approximate age, for example. chatGPT is being conservative again, and avoid an answer, at first. you can see a pattern
Image
Show this thread