Maggie 🔜 visting SFO 🇺🇸 on Twitter: "@davidmanheim Oh neat I didn't think to do a GPT-3 pass but that helps bridge the gap a little. Still not able to do the nuanced metaphor design that a human could though. Specificity of the image is one step, but making those literal symbols stand in as metaphors for the concept is the next" / Twitter

Maggie

visting SFO

@Mappletons

Jul 17

Just realised promptupyour.life – the tiny prompt generator

@daveforall

and I built – could generate inputs for DALL-E & co. But turns out they can't do abstract representation of concepts yet. So "{noun} to illustrate {concept}" doesn't work. Perhaps a future benchmark?

A prompt generated by promptupyour.life: "Draw a porcupine to illustrate the paleo diet"

Porcupine images generated by Midjourney

2

26

The generator is very simple: Draw {noun} to illustrate {concept} in the style of {art movement} Simple, but requires finding symbols and imagery associated with the abstract concept, then artfully blend it with the noun. Great editorial illustration does this well.

1

6

As plenty of others have pointed, you still need a human art director in collaboration with DALLE & co. to ask for very literal descriptions of things. Until we teach it metaphors and symbolic representation...

2

6

David Manheim

@davidmanheim

Aug 4

I'm optimistic that clever prompt engineering could use GPT-3 to build the literal descriptions and automate the pipeline for what you've done already.

1

David Manheim

@davidmanheim

Aug 4

For example, using the earlier prompt;

1

Replying to

Oh neat I didn't think to do a GPT-3 pass but that helps bridge the gap a little. Still not able to do the nuanced metaphor design that a human could though. Specificity of the image is one step, but making those literal symbols stand in as metaphors for the concept is the next

7:06 AM · Aug 4, 2022Twitter Web App

Replying to

and

Certainly not beyond the reach of NLP/LLMs though. I love all the work Tony Veale has done in the space and has built a lot of practical metaphors generators: direct.mit.edu/books/book/454 haddock.ucd.ie/comix/Twitterb

direct.mit.edu

Tony Veale and His Metaphor-and Story-Generating Programs

2

Conversation