François CholletVerified account

s-v agreement from example (first two) fails with rc attractorspic.twitter.com/3gYHrwMxue

adding the two rc examples as prompts (now first four are prompts), improve things substantiallypic.twitter.com/6sv47oPxv0

some more "code", here the prompt was "def factorial(a):" obviously it has this memorized + spit out a few more recursive homework functions just in case. (i think the lack of indentation is a UI issue)pic.twitter.com/GmavuydWSP

here the prompt was: """ # non recursive implementation of factorial def factorial(a): """ the result is.. interesting.pic.twitter.com/45FH9WUWtg

a few more "code" examples, here's a "translation from python to java". it does the syntax well but clearly does not understand the semantics (duh). however i really like its post-code textual remarks, kinda shows where it is coming from, and to what extent it "understands".pic.twitter.com/kcmwZxEIhM

this is a really neat code example (i gave it only the bold part). note how it not only implements the function, but also generates two other related functions. the context sensitivity of this pattern matching and re-use is really impressive.pic.twitter.com/ybIrpNttwN

otoh, re-running the same prompt does not reproduce this neat behavior:pic.twitter.com/LrrchFXY5a

in general, many simple cs101 homework code-gen "success-stories", but also many many failures. at least it knows that it should add some tests:pic.twitter.com/tMVq21xTM7