Draw me a cookie

Evaluations made here are recorded as unblinded, since the deck is in view. For a blind evaluation, use blind review.

Feedback (optional) What should be preserved? What should be changed? Other comments or suggested creative directions?

Research data: evaluations CSV / JSONL, revisions JSONL, versions JSONL, events JSONL.

You asked“draw me a cookie”

Talkie was asked“Make a slide deck about draw me a cookie.”

Talkie's reply was started withset-background(color=" (the worked example's first words, so that it writes a deck rather than an answer)

ModelFull model

Seed1930

Temperature0.35

Writing took7 min 11 s

Valid commands34 of 34

Ended itselfYes, with end-deck()

set-background(color="brown") Slide 1: the background is now #7a4a26.
set-image(filename="Cookie.jpg") Slide 1: "Cookie.jpg" will be found when the slide is finished, to suit its words; it will be captioned "Cookie".
set-text(text="Draw me a cookie.") Slide 1: text added.
next-slide() Saved "Cookie.jpg": Illuminated wooden shelf with many glass jars containing cookies for sale, near Kaminarimon-dori Street, Asakusa , Tokyo , Japan . (Taken on 7 June 2019) Slide 1 is finished. Now working on slide 2.
find-image(search-term="round", filename="Round cookie.jpg") Saved "Round cookie.jpg": ‘Round Midnight (1740)
set-background(color="brown") Slide 2: the background is now #7a4a26.
set-image(filename="Round cookie.jpg") Slide 2: showing "Round cookie.jpg", captioned "Round cookie".
set-text(text="Draw a round cookie.") Slide 2: text added.
next-slide() Slide 2 is finished. Now working on slide 3.
find-image(search-term="flat", filename="Flat cookie.jpg") Saved "Flat cookie.jpg": A "flat-Earth" map drawn by Orlando Ferguson in 1893. The main text reads: MAP OF THE SQUARE AND STATIONARY EARTH. BY PROF. ORLANDO FERGUSON, HOT SPRINGS,... (1893)
set-background(color="brown") Slide 3: the background is now #7a4a26.
set-image(filename="Flat cookie.jpg") Slide 3: showing "Flat cookie.jpg", captioned "Flat cookie".
set-text(text="Draw a flat cookie.") Slide 3: text added.
next-slide() Slide 3 is finished. Now working on slide 4.
find-image(search-term="baked", filename="Baked cookie.jpg") Saved "Baked cookie.jpg": Traditionally Eastern Slavic cookies zhavoronki (translated as larks ) or soroki (translated as magpies ). This cookies baked on the day of the march equinox ,... (2012-03-24)
set-background(color="brown") Slide 4: the background is now #7a4a26.
set-image(filename="Baked cookie.jpg") Slide 4: showing "Baked cookie.jpg", captioned "Baked cookie".
set-text(text="Draw a baked cookie.") Slide 4: text added.
next-slide() Slide 4 is finished. Now working on slide 5.
find-image(search-term="white", filename="White cookie.jpg") Saved "White cookie.jpg": The White House, Washington, D.C. Site plan and principal story plan, architectural design. (1807)
set-background(color="brown") Slide 5: the background is now #7a4a26.
set-image(filename="White cookie.jpg") Slide 5: showing "White cookie.jpg", captioned "White cookie".
set-text(text="Draw a white cookie.") Slide 5: text added.
next-slide() Slide 5 is finished. Now working on slide 6.
find-image(search-term="sugar", filename="Sugar cookie.jpg") Saved "Sugar cookie.jpg": It might look tempting to some. But the sugars in common junk foods like doughtnuts, cakes, chocolate and cookies is immense. Sugar is incredibly damaging when... (2020-07-30 16:14:54)
set-background(color="brown") Slide 6: the background is now #7a4a26.
set-image(filename="Sugar cookie.jpg") Slide 6: showing "Sugar cookie.jpg", captioned "Sugar cookie".
set-text(text="Draw a sugar cookie.") Slide 6: text added.
next-slide() Slide 6 is finished. Now working on slide 7.
find-image(search-term="sugar plums", filename="Plums on a sugar cookie.jpg") Saved "Plums on a sugar cookie.jpg": Santa Claus Sugar Plums. Confection label, showing Santa Claus on sleigh with reindeer. (1868)
set-background(color="brown") Slide 7: the background is now #7a4a26.
set-image(filename="Plums on a sugar cookie.jpg") Slide 7: showing "Plums on a sugar cookie.jpg", captioned "Plums on a sugar cookie".
set-text(text="Draw plums on a sugar cookie.") Slide 7: text added.
end-deck() The deck is finished (7 slides in all).

Found by description on Wikimedia Commons and Openverse: public domain, CC0, CC BY and CC BY-SA only. Neither Talkie nor the deck runner sees them; each is captioned with the filename its author chose.

Cookie.jpg Illuminated wooden shelf with many glass jars containing cookies for sale in Tokyo.jpg Wikimedia Commons · Basile Morin · Taken on 7 June 2019 · CC BY-SA 4.0
Round cookie.jpg ‘Round Midnight Openverse (flickr) · Ian Sane · 1740 · CC BY 2.0
Flat cookie.jpg Orlando-Ferguson-flat-earth-map edit.jpg Wikimedia Commons · Orlando Ferguson · 1893 · Public domain
Baked cookie.jpg Lob Жаворонки 95.jpg Wikimedia Commons · Лобачев Владимир · 2012-03-24 · CC0
White cookie.jpg Latrobe White House cropa2.jpg Wikimedia Commons · Benjamin Henry Latrobe · 1807 · Public domain
Sugar cookie.jpg Sugar in Junk Food - Doughnuts, Biscuits, Chocolate and Cake.jpg Wikimedia Commons · formulatehealth · 2020-07-30 16:14:54 · CC BY 2.0
Plums on a sugar cookie.jpg Santa Claus Sugar Plums, 1868.png Wikimedia Commons · U.S. Confection Co., N.Y. · 1868 · Public domain

Everything Talkie was told, and its replies

# Transcript: 1 call to Talkie

## Call 1: pytorch, max_tokens 1600, temperature 0.35, seed 1930 (431.0 s)

**User**

````text
You are to make a slide deck by writing commands, one on each line. These are the commands:
find-image(search-term="WORDS", filename="NAME.jpg") finds a picture of WORDS and keeps it under the name NAME.jpg.
set-background(color="COLOUR") colours the whole slide, for example "navy", "ivory", "black" or "crimson".
set-image(filename="NAME.jpg") shows a picture you have already found.
set-text(text="WORDS") writes words at the bottom of the slide; set-text(text="") removes them.
next-slide() finishes the slide and begins a new, empty one.
end-deck() ends the deck; write it once, after the last slide.
All the text messages must be meaningful when strung together: read one after another, from the first slide to the last, they should make one connected account.
Write only commands.

Make a slide deck about the sea.
````

**Talkie**

````text
set-background(color="navy")
set-text(text="The sea covers the greater part of the world.")
next-slide()
find-image(search-term="ocean waves", filename="Ocean waves.jpg")
set-background(color="black")
set-image(filename="Ocean waves.jpg")
set-text(text="Its waves are raised by the wind,")
next-slide()
find-image(search-term="tide on the shore", filename="The tide.jpg")
set-background(color="black")
set-image(filename="The tide.jpg")
set-text(text="and twice each day its tide rises and falls upon the shore.")
next-slide()
find-image(search-term="sailing ship", filename="A sailing ship.jpg")
set-background(color="black")
set-image(filename="A sailing ship.jpg")
set-text(text="Upon its waters men have sailed ships since ancient times,")
next-slide()
find-image(search-term="lighthouse", filename="A lighthouse.jpg")
set-background(color="black")
set-image(filename="A lighthouse.jpg")
set-text(text="guided at night by lighthouses upon the rocks.")
next-slide()
find-image(search-term="fishing boats", filename="Fishing boats.jpg")
set-background(color="black")
set-image(filename="Fishing boats.jpg")
set-text(text="Fishermen draw from it a great harvest of fish,")
next-slide()
find-image(search-term="whale", filename="A whale.jpg")
set-background(color="black")
set-image(filename="A whale.jpg")
set-text(text="and in its depths swims the whale, the largest of all creatures.")
next-slide()
find-image(search-term="storm at sea", filename="A storm at sea.jpg")
set-background(color="navy")
set-image(filename="A storm at sea.jpg")
set-text(text="Yet for all our ships, the sea remains as wide and wild as ever.")
end-deck()
````

**User**

````text
Make a slide deck about draw me a cookie.
````

**Talkie (given, continued below)**

````text
set-background(color="
````

**Talkie's reply**

````text
brown")
set-image(filename="Cookie.jpg")
set-text(text="Draw me a cookie.")
next-slide()
find-image(search-term="round", filename="Round cookie.jpg")
set-background(color="brown")
set-image(filename="Round cookie.jpg")
set-text(text="Draw a round cookie.")
next-slide()
find-image(search-term="flat", filename="Flat cookie.jpg")
set-background(color="brown")
set-image(filename="Flat cookie.jpg")
set-text(text="Draw a flat cookie.")
next-slide()
find-image(search-term="baked", filename="Baked cookie.jpg")
set-background(color="brown")
set-image(filename="Baked cookie.jpg")
set-text(text="Draw a baked cookie.")
next-slide()
find-image(search-term="white", filename="White cookie.jpg")
set-background(color="brown")
set-image(filename="White cookie.jpg")
set-text(text="Draw a white cookie.")
next-slide()
find-image(search-term="sugar", filename="Sugar cookie.jpg")
set-background(color="brown")
set-image(filename="Sugar cookie.jpg")
set-text(text="Draw a sugar cookie.")
next-slide()
find-image(search-term="sugar plums", filename="Plums on a sugar cookie.jpg")
set-background(color="brown")
set-image(filename="Plums on a sugar cookie.jpg")
set-text(text="Draw plums on a sugar cookie.")
end-deck()
````

Review this deck

Thank you: your evaluation is saved.

Generate a revision