Aeroplanes

Evaluations made here are recorded as unblinded, since the deck is in view. For a blind evaluation, use blind review.

Feedback (optional) What should be preserved? What should be changed? Other comments or suggested creative directions?

Research data: evaluations CSV / JSONL, revisions JSONL, versions JSONL, events JSONL.

You asked“I want to about aeroplanes”

Talkie was asked“Make a slide deck about aeroplanes.”

Talkie's reply was started withset-background(color=" (the worked example's first words, so that it writes a deck rather than an answer)

ModelFull model

Seed1930

Temperature0.35

Writing took7 min 6 s

Valid commands33 of 33

Ended itselfYes, with end-deck()

set-background(color="blue") Slide 1: the background is now #1f4fa8.
set-text(text="Aeroplanes fly above the sea.") Slide 1: text added.
next-slide() Slide 1 is finished. Now working on slide 2.
find-image(search-term="aeroplane rising from the ground", filename="An aeroplane rising from the ground.") Saved "An aeroplane rising from the ground.": Aeroplane contrail stitched from 9 images taken within a period of 18 seconds over an arc of sky of approx. 60°. Flight direction from right to left. The... (2021-12-10 12:13:10)
set-background(color="blue") Slide 2: the background is now #1f4fa8.
set-image(filename="An aeroplane rising from the ground") Slide 2: "An aeroplane rising from the ground" will be found when the slide is finished, to suit its words; it will be captioned "An aeroplane rising from the ground".
set-text(text="It mounts upwards into the air.") Slide 2: text added.
next-slide() Saved "An aeroplane rising from the ground": Aeroplane contrail stitched from 9 images taken within a period of 18 seconds over an arc of sky of approx. 60°. Flight direction from right to left. The... (2021-12-10 12:13:10) Slide 2 is finished. Now working on slide 3.
find-image(search-term="aeroplane in flight", filename="An aeroplane in flight.") Saved "An aeroplane in flight.": Curtiss Aeroplane flying at the Morris Park Aerodrome, Bronx, New York, 1909. From the cover of the July 1909 issue of Aeronautics magazine. (July 1909)
set-background(color="blue") Slide 3: the background is now #1f4fa8.
set-image(filename="An aeroplane in flight") Slide 3: "An aeroplane in flight" will be found when the slide is finished, to suit its words; it will be captioned "An aeroplane in flight".
set-text(text="It flies swiftly and steadily.") Slide 3: text added.
next-slide() Saved "An aeroplane in flight": Curtiss Aeroplane flying at the Morris Park Aerodrome, Bronx, New York, 1909. From the cover of the July 1909 issue of Aeronautics magazine. (July 1909) Slide 3 is finished. Now working on slide 4.
find-image(search-term="aeroplane alighting", filename="An aeroplane alighting") Saved "An aeroplane alighting": Scope and content: Date Taken: 8/29/1918 (1917 – 1918)
set-background(color="blue") Slide 4: the background is now #1f4fa8.
set-image(filename="An aeroplane alighting") Slide 4: showing "An aeroplane alighting", captioned "An aeroplane alighting".
set-text(text="It comes to rest upon the earth again.") Slide 4: text added.
next-slide() Slide 4 is finished. Now working on slide 5.
find-image(search-term="aeroplane sheds", filename="Aeroplane sheds.") Saved "Aeroplane sheds.": Scope and content: Photographer: Hall-Scott Motor Car Co. (1917 – 1918)
set-background(color="blue") Slide 5: the background is now #1f4fa8.
set-image(filename="Aeroplane sheds") Slide 5: "Aeroplane sheds" will be found when the slide is finished, to suit its words; it will be captioned "Aeroplane sheds".
set-text(text="There it is housed from storm and weather.") Slide 5: text added.
next-slide() Saved "Aeroplane sheds": The uncovered frame of British Army Aircraft I with Samuel Cody standing in front of it inside the airship shed. (1907) Slide 5 is finished. Now working on slide 6.
find-image(search-term="aeroplanes in use", filename="Aeroplanes in use.") Saved "Aeroplanes in use.": The Blue Aeroplanes 2019 Glastonbury Festival (2019-06-30 17:16:11)
set-background(color="blue") Slide 6: the background is now #1f4fa8.
set-image(filename="Aeroplanes in use") Slide 6: "Aeroplanes in use" will be found when the slide is finished, to suit its words; it will be captioned "Aeroplanes in use".
set-text(text="Men travel in them from place to place.") Slide 6: text added.
next-slide() Saved "Aeroplanes in use": The Blue Aeroplanes 2019 Glastonbury Festival (2019-06-30 17:16:11) Slide 6 is finished. Now working on slide 7.
find-image(search-term="aeroplanes for sport", filename="Aeroplanes for sport.") Saved "Aeroplanes for sport.": Single-engine light biplane In 1919, the H.& M. Farman Aeroplane Company of France produced the Farman Sport two-place sport and light commercial biplane. In... (1924)
set-background(color="blue") Slide 7: the background is now #1f4fa8.
set-image(filename="Aeroplanes for sport") Slide 7: "Aeroplanes for sport" will be found when the slide is finished, to suit its words; it will be captioned "Aeroplanes for sport".
set-text(text="Sportsmen fly in them for recreation.") Slide 7: text added.
end-deck() The deck is finished (7 slides in all).

Found by description on Wikimedia Commons and Openverse: public domain, CC0, CC BY and CC BY-SA only. Neither Talkie nor the deck runner sees them; each is captioned with the filename its author chose.

An aeroplane rising from the ground. Elongated contrail dissolving - 2021-12-10 (stitched image).jpg Wikimedia Commons · Franz van Duns · 2021-12-10 12:13:10 · CC BY-SA 4.0
An aeroplane rising from the ground Elongated contrail dissolving - 2021-12-10 (stitched image).jpg Wikimedia Commons · Franz van Duns · 2021-12-10 12:13:10 · CC BY-SA 4.0
An aeroplane in flight. Curtiss Aeroplane in Flight 1909.png Wikimedia Commons · H. M. Benner · July 1909 · Public domain
An aeroplane in flight Curtiss Aeroplane in Flight 1909.png Wikimedia Commons · H. M. Benner · July 1909 · Public domain
An aeroplane alighting Airplanes - Historical - Aeroplane alighting at Ft. Des Moines, IA., Aug. 29, 1918 - NARA - 17339110.jpg Wikimedia Commons · Unknown author Unknown author or not provided · 1917 – 1918 · Public domain
Aeroplane sheds. Airplanes - Engines - Hall-Scott Aeroplane Engines. Manufacturing Hall-Scott aeroplane engines at the Hall-Scott Motor Car Co. Plant, San Francisco, Cal. View of testing sheds - NARA - 17338428.jpg Wikimedia Commons · Unknown author Unknown author or not provided · 1917 – 1918 · Public domain
Aeroplane sheds British Army Aeroplane No 1 and Samuel Cody 1907 IWM RAE-O 858.jpg Wikimedia Commons · Royal Engineers official photographer · 1907 · Public domain
Aeroplanes in use. The Blue Aeroplanes 2019 Glastonbury Festival 06.jpg Wikimedia Commons · Edwardx · 2019-06-30 17:16:11 · CC BY-SA 4.0
Aeroplanes in use The Blue Aeroplanes 2019 Glastonbury Festival 06.jpg Wikimedia Commons · Edwardx · 2019-06-30 17:16:11 · CC BY-SA 4.0
Aeroplanes for sport. Farman Sport - DPLA - ffe8e4a09690903ecca4320b301bdbb6 (page 1).jpg Wikimedia Commons · Henri Farman, Maurice Farman · 1924 · CC0
Aeroplanes for sport Farman Sport - DPLA - ffe8e4a09690903ecca4320b301bdbb6 (page 1).jpg Wikimedia Commons · Henri Farman, Maurice Farman · 1924 · CC0

Everything Talkie was told, and its replies

# Transcript: 1 call to Talkie

## Call 1: pytorch, max_tokens 1600, temperature 0.35, seed 1930 (426.2 s)

**User**

````text
You are to make a slide deck by writing commands, one on each line. These are the commands:
find-image(search-term="WORDS", filename="NAME.jpg") finds a picture of WORDS and keeps it under the name NAME.jpg.
set-background(color="COLOUR") colours the whole slide, for example "navy", "ivory", "black" or "crimson".
set-image(filename="NAME.jpg") shows a picture you have already found.
set-text(text="WORDS") writes words at the bottom of the slide; set-text(text="") removes them.
next-slide() finishes the slide and begins a new, empty one.
end-deck() ends the deck; write it once, after the last slide.
All the text messages must be meaningful when strung together: read one after another, from the first slide to the last, they should make one connected account.
Write only commands.

Make a slide deck about the sea.
````

**Talkie**

````text
set-background(color="navy")
set-text(text="The sea covers the greater part of the world.")
next-slide()
find-image(search-term="ocean waves", filename="Ocean waves.jpg")
set-background(color="black")
set-image(filename="Ocean waves.jpg")
set-text(text="Its waves are raised by the wind,")
next-slide()
find-image(search-term="tide on the shore", filename="The tide.jpg")
set-background(color="black")
set-image(filename="The tide.jpg")
set-text(text="and twice each day its tide rises and falls upon the shore.")
next-slide()
find-image(search-term="sailing ship", filename="A sailing ship.jpg")
set-background(color="black")
set-image(filename="A sailing ship.jpg")
set-text(text="Upon its waters men have sailed ships since ancient times,")
next-slide()
find-image(search-term="lighthouse", filename="A lighthouse.jpg")
set-background(color="black")
set-image(filename="A lighthouse.jpg")
set-text(text="guided at night by lighthouses upon the rocks.")
next-slide()
find-image(search-term="fishing boats", filename="Fishing boats.jpg")
set-background(color="black")
set-image(filename="Fishing boats.jpg")
set-text(text="Fishermen draw from it a great harvest of fish,")
next-slide()
find-image(search-term="whale", filename="A whale.jpg")
set-background(color="black")
set-image(filename="A whale.jpg")
set-text(text="and in its depths swims the whale, the largest of all creatures.")
next-slide()
find-image(search-term="storm at sea", filename="A storm at sea.jpg")
set-background(color="navy")
set-image(filename="A storm at sea.jpg")
set-text(text="Yet for all our ships, the sea remains as wide and wild as ever.")
end-deck()
````

**User**

````text
Make a slide deck about aeroplanes.
````

**Talkie (given, continued below)**

````text
set-background(color="
````

**Talkie's reply**

````text
blue")
set-text(text="Aeroplanes fly above the sea.")
next-slide()
find-image(search-term="aeroplane rising from the ground", filename="An aeroplane rising from the ground.")
set-background(color="blue")
set-image(filename="An aeroplane rising from the ground")
set-text(text="It mounts upwards into the air.")
next-slide()
find-image(search-term="aeroplane in flight", filename="An aeroplane in flight.")
set-background(color="blue")
set-image(filename="An aeroplane in flight")
set-text(text="It flies swiftly and steadily.")
next-slide()
find-image(search-term="aeroplane alighting", filename="An aeroplane alighting")
set-background(color="blue")
set-image(filename="An aeroplane alighting")
set-text(text="It comes to rest upon the earth again.")
next-slide()
find-image(search-term="aeroplane sheds", filename="Aeroplane sheds.")
set-background(color="blue")
set-image(filename="Aeroplane sheds")
set-text(text="There it is housed from storm and weather.")
next-slide()
find-image(search-term="aeroplanes in use", filename="Aeroplanes in use.")
set-background(color="blue")
set-image(filename="Aeroplanes in use")
set-text(text="Men travel in them from place to place.")
next-slide()
find-image(search-term="aeroplanes for sport", filename="Aeroplanes for sport.")
set-background(color="blue")
set-image(filename="Aeroplanes for sport")
set-text(text="Sportsmen fly in them for recreation.")
end-deck()
````

Review this deck

Thank you: your evaluation is saved.

Generate a revision