Lighthouses

Evaluations made here are recorded as unblinded, since the deck is in view. For a blind evaluation, use blind review.

Feedback (optional) What should be preserved? What should be changed? Other comments or suggested creative directions?

Research data: evaluations CSV / JSONL, revisions JSONL, versions JSONL, events JSONL.

You asked“Teach me about lighthouses”

Talkie was asked“Make a slide deck about lighthouses.”

Talkie's reply was started withset-background(color=" (the worked example's first words, so that it writes a deck rather than an answer)

ModelFast model

Seed1930

Temperature0.35

Writing took0 min 43 s

Valid commands29 of 33

Ended itselfYes, with end-deck()

set-background(color="black") Slide 1: the background is now #000000.
set-text(text="Lighthouses stand upon dangerous coasts to warn mariners from the rocks.") Slide 1: text added.
Next-slide() That instruction could not be carried out: unknown command 'Next-slide'; the commands are find-image, set-background, set-image, set-text, next-slide, end-deck
find-image(search-term="the Eddystone", filename="The Eddystone Lighthouse.") Saved "The Eddystone Lighthouse.": Forms part of: Views of the British Isles, in the Photochrom print collection.; More information about the Photochrom Print Collection is available at... (between 1890 and 1900)
set-background(color="black") Slide 1: the background is now #000000.
set-image(filename="The Eddystone Lighthouse.") Slide 1: showing "The Eddystone Lighthouse.", captioned "The Eddystone Lighthouse".
set-text(text="It was first built in 1859, upon a reef off the coast of Cornwall.") Slide 1: text added.
next-slide() Slide 1 is finished. Now working on slide 2.
find-image(search-term="the Bell Rock", filename="The Bell Rock Lighthouse.") Saved "The Bell Rock Lighthouse.": Bell Rock Lighthouse. Detail of the interior. (1824)
set-background(color="black") Slide 2: the background is now #000000.
set-image(filename="The Bell Rock Lighthouse.") Slide 2: showing "The Bell Rock Lighthouse.", captioned "The Bell Rock Lighthouse".
set-text(text="It was begun in 1807, and finished in 1810.") Slide 2: text added.
Next-slide() That instruction could not be carried out: unknown command 'Next-slide'; the commands are find-image, set-background, set-image, set-text, next-slide, end-deck
find-image(search-term="the Skerries", filename="The Skerries Lighthouse.") Saved "The Skerries Lighthouse.": The Skerries Lighthouse (Ynys Y Moelrhoniaid) off NW Anglesey. I took this picture as the supplies boat pulled away from the quay at the Skerries on a... (2005-07-04)
set-background(color="black") Slide 2: the background is now #000000.
set-image(filename="The Skerries Lighthouse.") Slide 2: showing "The Skerries Lighthouse.", captioned "The Skerries Lighthouse".
set-text(text="It stands upon an outlying group of the Scottish mainland.") Slide 2: text added.
next-slide() Slide 2 is finished. Now working on slide 3.
find-image(search-term="the Bishop and Clerks", filename="The Bishop and Clerks Lighthouse.") Saved "The Bishop and Clerks Lighthouse.": Title: Old Aberdeen Light, Great Island, Cape Cod, Mass. Description: This light was erected in 1816 on Point Gammon. It was replaced in 1855 by the Bishops... (between circa 1930 and circa 1945)
set-background(color="black") Slide 3: the background is now #000000.
set-image(filename="The Bishop and Clerks Lighthouse.") Slide 3: showing "The Bishop and Clerks Lighthouse.", captioned "The Bishop and Clerks Lighthouse".
set-text(text="It was first built in 1840, and rebuilt in 1861.") Slide 3: text added.
Next-slide() That instruction could not be carried out: unknown command 'Next-slide'; the commands are find-image, set-background, set-image, set-text, next-slide, end-deck
find-image(search-term="the Tuskar", filename="The Tuskar Lighthouse.") Saved "The Tuskar Lighthouse.": Tuskar Lighthouse, Tuskar Rock (2016-09-16)
set-background(color="black") Slide 3: the background is now #000000.
set-image(filename="The Tuskar Lighthouse.") Slide 3: showing "The Tuskar Lighthouse.", captioned "The Tuskar Lighthouse".
set-text(text="It stands upon a dangerous rock in the Irish Sea.") Slide 3: text added.
next-slide() Slide 3 is finished. Now working on slide 4.
find-image(search-term="a floating light", filename="A floating light.) That instruction could not be carried out: not a command: 'find-image(search-term="a floating light", filename="A floating light.)'
set-background(color="black") Slide 4: the background is now #000000.
set-image(filename="A floating light.") Slide 4: "A floating light." will be found when the slide is finished, to suit its words; it will be captioned "A floating light".
set-text(text="It rides at anchor off the coast, and marks a dangerous spot.") Slide 4: text added.
end-deck() The deck is finished (4 slides in all).

Found by description on Wikimedia Commons and Openverse: public domain, CC0, CC BY and CC BY-SA only. Neither Talkie nor the deck runner sees them; each is captioned with the filename its author chose.

The Eddystone Lighthouse. Eddystone Lighthouse, Plymouth, England-LCCN2002708052.jpg Wikimedia Commons · Photochrom Print Collection · between 1890 and 1900 · Public domain
The Bell Rock Lighthouse. Bell Rock Lighthouse. Last room.png Wikimedia Commons · Robert Stevenson. 1772-1850 · 1824 · Public domain
The Skerries Lighthouse. The Skerries Lighthouse (Ynys Y Moelrhoniaid) off NW Anglesey. - geograph.org.uk - 96494.jpg Wikimedia Commons · Stephen Elwyn RODDICK · 2005-07-04 · CC BY-SA 2.0
The Bishop and Clerks Lighthouse. Old Aberdeen Light, Great Island, Cape Cod, Mass (76249).jpg Wikimedia Commons · (Photo by Hicks) Pub. by H. L. Moore Co., West Yarmouth, Mass. Tichnor Bros. Inc., Boston, Mass. · between circa 1930 and circa 1945 · Public domain
The Tuskar Lighthouse. Tuskar Lighthouse, Tuskar Rock - geograph.org.uk - 5154758.jpg Wikimedia Commons · David P Howard · 2016-09-16 · CC BY-SA 2.0
A floating light. The 'Griffith' Steamer, passing the lighthouse at Buffalo Harbour Point ILN-1850-0727-0016.jpg Wikimedia Commons · Unidentified engraver · 2 January 1845 · Public domain

Everything Talkie was told, and its replies

# Transcript: 1 call to Talkie

## Call 1: llama-server, max_tokens 1600, temperature 0.35, seed 1930 (42.6 s)

**User**

````text
You are to make a slide deck by writing commands, one on each line. These are the commands:
find-image(search-term="WORDS", filename="NAME.jpg") finds a picture of WORDS and keeps it under the name NAME.jpg.
set-background(color="COLOUR") colours the whole slide, for example "navy", "ivory", "black" or "crimson".
set-image(filename="NAME.jpg") shows a picture you have already found.
set-text(text="WORDS") writes words at the bottom of the slide; set-text(text="") removes them.
next-slide() finishes the slide and begins a new, empty one.
end-deck() ends the deck; write it once, after the last slide.
All the text messages must be meaningful when strung together: read one after another, from the first slide to the last, they should make one connected account.
Write only commands.

Make a slide deck about the sea.
````

**Talkie**

````text
set-background(color="navy")
set-text(text="The sea covers the greater part of the world.")
next-slide()
find-image(search-term="ocean waves", filename="Ocean waves.jpg")
set-background(color="black")
set-image(filename="Ocean waves.jpg")
set-text(text="Its waves are raised by the wind,")
next-slide()
find-image(search-term="tide on the shore", filename="The tide.jpg")
set-background(color="black")
set-image(filename="The tide.jpg")
set-text(text="and twice each day its tide rises and falls upon the shore.")
next-slide()
find-image(search-term="sailing ship", filename="A sailing ship.jpg")
set-background(color="black")
set-image(filename="A sailing ship.jpg")
set-text(text="Upon its waters men have sailed ships since ancient times,")
next-slide()
find-image(search-term="lighthouse", filename="A lighthouse.jpg")
set-background(color="black")
set-image(filename="A lighthouse.jpg")
set-text(text="guided at night by lighthouses upon the rocks.")
next-slide()
find-image(search-term="fishing boats", filename="Fishing boats.jpg")
set-background(color="black")
set-image(filename="Fishing boats.jpg")
set-text(text="Fishermen draw from it a great harvest of fish,")
next-slide()
find-image(search-term="whale", filename="A whale.jpg")
set-background(color="black")
set-image(filename="A whale.jpg")
set-text(text="and in its depths swims the whale, the largest of all creatures.")
next-slide()
find-image(search-term="storm at sea", filename="A storm at sea.jpg")
set-background(color="navy")
set-image(filename="A storm at sea.jpg")
set-text(text="Yet for all our ships, the sea remains as wide and wild as ever.")
end-deck()
````

**User**

````text
Make a slide deck about lighthouses.
````

**Talkie (given, continued below)**

````text
set-background(color="
````

**Grammar the reply had to follow**

````text
root ::= ([^\n]* "\n")* "end-deck()"
````

**Talkie's reply**

````text
black")
set-text(text="Lighthouses stand upon dangerous coasts to warn mariners from the rocks.")

Next-slide()
find-image(search-term="the Eddystone", filename="The Eddystone Lighthouse.")
set-background(color="black")
set-image(filename="The Eddystone Lighthouse.")
set-text(text="It was first built in 1859, upon a reef off the coast of Cornwall.")
next-slide()
find-image(search-term="the Bell Rock", filename="The Bell Rock Lighthouse.")
set-background(color="black")
set-image(filename="The Bell Rock Lighthouse.")
set-text(text="It was begun in 1807, and finished in 1810.")

Next-slide()
find-image(search-term="the Skerries", filename="The Skerries Lighthouse.")
set-background(color="black")
set-image(filename="The Skerries Lighthouse.")
set-text(text="It stands upon an outlying group of the Scottish mainland.")
next-slide()
find-image(search-term="the Bishop and Clerks", filename="The Bishop and Clerks Lighthouse.")
set-background(color="black")
set-image(filename="The Bishop and Clerks Lighthouse.")
set-text(text="It was first built in 1840, and rebuilt in 1861.")

Next-slide()
find-image(search-term="the Tuskar", filename="The Tuskar Lighthouse.")
set-background(color="black")
set-image(filename="The Tuskar Lighthouse.")
set-text(text="It stands upon a dangerous rock in the Irish Sea.")
next-slide()
find-image(search-term="a floating light", filename="A floating light.)
set-background(color="black")
set-image(filename="A floating light.")

set-text(text="It rides at anchor off the coast, and marks a dangerous spot.")
end-deck()
````

Review this deck

Thank you: your evaluation is saved.

Generate a revision