Ok, tried running in vllm, and also with transformers using the code provided in the model card. I'll preface these results by saying that new models often have issues to work out.

vllm sample outputs:

(response to the first planning prompt in the longform creative writing benchmark)

# Brainstorming **«🩸🩸🩸」** **«Darkly Comic British YA Fiction»** **«Short Story»** **«8 Chapters» **«Approx.**\n**[100]** **[100]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** 
(etc)



(response to the first planning prompt in the longform creative writing benchmark)
# Brainstorming fokusiert auf Charaktere, Handlungssysteme und allgemeine Struktur.\n\n## Charaktere Ideen:\n### Götter:\n1 **«Zeus»** trägt weiße Nike Air Jordans, repräsentiert Macht und Kontrolle. Seine Fähigkeiten sind Blitzschlag und Wetterkontrolle.\n **«Hera」** trägt schwarze Adidas Ultraboost für Geschwindigkeit und Stil. Göttin der Ehe und Familie.\n **«Ares»** trägt rote Under Armour Speedforms für Kriegslust und Energie.\n **«Athena»**

(note: the prompt was in English, so this it responding in German is unexpected)

transformers sample output:

You: Write a long story about a princess. Make it 1000 words.
Bot: Once upon a time in the kingdom of Eldoria, there lived Princess Amelia. Born to King Reginald III and Queen Isabella, Amelia was the youngest of three children. Her elder siblings were Prince Edward and Princess Margaret. Unlike her siblings, Amelia was not born with the typical royal traits. She was not interested in courtly affairs, nor did she possess the grace and poise expected of a princess. Instead, Amelia was a curious and adventurous spirit, always eager to explore the vast forests and mountains surrounding Eldoria.

(it only returns 1 paragraph)

Ok, tried running in vllm, and also with transformers using the code provided in the model card. I'll preface these results by saying that new models often have issues to work out.

vllm sample outputs:

(response to the first planning prompt in the longform creative writing benchmark)

# Brainstorming **«🩸🩸🩸」** **«Darkly Comic British YA Fiction»** **«Short Story»** **«8 Chapters» **«Approx.**\n**[100]** **[100]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** **[1]** 
(etc)

(response to the first planning prompt in the longform creative writing benchmark)

# Brainstorming fokusiert auf Charaktere, Handlungssysteme und allgemeine Struktur.\n\n## Charaktere Ideen:\n### Götter:\n1 **«Zeus»** trägt weiße Nike Air Jordans, repräsentiert Macht und Kontrolle. Seine Fähigkeiten sind Blitzschlag und Wetterkontrolle.\n **«Hera」** trägt schwarze Adidas Ultraboost für Geschwindigkeit und Stil. Göttin der Ehe und Familie.\n **«Ares»** trägt rote Under Armour Speedforms für Kriegslust und Energie.\n **«Athena»**

(note: the prompt was in English, so this it responding in German is unexpected)

transformers sample output:

You: Write a long story about a princess. Make it 1000 words.
Bot: Once upon a time in the kingdom of Eldoria, there lived Princess Amelia. Born to King Reginald III and Queen Isabella, Amelia was the youngest of three children. Her elder siblings were Prince Edward and Princess Margaret. Unlike her siblings, Amelia was not born with the typical royal traits. She was not interested in courtly affairs, nor did she possess the grace and poise expected of a princess. Instead, Amelia was a curious and adventurous spirit, always eager to explore the vast forests and mountains surrounding Eldoria.

(it only returns 1 paragraph)