# Pelicans on a bicycle

For more on this benchmark check out my talk [The last six months in LLMs, illustrated by pelicans on bicycles](https://simonwillison.net/2025/Jun/6/six-months-in-llms/) or review the [pelican-riding-a-bicycle tag](https://simonwillison.net/tags/pelican-riding-a-bicycle/) on my blog.

Prompt:

> `Generate an SVG of a pelican riding a bicycle`

## Cerebras Llama models

### Cerebras Llama 3.1 70B
<img src="cerebras-llama3.1-70b.svg" width="600" alt="Cerebras Llama 3.1 70B">

### Cerebras Llama 3.1 8B
<img src="cerebras-llama3.1-8b.svg" width="600" alt="Cerebras Llama 3.1 8B">

## Claude models

### Claude 3.5 Sonnet (2024-06-20)
<img src="claude-3-5-sonnet-20240620.svg" width="600" alt="Claude 3.5 Sonnet (2024-06-20)">

### Claude 3.5 Sonnet (2024-10-22)
<img src="claude-3-5-sonnet-20241022.svg" width="600" alt="Claude 3.5 Sonnet (2024-10-22)">

### Claude 3 Haiku
<img src="claude-3-haiku-20240307.svg" width="600" alt="Claude 3 Haiku">

### Claude 3 Opus
<img src="claude-3-opus-20240229.svg" width="600" alt="Claude 3 Opus">

## Gemini models

### Gemini 1.5 Flash 001
<img src="gemini-1.5-flash-001.svg" width="600" alt="Gemini 1.5 Flash 001">

### Gemini 1.5 Flash 002
<img src="gemini-1.5-flash-002.svg" width="600" alt="Gemini 1.5 Flash 002">

### Gemini 1.5 Flash 8B 001
<img src="gemini-1.5-flash-8b-001.svg" width="600" alt="Gemini 1.5 Flash 8B 001">

### Gemini 1.5 Pro 001
<img src="gemini-1.5-pro-001.svg" width="600" alt="Gemini 1.5 Pro 001">

### Gemini 1.5 Pro 002
<img src="gemini-1.5-pro-002.svg" width="600" alt="Gemini 1.5 Pro 002">

### gemini-exp-1114
<img src="gemini-exp-1114.svg" width="600" alt="gemini-exp-1114">

### gemini-exp-1121
<img src="gemini-exp-1121.svg" width="600" alt="gemini-exp-1121">

### gemini-exp-1206
<img src="gemini-exp-1206.svg" width="600" alt="gemini-exp-1206">

## OpenAI models

### GPT-3.5 Turbo
<img src="gpt-3.5-turbo.svg" width="600" alt="GPT-3.5 Turbo">

### GPT-4o mini
<img src="gpt-4o-mini.svg" width="600" alt="GPT-4O Mini">

### GPT-4o
<img src="gpt-4o.svg" width="600" alt="GPT-4O">

### o1-mini
<img src="o1-mini.svg" width="600" alt="O1 Mini">

### o1-preview
<img src="o1-preview.svg" width="600" alt="O1 Preview">

## AWS models

### Amazon Nova Micro
<img src="us.amazon.nova-micro-v1-0.svg" width="600" alt="Amazon Nova Micro">

### Amazon Nova Lite
<img src="us.amazon.nova-lite-v1-0.svg" width="600" alt="Amazon Nova Lite">

### Amazon Nova Pro
<img src="us.amazon.nova-pro-v1-0.svg" width="600" alt="Amazon Nova Pro">