CARD · Card record
Astra pelicans: what to test beyond one example
Simon compares reasoning levels across Astra and three GPT-5.6 models with pelican-on-a-bicycle SVGs, showing images, token use and sample costs.
01
THE STORY · The original
Read the explanation and its limits.
A visual example can inform model choice; your own tasks still need testing.
- Originalcreator self-reporthttps://simonwillison.net/2026/Sep/4/astra-pelicans/
Why it is worth understanding
Try this comparison method on several real tasks: fix acceptance criteria, record quality, time and cost, then decide whether higher reasoning effort helps.
Conditions and limitations
This creator self-report is not proof of general ability. The post and grid give different Sol rates, so sample costs are not a current price quote. We have not reproduced the comparison.
Important additions and corrections
Dates below mark changes to our coverage.
- Addition ·
Clarified the sample and cost limits: one SVG comparison cannot establish general ability, and differing rates in the post and grid make the sample costs unsuitable as current quotes.
Reading progress is saved in this browser. Save or add a note →
02
THE THREAD · Full timeline
1 event, every row traceable.
A card accumulates records as its story develops: new corroborators, market contrasts, material changes at the original — each dated and linked to its archive day.
- Added to BitShovelEntered the BitShovel radar: first-party on Simon Willison's weblog (15 entries visible at collection).
03
SOURCES · Sources and evidence
Check each link's purpose and limits.
Sources and evidence · 3 links
Each link has a purpose and scope. Link counts do not establish independent confirmation; direct support applies only to the statements specified below.
- Simon Willison’s examples and observationsDirect support
The author’s prompt, observations and interpretation.
Limits: One example and personal judgment.
Evidence for this assessment
https://simonwillison.net/2026/Sep/4/astra-pelicans/Retained evidence and full review record (JSON) - Simon Willison's weblog feedScope not documented
A per-link statement of support has not been attached.
- Original SVG examples and cost tableDirect support
Comparison of images, usage and sample costs.
Limits: Rates differ from the post; no bill or current pricing check.
04
EDITORIAL REVIEW
Review of this card's wording and evidence.
Editorial review · Evidence reviewed
· Beijing time (UTC+8)
Read source materials to clarify purpose and limits. Discovery and event dates are retained; editorial review is not an independent experiment.
This dates our review of the card's wording and evidence, not a project release or product update.