Image
Three image briefs, each with exact text that must appear in the picture, sent to three image models. A model judge checked every image for the exact words and for the scene. No human review on this run.
Copies the contestants, the rules and the shared prompt into a new evaluation. You add your own test cases; nothing from this report's test set is copied.
Everything needed to run this comparison again.
| Contestant | Model ID | Route | Settings | Price |
|---|---|---|---|---|
Contestant A: GPT Image 2.5 SunburstOpenAI | openai/gpt-image-2.5-sunburst | OpenAI (direct) | Provider defaults | $8.00 in / $8.00 out per 1M tokens · $30.00 per 1M image tokenschecked 30 Sep 2026 (UTC) |
Contestant B: Nano Banana 2 (Gemini 3.1 Flash Image)Google | google/gemini-3.1-flash-image | Google AI Studio (direct) | Provider defaults | $0.50 in / $3.00 out per 1M tokens · $60.00 per 1M image tokenschecked 30 Sep 2026 (UTC) |
Contestant C: Seedream 5.0 ProByteDance Seed | bytedance-seed/seedream-5-0-pro | BytePlus ModelArk (direct) | Provider defaults | $0.045 per imagechecked 30 Sep 2026 (UTC) |
What counts as a good result for this task, in the evaluator's own words. The model judge judged strictly by it; human reviewers saw it for reference.
The user's own words · version 1
Sample size, review coverage and anything that limits the comparison.
Each measure is reported on its own. Cost is the provider's price in US dollars, not credits.
| Contestant | Model judgepassed / judged | Cost per callprovider price | Response timeaverage | Model failures | Not completed |
|---|---|---|---|---|---|
Contestant A: GPT Image 2.5 SunburstOpenAI | 3/ 3 (best in this column)100% | $0.0128 (best in this column)$0.0384 in total | 17.0 s | 0 | 0 |
Contestant B: Nano Banana 2 (Gemini 3.1 Flash Image)Google | 2/ 367% | $0.0672$0.2017 in total | 8.9 s (best in this column) | 0 | 0 |
Contestant C: Seedream 5.0 ProByteDance Seed | 2/ 367% | $0.045$0.135 in total | 1 m 9 s | 0 | 0 |
Vertical axis: Passed by the model judge.
| Contestant | Passed by the model judge | Cost per call | Average response time | On the frontier |
|---|---|---|---|---|
| A · GPT Image 2.5 Sunburst | 100% | $0.0128 | 17.0 s | Yes |
| B · Nano Banana 2 (Gemini 3.1 Flash Image) | 67% | $0.0672 | 8.9 s | No |
| C · Seedream 5.0 Pro | 67% | $0.045 | 1 m 9 s | No |
Generated from this run's numbers only. They state differences; they do not recommend a model.
Chosen by the person who ran the evaluation. Every output is shown as the model returned it.
Poster for a jazz night. Headline: "Blue Hour Jazz". Line below it: "Friday 8 PM · Free Entry". Warm dusk colours, a saxophone silhouette.
Chalkboard menu outside a small coffee shop, listing exactly three items: "Flat White $4.50", "Oat Latte $5.00", "Cold Brew $4.00". Hand-drawn chalk lettering.
Phone splash screen for a meditation app called "Stillwater", with the tagline "Breathe in. Slow down." Calm lake at dawn, lots of empty space.
Open a test case to see its input and every output.
Poster for a jazz night. Headline: "Blue Hour Jazz". Line below it: "Friday 8 PM · Free Entry". Warm dusk colours, a saxophone silhouette.
Chalkboard menu outside a small coffee shop, listing exactly three items: "Flat White $4.50", "Oat Latte $5.00", "Cold Brew $4.00". Hand-drawn chalk lettering.
Phone splash screen for a meditation app called "Stillwater", with the tagline "Breathe in. Slow down." Calm lake at dawn, lots of empty space.
The prompt every contestant received with each test case.
Start an evaluation with these contestants and rules, then add test cases from your own work.
Measured with LLMCompare. Every number on this page comes from one run on 19 Oct 2026 (UTC).