LLMCompare
中文

Pricing

LLMCompare calls the models with its own accounts and charges credits for what each call used. You see an estimate before every run, and you are charged for actual usage.

One credit pays for $0.001 of usage: the provider's price plus a 20% service fee.On the Starter plan, $10 buys 10,000 credits.

Plans

Every plan can use every model. The plans differ in how many credits they include and how large an evaluation can be.

  • Free

    $0forever

    • 50 free credits a day, up to 500 a month
    • Text and image evaluations
    • Up to 20 test cases per evaluation
    • Share reports by link or publish them

  • Starter

    $10one-time

    • 10,000 credits, never expire
    • Up to 200 test cases per evaluation
    • Up to 1,000 calls per run
    • Model judge and rule checks

  • Growth

    Recommended

    $29per month

    • 32,000 credits every month
    • Up to 500 test cases per evaluation
    • Up to 3,000 calls per run
    • Export results as CSV

  • Expert

    $99per month

    • 120,000 credits every month
    • Unlimited test cases per evaluation
    • Up to 10,000 calls per run
    • Export results as CSV

Paid plans are coming soon. For now, claim free credits every day to run evaluations.

Plan limits

Contestants per evaluation and runs per cell are the same on every plan.
PlanFreeStarterGrowthExpert
Price$0forever$10one-time$29per month$99per month
Credits50 a day, up to 500 a month10,000, paid once32,000 a month120,000 a month
Price per 1,000 creditsNot applicable$1.00$0.91$0.83
Test cases per evaluation20200500No limit
Calls per run1001,0003,00010,000
Contestants per evaluationUp to 12Up to 12Up to 12Up to 12
Runs per cellUp to 5Up to 5Up to 5Up to 5

What an evaluation costs

These examples are calculated from the prices in the model catalogue. The token counts are assumptions. A real run is charged for the usage that the provider reports, so its cost depends on how long your inputs and outputs are.

Two text models on 50 test cases

100 calls: 50 test cases × 2 models, 1 run per cell. Each call is assumed to use 500 input tokens and 300 output tokens. The two models are the lowest-priced and the highest-priced text model in the catalogue.

In total: 100 calls, $0.24 in model cost, 350 credits.

Prices checked on 30 September 2026. 10,000 credits on the Starter plan pay for this run 28 times.
ModelInput / output priceper million tokensCallsCost per callCredits per callModel costCredits
GPT-6 LunaOpenAI$0.10 / $0.5050$0.00021$0.0150
GPT-5.6 TerraOpenAI$2.00 / $12.0050$0.00466$0.23300
Total100$0.24350

Three text models on 200 test cases, scored by a model judge

600 model calls and 600 judge calls. Each model call is assumed to use 500 input tokens and 300 output tokens. Each judge call is assumed to read 1,200 input tokens (the test case, the output and your criteria) and write 100 output tokens. The three models are the most recently released text model of three providers. The judge is the lowest-priced text model in the catalogue.

In total: 1,200 calls, $1.242 in model cost, 2,200 credits.

Prices checked on 30 September 2026. 10,000 credits on the Starter plan pay for this run 4 times.
ModelInput / output priceper million tokensCallsCost per callCredits per callModel costCredits
GPT-6 LunaOpenAI$0.10 / $0.50200$0.000201$0.040200
Gemini 3.7 FlashGoogle$0.75 / $3.75200$0.001502$0.300400
Claude Sonnet 5Anthropic$2.00 / $10.00200$0.004005$0.8001,000
GPT-6 LunaOpenAIModel judge$0.10 / $0.50600$0.000171$0.102600
Models600$1.1401,600
Model judge600$0.102600
Total1,200$1.2422,200

Two image models on 20 prompts

40 calls: 20 prompts × 2 models, one image per call. Both models are priced per image.

In total: 40 calls, $1.60 in model cost, 1,920 credits.

Prices checked on 30 September 2026. 10,000 credits on the Starter plan pay for this run 5 times.
ModelPrice per imageCallsCost per callCredits per callModel costCredits
Seedream 5.0 LiteByteDance Seed$0.03520$0.03542$0.70840
Seedream 5.0 ProByteDance Seed$0.04520$0.04554$0.901,080
Total40$1.601,920

Credits for one call = model cost × 1.2 ÷ $0.001, rounded up to a whole credit. A call that the provider charged for costs at least 1 credit.

1.2 is the model cost plus the 20% service fee. Credits are rounded up for each call, so many small calls cost more credits than one call with the same total cost.

See all models and prices

How charging works

  1. You confirm an estimate before every run

    LLMCompare shows the number of calls and an estimated range of credits. Nothing runs until you confirm.

  2. Credits are held, then settled to actual usage

    When a run starts, the upper end of the estimate is held. When it ends, you are charged for the usage the providers reported and the difference is returned.

  3. Calls that did not complete are not charged

    A call stopped by a provider's rate limit, by a fault on our side or because you canceled the run costs no credits. You can retry these calls.

  4. Model failures are charged only if the provider charged

    A timeout, a refusal or an empty output is recorded as that model's result. It costs credits only when the provider charged for the call.

  5. The model judge is listed separately

    A judge is also a model call and costs credits. The estimate shows its credits on a separate line.

  6. Cost in reports is not the same number as credits

    The cost shown in results and reports is the provider's price in US dollars. It is there to help you choose a model. Credits are what you pay LLMCompare.

Free credits every day

Every account can claim 50 free credits once a day, up to 500 a month. Free credits expire at the end of the day on which you claim them.

Credits are spent in this order: free credits claimed today, then monthly credits, then purchased credits.

Questions about pricing and credits

What is a credit?
A credit is the unit that LLMCompare charges in. One credit pays for $0.001 of usage, which is the provider's price plus a 20% service fee. Credits are whole numbers.
How many credits does a run cost?
It depends on the models, on the number of calls and on how long the inputs and outputs are. The number of calls is test cases × contestants × runs per cell. Before every run LLMCompare shows an estimated range of credits, and the run starts only after you confirm it.
Why is the estimate a range?
The length of an output is not known before the model writes it. LLMCompare holds the upper end of the range when the run starts, charges for actual usage when the run ends, and returns the difference.
Am I charged for calls that fail?
Calls that were not completed cost no credits. That covers provider rate limits, faults on our side and runs that you canceled. A model failure, such as a timeout, a refusal or an empty output, costs credits only when the provider charged for that call.
Does the model judge cost credits?
Yes. A judge is a model call. Its credits are listed separately in the estimate, and its cost is listed separately in your credit history.
Why is the cost in a report different from the credits I spent?
The cost in results and reports is the provider's published price in US dollars. It is there to help you choose a model. Credits are what you pay LLMCompare: the same cost plus the service fee, rounded up for each call.
Do credits expire?
Free daily credits expire at the end of the day on which you claim them. Monthly credits come with a subscription and are reset at each billing date. Purchased credits do not expire while your account is in good standing.
Can I use my own API keys?
No. LLMCompare calls the models with its own accounts and charges credits for the usage.
What happens when I change my subscription plan?
The plan changes immediately and the billing date stays the same. When you move to a higher plan, you pay the price difference for the rest of the billing period, and your monthly credits increase by the difference between the two plans. The amount is shown before you confirm. When you move to a lower plan, nothing is charged at that moment, and you keep the monthly credits you have until the next billing date.
How do I cancel a subscription?
Cancel it from the Billing tab of your account. Cancelling takes effect at the end of the billing period that you have paid for. After that date the account moves to the Free plan, and purchased credits stay on the account.

The full terms for credits, payments and refunds are in the Terms of Service.