Model performance on MindsHub

See how models served through MindsHub Inference perform: response times, availability and cost, with current prices, API aliases and fallback routes.

Measurements refresh every 2 to 6 hours · About the data

All makers
Makers
Reasoning effort

Leaderboard

Compare typical results. Expand a model for more details and data at every effort level.

30 days7 days24 hours

Showing 1 of 48 models

What the columns mean
Model

Expand a model for more details and data for every reasoning effort level.

About model aliases

Intelligence

MindsHub’s read is a subjective estimate from 1 to 10 based on public benchmarks and rankings, not a precise measurement. Performance depends on your workload; test models on your own tasks.

For detailed benchmarks, refer to third party services such as Artificial Analysis, Epoch AI or similar.

About the intelligence estimate

Ping · p50

Time to the first answer token for a one-word reply at the lowest reasoning effort. This checks basic responsiveness.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Ping methodology and sample prompt

Simple task · p50

Time to the first answer token at the default reasoning effort. The model interprets a short briefing and reasons about how to describe it in at least 150 words, using only the supplied facts.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Simple task methodology and sample prompt

Complex task · p50

Time to the first answer token at the selected reasoning effort. The model analyzes a longer briefing and plans an 800+ word guide that covers its facts in order and follows content and formatting rules.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Complex task methodology and sample prompt

Writing speed

How fast the model writes after its answer starts, in tokens per second. Measured on the 800+ word task. Higher is faster; thinking time is excluded.

How writing speed is measured

Context limit

How much input the model can take in one request, measured in tokens. Tokens are pieces of text.

About tokens, context and prices

Cost per task

Cost of the same writing task relative to the most expensive measured model and effort level (100%). 50% costs half as much. The collapsed range covers measured effort levels; expand for each level. Lower is cheaper.

100% = Claude Opus 5.5 at max, the highest measured cost for this writing task.

How cost per task is compared

Token price

US dollars per million tokens: input / output. Input is what you send; output is what the model generates. See Prices for other rates.

About token prices and the free tier

Availability

Below 100% does not necessarily mean customer requests failed: a configured fallback route can still answer. Share of automated checks answered by the model you chose, including retries. Other checks were answered by a fallback or got no answer. Failures attributed to our monitoring network are excluded. Higher is better.

How availability and fallbacks work

First answer token is the wait before the answer starts, including thinking. P50 is the typical result. Cost per task spans the measured effort levels.

Every model MindsHub serves: intelligence (our estimate, from 1 to 10), time to first word at three tasks, writing speed, context limit, relative cost per task, token price and availability before fallback. Sorted by intelligence.

Model

Expand a model for more details and data for every reasoning effort level.

About model aliases

Intelligence

MindsHub’s read is a subjective estimate from 1 to 10 based on public benchmarks and rankings, not a precise measurement. Performance depends on your workload; test models on your own tasks.

For detailed benchmarks, refer to third party services such as Artificial Analysis, Epoch AI or similar.

About the intelligence estimate

Ping · p50

Time to the first answer token for a one-word reply at the lowest reasoning effort. This checks basic responsiveness.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Ping methodology and sample prompt

Simple task · p50

Time to the first answer token at the default reasoning effort. The model interprets a short briefing and reasons about how to describe it in at least 150 words, using only the supplied facts.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Simple task methodology and sample prompt

Complex task · p50

Time to the first answer token at the selected reasoning effort. The model analyzes a longer briefing and plans an 800+ word guide that covers its facts in order and follows content and formatting rules.

Includes thinking before the answer starts, not the time to finish it. Lower is faster. P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements.

Complex task methodology and sample prompt

Writing speed

How fast the model writes after its answer starts, in tokens per second. Measured on the 800+ word task. Higher is faster; thinking time is excluded.

How writing speed is measured

Context limit

How much input the model can take in one request, measured in tokens. Tokens are pieces of text.

About tokens, context and prices

Cost per task

Cost of the same writing task relative to the most expensive measured model and effort level (100%). 50% costs half as much. The collapsed range covers measured effort levels; expand for each level. Lower is cheaper.

100% = Claude Opus 5.5 at max, the highest measured cost for this writing task.

How cost per task is compared

Token price

US dollars per million tokens: input / output. Input is what you send; output is what the model generates. See Prices for other rates.

About token prices and the free tier

Availability

Below 100% does not necessarily mean customer requests failed: a configured fallback route can still answer. Share of automated checks answered by the model you chose, including retries. Other checks were answered by a fallback or got no answer. Failures attributed to our monitoring network are excluded. Higher is better.

How availability and fallbacks work

Closed
OpenAI
2 4 1.28 s 1.10 s 1.10 s 69.5 s 217 257 400K <1%–10% $0.75 / $4.50 99.99% 100.00% 100.00%
GPT 5.4 Mini, effortnone default 2 1.28 s 1.10 s 1.10 s 217 0.8%
GPT 5.4 Mini, effortlow 3 1.36 s 215 0.8%
GPT 5.4 Mini, effortmedium 3.5 2.34 s 214 0.9%
GPT 5.4 Mini, efforthigh 4 7.11 s 211 1.4%
GPT 5.4 Mini, effortxhigh 4 69.5 s 257 10.0%
Response times
Typical time to the first answer token (p50), including thinking.
Fixed alias
gpt-mini-5-4
Rotating
gpt-mini
Also accepts
gpt-mini-5.4
Fallbacks
1st fallback: Gemini Flash2nd fallback: Claude Haiku
Inputs
Text, images
Measured
Ping: every 10 minutes, from multiple regionsSimple task: every 6 hoursComplex task: 200 test runs, Oct 22–Nov 20
Licence
Closed.

Cost per task: 100% = Claude Opus 5.5 at max, the highest measured cost for this writing task.

About the data

What does this page show?

Performance and reliability measured through MindsHub Inference, alongside current token prices, API aliases and fallback routes. The figures describe the models as served through MindsHub. They are not a ranking of every provider’s deployment of those models.

Where do the measurements come from?

We run automated API checks and writing tasks through MindsHub Inference. Complex task, writing speed and cost per task figures refresh every two hours, and the other measurements every six hours. Complex task performance and cost cover up to 35 days of tests. Each chart shows its measurement dates. If an update fails, we keep previously saved measurements with their original dates. Prices, aliases and fallback routes come from the same live catalog as our pricing page. A dash means no usable measurement is available.

How is Ping measured?

Every 10 minutes, checks from multiple regions ask for a one-word reply at the lowest reasoning effort. We time the first answer token, including any thinking before it. Ping measures basic responsiveness and tracks availability.

Sample prompt

Reply with the single word: ok
How is the Simple task measured?

Every six hours, the model receives a short briefing about a fictional market hall and is asked to describe a Saturday morning in at least 150 words. It must interpret the facts, decide how to present them and follow the writing constraints. We time the first answer token at the default reasoning effort, including thinking time.

Sample prompt, abridged; briefing omitted

Using only the supplied market-hall briefing, describe a typical Saturday morning in at least 150 words. Use plain paragraphs, with no headings or lists, and do not add facts.
How is the Complex task measured?

The model receives a longer briefing about the same fictional market hall and must turn it into a complete visitor’s guide of at least 800 words. It must analyze and organize the supplied facts, cover them in order and obey content and formatting constraints. We measure the first answer token, total response time and writing speed at each tested effort level. The first-answer and total times include thinking; writing speed starts when the answer begins. Repeated tests run over several weeks; each model’s details show the test count and interval. These are speed tests, not scores for reasoning quality.

Sample prompt, abridged; briefing omitted

Using only the supplied briefing, write a visitor’s guide of at least 800 words. Cover every part in the given order, in plain paragraphs with no headings, lists or tables. Do not add facts.
What are p50, p05 and p95?

P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements. The leaderboard shows p50. Open Performance to explore the spread; Ping and Simple task have p50 and p95 only.

Does availability below 100% mean requests failed?

Not necessarily. A configured fallback route can still answer when the model you chose does not. Availability before fallback is the share of our automated checks answered by that model, including retries, over the selected period. Other checks were answered by a fallback or got no answer. These checks do not measure how often customer requests fail. Failures attributed to our monitoring network are excluded.

What does the intelligence score mean?

MindsHub’s read is a subjective estimate from 1 to 10 based on public benchmarks and rankings, not a precise measurement. Performance depends on your workload; test models on your own tasks.

For detailed benchmarks, refer to third party services such as Artificial Analysis, Epoch AI or similar.

How is cost per task compared?

The most expensive measured model and effort level is the 100% reference, updated automatically as results change. The leaderboard range covers a model’s measured effort levels; expand it for individual values. In Cost per task, choose another reference to compare against. Dollar estimates use mean input and output tokens at current standard rates, excluding cache discounts. Your bill depends on your requests.

What changes with reasoning effort?

Intelligence, Complex task timings and writing speed follow the selected effort. Ping always uses the lowest effort and Simple task the default. The cost range covers all measured levels. Views showing all effort levels disable the selector because every level is already visible.

What are fixed and rotating aliases?

An alias is the name sent in the API’s model field. Fixed aliases select a specific model version. Rotating aliases follow a model family as it updates. MindsHub Air and MindsHub Blaze are managed rotating aliases: MindsHub can change the model behind each name. The Aliases tab explains their purpose and lists the names you can use.

How do token prices, context limits and the free tier work?

Tokens are the units a model reads and writes: pieces of text, or of an image for image models. The context limit is how much input a model accepts in one request. Token prices are US dollars per million tokens, from the same catalog as the pricing page. MindsHub Air is free within the free-tier limits; its listed token rates apply to usage beyond those limits. TypeSafe’s Jev is free. See Prices for cached-input, cache-write and other rates.

Which models are included?

The leaderboard covers chat models and their managed aliases. Other models lists decision and embedding models with their own response-time measurements and availability, and image models, which are not measured. See mindshub.ai/unified-inference#free-tier for the free tier and mindshub.ai/pricing for rates and credits.