Model performance on MindsHub

See how models served through MindsHub Inference perform: response times, availability and cost, with current prices, API aliases and fallback routes.

Measurements refresh every 2 to 6 hours · About the data

All makers
Makers
Reasoning effort

Other models

Decision models choose, classify and score. Embedding models turn text into vectors for search and matching.

Interval 7 days24 hours
Chart key

Response-time chart

Pale bar: typical time to complete the request (P50), including connection and processing time.Dot: the P50 time. Half of measured requests completed within this time.Thin line: P50 to P95. 95% of measured requests completed within the P95 time.

These checks report P50 and P95 only. Point to a dot, focus it with Tab, or select it for values and dates.

Response times use completed UTC periods. Availability can include more recent checks through the latest complete hour.

Availability

Availability before fallback

Share of automated checks answered by the model you chose, including retries. Failures attributed to our monitoring network are excluded. If a fallback answers instead, it does not count toward this percentage.

How availability and fallbacks work

Showing 2 models

Full response time. Time to a complete response from each API. Lower is faster. The interval applies to response time and availability.

  • Jev 1.13.0Decision · TypeSafeJev 1.13.0 · full response0.56 sP50 · typical0.94 sP95 · highAPIDecisionSelected interval7 daysFrom (UTC)Nov 11, 2026, 00:00To (UTC)Nov 18, 2026, 00:00Tests9810.56 s P50, P95 0.94 s
    Availability before fallback
    100.00%
    API aliases
    jev-1.13.0 jev jev-latest
  • Text Embedding 3 (small)Embedding · OpenAIText Embedding 3 (small) · full response1.01 sP50 · typical1.44 sP95 · highAPIEmbeddingSelected interval7 daysFrom (UTC)Nov 11, 2026, 00:00To (UTC)Nov 18, 2026, 00:00Tests9721.01 s P50, P95 1.44 s
    Availability before fallback
    100.00%
    API aliases
    embed-3-small embed-small text-embedding-3-small
  • Jev 1.13.0Decision · TypeSafeJev 1.13.0 · full response0.54 sP50 · typical0.77 sP95 · highAPIDecisionSelected interval24 hoursFrom (UTC)Nov 17, 2026, 00:00To (UTC)Nov 18, 2026, 00:00Tests1420.54 s P50, P95 0.77 s
    Availability before fallback
    100.00%
    API aliases
    jev-1.13.0 jev jev-latest
  • Text Embedding 3 (small)Embedding · OpenAIText Embedding 3 (small) · full response0.80 sP50 · typical1.33 sP95 · highAPIEmbeddingSelected interval24 hoursFrom (UTC)Nov 17, 2026, 00:00To (UTC)Nov 18, 2026, 00:00Tests1410.80 s P50, P95 1.33 s
    Availability before fallback
    100.00%
    API aliases
    embed-3-small embed-small text-embedding-3-small

About the data

What does this page show?

Performance and reliability measured through MindsHub Inference, alongside current token prices, API aliases and fallback routes. The figures describe the models as served through MindsHub. They are not a ranking of every provider’s deployment of those models.

Where do the measurements come from?

We run automated API checks and writing tasks through MindsHub Inference. Complex task, writing speed and cost per task figures refresh every two hours, and the other measurements every six hours. Complex task performance and cost cover up to 35 days of tests. Each chart shows its measurement dates. If an update fails, we keep previously saved measurements with their original dates. Prices, aliases and fallback routes come from the same live catalog as our pricing page. A dash means no usable measurement is available.

How is Ping measured?

Every 10 minutes, checks from multiple regions ask for a one-word reply at the lowest reasoning effort. We time the first answer token, including any thinking before it. Ping measures basic responsiveness and tracks availability.

Sample prompt

Reply with the single word: ok
How is the Simple task measured?

Every six hours, the model receives a short briefing about a fictional market hall and is asked to describe a Saturday morning in at least 150 words. It must interpret the facts, decide how to present them and follow the writing constraints. We time the first answer token at the default reasoning effort, including thinking time.

Sample prompt, abridged; briefing omitted

Using only the supplied market-hall briefing, describe a typical Saturday morning in at least 150 words. Use plain paragraphs, with no headings or lists, and do not add facts.
How is the Complex task measured?

The model receives a longer briefing about the same fictional market hall and must turn it into a complete visitor’s guide of at least 800 words. It must analyze and organize the supplied facts, cover them in order and obey content and formatting constraints. We measure the first answer token, total response time and writing speed at each tested effort level. The first-answer and total times include thinking; writing speed starts when the answer begins. Repeated tests run over several weeks; each model’s details show the test count and interval. These are speed tests, not scores for reasoning quality.

Sample prompt, abridged; briefing omitted

Using only the supplied briefing, write a visitor’s guide of at least 800 words. Cover every part in the given order, in plain paragraphs with no headings, lists or tables. Do not add facts.
What are p50, p05 and p95?

P50 is the median: half of measurements are at or below it and half at or above it. P05 and P95 mark the lower and upper ends of the middle 90% of measurements. The leaderboard shows p50. Open Performance to explore the spread; Ping and Simple task have p50 and p95 only.

Does availability below 100% mean requests failed?

Not necessarily. A configured fallback route can still answer when the model you chose does not. Availability before fallback is the share of our automated checks answered by that model, including retries, over the selected period. Other checks were answered by a fallback or got no answer. These checks do not measure how often customer requests fail. Failures attributed to our monitoring network are excluded.

What does the intelligence score mean?

MindsHub’s read is a subjective estimate from 1 to 10 based on public benchmarks and rankings, not a precise measurement. Performance depends on your workload; test models on your own tasks.

For detailed benchmarks, refer to third party services such as Artificial Analysis, Epoch AI or similar.

How is cost per task compared?

The most expensive measured model and effort level is the 100% reference, updated automatically as results change. The leaderboard range covers a model’s measured effort levels; expand it for individual values. In Cost per task, choose another reference to compare against. Dollar estimates use mean input and output tokens at current standard rates, excluding cache discounts. Your bill depends on your requests.

What changes with reasoning effort?

Intelligence, Complex task timings and writing speed follow the selected effort. Ping always uses the lowest effort and Simple task the default. The cost range covers all measured levels. Views showing all effort levels disable the selector because every level is already visible.

What are fixed and rotating aliases?

An alias is the name sent in the API’s model field. Fixed aliases select a specific model version. Rotating aliases follow a model family as it updates. MindsHub Air and MindsHub Blaze are managed rotating aliases: MindsHub can change the model behind each name. The Aliases tab explains their purpose and lists the names you can use.

How do token prices, context limits and the free tier work?

Tokens are pieces of text. The context limit is how much input a model accepts in one request. Token prices are US dollars per million input or output tokens, from the same catalog as the pricing page. MindsHub Air is free within the free-tier limits; its listed token rates apply to usage beyond those limits. TypeSafe’s Jev is free. See Prices for cached-input, cache-write and other rates.

Which models are included?

The leaderboard covers chat models and their managed aliases. Other models lists decision and embedding models with their own response-time measurements and availability. See mindshub.ai/unified-inference#free-tier for the free tier and mindshub.ai/pricing for rates and credits.