mistral-small API — compare providers
The same model (mistral-small) is served by 2 providers; Mistral AI is the cheapest at $0.75/1M blended — the priciest (Venice) costs 25% more.
| Rank | Provider | Input /1M | Output /1M | Blended /1M | Speed (tok/s per $) |
|---|---|---|---|---|---|
| 1 | Mistral AI | $0.15 | $0.6 | $0.75 ← cheapest | 189.5 |
| 2 | Venice | $0.1875 | $0.75 | $0.938 | — |
Speed per dollar = measured output tokens/s ÷ blended price. Throughput is provider-specific, so it can rank endpoints differently from price — see the speed-per-dollar ranking.
Prices are per 1M tokens (USD). "Blended" = input + output, for coarse ranking. Same underlying model, 2 serving providers, 25% spread top to bottom. Context window: 131,072 tokens (32,768 max output) — see how it ranks in biggest context windows. See how this compares across the catalogue in same model, different price.
Cost per 1,000 requests by workload
What each provider actually bills for a representative job, not just the sticker price.
| Provider | Chatbot 1000 in / 500 out | RAG / long context 8000 in / 500 out | Batch summarize 4000 in / 1000 out |
|---|---|---|---|
| Mistral AI | $0.45 | $1.50 | $1.20 |
| Venice | $0.56 | $1.88 | $1.50 |
Estimate your own workload
Input tokens/request: Output tokens/request: Requests:
| Provider | Estimated cost (USD) |
|---|
Self-host / quantized builds
Open weights under Apache 2.0 — you can run mistral-small on your own hardware instead of paying per token. Quantized to int4 it needs roughly 14.4 GB of VRAM — within reach of a single consumer GPU or a Mac with unified memory. Formats: GGUF for llama.cpp / Ollama / LM Studio, AWQ and GPTQ for GPU serving, MLX for Apple silicon.
- GGUF builds llama.cpp · Ollama · LM Studio
- AWQ builds GPU serving (vLLM)
- GPTQ builds GPU serving
- MLX builds Apple silicon
- Ollama library one-command local run
Links search the live model hubs (Hugging Face, Ollama) so they track new builds as they appear — we don't host weights. Which formats exist depends on what the model owner and community have published.
→ See VRAM, GPU and cost vs API for mistral-small, or the full self-host break-even calculator.