Ternary Bonsai 27B
PrismMLReleased Jul 14, 2026Open weights · Apache 2.0ternary-bonsai-27b
- Context
- 262K tokens
- Input
- text, image, video
Read from the hosts' published offers and OpenRouter, spec sheet from PrismML
Run it yourself
open weights, Apache 2.0 · fits 6 of the 6 workstations in our guideSelf-host guide ›- Parameters
- 27B
- dense
- Memory needed
- 16 GB
- in INT4 · 32 GB in INT8
- Smallest cloud setup
- RTX 3090
- 24 GB · $0.17/h, about $124 a month
| Quantization | Memory | Smallest cloud GPU | Quality |
|---|---|---|---|
| INT4 (Q4) | 16 GB | RTX 3090 · $0.17/h | smallest footprint, minor quality loss |
| INT8 (Q8) | 32 GB | A100 · $1.19/h | near-lossless |
| FP16 (full) | 65 GB | A100 · $1.19/h | reference quality |
At home: in INT4 it fits a RTX 5090 (32 GB) + host PC (plus a host PC), about $3,500 once, or $0.1332/h over 3 years, electricity aside.
Memory ≈ parameters × bytes per parameter × 1.2 · cloud price: on-demand rate, running 24/7 · builds: GGUF, AWQ, MLX, GPTQ, Ollama · break-even calculator
Hosts serving Ternary Bonsai 27B, no published price yet
No price we can verify, so no rank.