Olmo 3
Olmo-3.1-32B-Instruct
Allen Institute for AI · open-permissive apache-2.0
| Parameters (B) | 32.234 |
|---|---|
| Architecture | dense |
| Layers / KV heads / head dim | 64 / 8 / 128 |
| Context window | 65536 |
| Modalities | in: text; out: text |
| GGUF | available |
| Commercial use | yes |
Minimum hardware (estimate)
At Q4_K_M and 8k context, total working set ≈ 22.3 GiB. On a machine with 64 GiB system RAM and no discrete GPU: CPU-only, slow. Limiting factor: No GPU VRAM; fits in system RAM but inference will be CPU-bound.
Scores
No Tier A comparable scores ingested yet for this model.
Provenance
- identity, license, architecture, parameter count: https://huggingface.co/allenai/Olmo-3.1-32B-Instruct (retrieved 2026-08-10)
HF: allenai/Olmo-3.1-32B-Instruct · snapshot 2026-08-10