Qwen2.5-Coder

Qwen2.5-Coder-32B-Instruct

Alibaba (Qwen team) · open-permissive apache-2.0

Parameters (B)32.764
Architecturedense
Layers / KV heads / head dim64 / 8 / 128
Context window32768
Modalitiesin: text; out: text
GGUFavailable
Commercial useyes

Minimum hardware (estimate)

At Q4_K_M and 8k context, total working set ≈ 22.6 GiB. On a machine with 64 GiB system RAM and no discrete GPU: CPU-only, slow. Limiting factor: No GPU VRAM; fits in system RAM but inference will be CPU-bound.

Open in fit advisor

Scores

BenchmarkValueUncertaintyRun bySource
Aider polyglot16.4%unknownthird-partyepoch-ai

Provenance

HF: Qwen/Qwen2.5-Coder-32B-Instruct · snapshot 2026-08-10