Qwen2.5

Qwen2.5-72B-Instruct

Alibaba (Qwen team) · open-restricted qwen

Parameters (B)72.706
Architecturedense
Layers / KV heads / head dim80 / 8 / 128
Context window32768
Modalitiesin: text; out: text
GGUFavailable
Commercial useyes

Minimum hardware (estimate)

At Q4_K_M and 8k context, total working set ≈ 47.4 GiB. On a machine with 64 GiB system RAM and no discrete GPU: Won't run. Limiting factor: No GPU and system RAM insufficient for weights + KV.

Open in fit advisor

Scores

BenchmarkValueUncertaintyRun bySource
GPQA Diamond49.1%unknownthird-partyepoch-ai
MATH Level 563.2%unknownthird-partyepoch-ai
OTIS Mock AIME 2024-20258.1%unknownthird-partyepoch-ai

Provenance

HF: Qwen/Qwen2.5-72B-Instruct · snapshot 2026-08-10