Phi-4

Phi-4-mini-instruct

Microsoft · open-permissive mit

Parameters (B)3.836
Architecturedense
Layers / KV heads / head dim32 / 8 / 128
Context window131072
Modalitiesin: text; out: text
GGUFavailable
Commercial useyes

Minimum hardware (estimate)

At Q4_K_M and 8k context, total working set ≈ 3.9 GiB. On a machine with 64 GiB system RAM and no discrete GPU: CPU-only, slow. Limiting factor: No GPU VRAM; fits in system RAM but inference will be CPU-bound.

Open in fit advisor

Scores

No Tier A comparable scores ingested yet for this model.

Provenance

HF: microsoft/Phi-4-mini-instruct · snapshot 2026-08-10