Falcon-H1

Falcon-H1-7B-Instruct

Technology Innovation Institute · open-restricted falcon-llm-license

Parameters (B)7.586
Architecturedense
Layers / KV heads / head dim44 / 2 / 128
Context window262144
Modalitiesin: text; out: text
GGUFavailable
Commercial useyes

Minimum hardware (estimate)

At Q4_K_M and 8k context, total working set ≈ 5.5 GiB. On a machine with 64 GiB system RAM and no discrete GPU: CPU-only, slow. Limiting factor: No GPU VRAM; fits in system RAM but inference will be CPU-bound.

Open in fit advisor

Scores

No Tier A comparable scores ingested yet for this model.

Provenance

HF: tiiuae/Falcon-H1-7B-Instruct · snapshot 2026-08-10