Kimi Linear 48B A3B Instruct kimi-linear-48b-a3b-instruct

moonshotai · kimi

unranked — no quality signals yet

params
49.1B
arch
moe
license
mit open weights
released
Oct 2025
downloads/30d
89.2k

# architecture

attn shared MHA ×32 router top-8 of 256 +1 shared expert ×256 expert out ×27 layers 49.1B pool
layers
27
d_model
2304
heads
32q / 32kv
head dim
72
experts
top-8 of 256 + 1 shared
vocab
163840
family
kimi_linear

signal path of one layer, generated from the registry's structured fields — dimension lines quote the model's real numbers; an MoE trace forks at the router, a dense trace runs straight through. Geometry fields come from the repo's config.json.

# trend

OGM score · last 50 days
OGM score over 50 days
overall rank (up is better)
Overall rank over 50 days

# where to run

no known API providers — download the weights from Hugging Face and run them yourself.

source aliases
aa
kimi-linear-48b-a3b-instruct