Solar Open 100B solar-open-100b

upstage · upstage

unranked — no quality signals yet

params
102.7B
arch
moe
license
other open weights
released
Dec 2025
train compute
1.4e+24 FLOP
downloads/30d
31.4k

# architecture

attn shared GQA 64q/8kv router top-8 of 128 +1 shared expert ×128 expert out ×48 layers 102.7B pool
layers
48
d_model
4096
heads
64q / 8kv
head dim
128
experts
top-8 of 128 + 1 shared
vocab
196608
family
solar_open

signal path of one layer, generated from the registry's structured fields — dimension lines quote the model's real numbers; an MoE trace forks at the router, a dense trace runs straight through. Geometry fields come from the repo's config.json.

# trend

OGM score · last 94 days
OGM score over 94 days

methodology changed during this history window; score movement across that boundary is not model movement. See methodology v6.

# where to run

no known API providers — download the weights from Hugging Face and run them yourself.

source aliases
epoch
Solar Open 100B