Devstral Small 2507 devstral-small-2507
mistralai · mistral coding
unranked — no quality signals yet
- params
- 24B
- arch
- dense
- license
- apache-2.0 open weights
- released
- Jul 2025
- downloads/30d
- 4.3k
# why ranked
Overall: provisional — score 9.3 ● low — a single signal; treat with caution
provisional: too few independent signals for a numbered position — the score is shown, but this model sorts after every ranked model.
| signal | weight | input (0–100) |
|---|---|---|
| aa_intelligence | 0.50 | 9.3 |
| arena_elo | 0.30 | — |
| bench_composite | 0.20 | — |
missing signals are dropped and the remaining weights renormalized — never imputed.
Coding: provisional — score 7.1 ● low — a single signal; treat with caution
provisional: too few independent signals for a numbered position — the score is shown, but this model sorts after every ranked model.
| signal | weight | input (0–100) |
|---|---|---|
| aa_coding | 0.25 | — |
| aider_polyglot | 0.25 | — |
| arena_elo_code | 0.15 | — |
| swe_bench_verified | 0.35 | 7.1 |
missing signals are dropped and the remaining weights renormalized — never imputed.
Agentic: #14 — score 7.1 ● low — a single signal; treat with caution
| signal | weight | input (0–100) |
|---|---|---|
| swe_bench_verified | 1.00 | 7.1 |
# trend
# benchmarks
| benchmark | score | source | date |
|---|---|---|---|
| AA Intelligence Index | 9.3 | Artificial Analysis | — |
| AA Math Index | 29.3 | Artificial Analysis | — |
| SWE-bench Verified | 38.0 | SWE-bench | Jul 2025 |
# where to run
no known API providers — download the weights from Hugging Face and run them yourself.
source aliases
- aa
devstral-small- openrouter
mistralai/devstral-small