Compare / LFM2.5 24B-A2B vs EuroLLM 22B Instruct
LFM2.5 24B-A2B vs EuroLLM 22B Instruct
Updated November 2026
Verdict
LFM2.5 24B-A2B scores higher on the Small LM Index: 61.4 vs 19.2. On the 3 benchmarks both labs report, LFM2.5 24B-A2B wins 3 and EuroLLM 22B Instruct wins 0. Both need about 16.5 GB of memory at 4-bit quantization. Only LFM2.5 24B-A2B has a hosted API on OpenRouter ($0.21 per million tokens); the other has to be self-hosted.
Pick LFM2.5 24B-A2B if…
- you want the strongest model overall
- you need math and reasoning
- you need precise instruction following
- you want a hosted API rather than running it yourself
- you work with long documents
- you want the more widely used model (more quantized builds and community support)
Pick EuroLLM 22B Instruct if…
- you need a permissive license (Apache-2.0)
Specifications
| LFM2.5 24B-A2B | EuroLLM 22B Instruct | |
|---|---|---|
| Small LM Index | 61.4 (likely 57–65) | 19.2 (likely 16–24) |
| Lab | Liquid AI · United States | EuroLLM (UTTER consortium) · Europe |
| Released | 2026-10-13 | 2025-12-05 |
| Parameters | 24B (2B active, MoE) | 22.6B (dense) |
| Memory at 4-bit | ~15.7 GB | ~16.5 GB |
| Context window | 128K tokens | 32K tokens |
| Input | text | text |
| Reasoning | No thinking | No thinking |
| License | LFM Open License | Apache-2.0 |
| API price / 1M tokens | $0.21 ($0.050 in, $0.70 out) | Self-host only |
| Hugging Face downloads (30 days) | 32.8K | 8.5K |
Benchmarks
Higher is better. Bold marks the winner where both labs report a score. ≈ marks the index model's estimate for a score that wasn't reported, ✓ an independent measurement and * a score measured by another lab.
| Benchmark | LFM2.5 24B-A2B | EuroLLM 22B Instruct |
|---|---|---|
| MMLU-Pro Knowledge | ≈ 79 | 50.9 |
| GPQA Diamond Knowledge | 74.4 | 26.8 |
| Humanity's Last Exam Reasoning | 7.4 | ≈ 1 |
| SWE-bench Verified Coding | 51.0 | ≈ 5 |
| IFBench Instruction following | 74.7 | — |
| MMLU Knowledge | — | 69.8 |
| Multilingual MMLU Multilingual | — | 64.1 |
| IFEval Instruction following | 96.8 | 67.2 |
| BFCL Agentic | 65.0 | — |
| MATH-500 Math | 96.0 | 54.5 |
| SciCode Coding | 32.7 | — |
Scores are mostly reported by each lab with its own settings, so small gaps are noise. See the methodology. Open in the interactive comparison to add more models.
Questions
Which is better, LFM2.5 24B-A2B or EuroLLM 22B Instruct?
LFM2.5 24B-A2B scores higher on the Small LM Index: 61.4 vs 19.2. On the 3 benchmarks both labs report, LFM2.5 24B-A2B wins 3 and EuroLLM 22B Instruct wins 0.
Which is cheaper to run?
Only LFM2.5 24B-A2B has a hosted API on OpenRouter ($0.21 per million tokens); the other has to be self-hosted. Both need about 16.5 GB of memory at 4-bit quantization.
Which has the longer context window?
LFM2.5 24B-A2B has the longer context window: 128K tokens against 32K.
Can I use LFM2.5 24B-A2B and EuroLLM 22B Instruct commercially?
LFM2.5 24B-A2B is released under LFM Open License and EuroLLM 22B Instruct under Apache-2.0. Apache 2.0 and MIT allow commercial use; other licenses can add conditions, so read the license before shipping a product.
Related comparisons
- Gemma 4 26B-A4B vs LFM2.5 24B-A2B
- gpt-oss-20b vs LFM2.5 24B-A2B
- LFM2.5 24B-A2B vs Magistral Small 1.2
- LFM2.5 24B-A2B vs Mistral Small 3.2
- LFM2.5 24B-A2B vs Tri-21B Think
- EuroLLM 22B Instruct vs gpt-oss-20b
- EuroLLM 22B Instruct vs Magistral Small 1.2
- EuroLLM 22B Instruct vs Tri-21B Think
- EuroLLM 22B Instruct vs Mistral Small 3.2