Compare / Spark-X2.5 4B vs Qwen3.5 4B

Spark-X2.5 4B vs Qwen3.5 4B

Updated November 2026

Verdict

Spark-X2.5 4B scores higher on the Small LM Index: 65.5 vs 57.8, although their likely ranges overlap, so the lead is not certain. On the 3 benchmarks both labs report, Spark-X2.5 4B wins 1 and Qwen3.5 4B wins 2. Both need about 3.4 GB of memory at 4-bit quantization. Neither model has a hosted API on OpenRouter, so you would run both yourself.

Pick Spark-X2.5 4B if…

  • you want the strongest model overall
  • you need precise instruction following
  • you work with long documents

Pick Qwen3.5 4B if…

  • you build agents that call tools
  • you need image input
  • you want the more widely used model (more quantized builds and community support)

Specifications

Spark-X2.5 4BQwen3.5 4B
Small LM Index65.5 (likely 63–68)57.8 (likely 52–63)
LabSparkLLM (XHToken) · ChinaAlibaba (Qwen) · China
Released2026-08-242026-03-02
Parameters4.1B (dense)4B (dense)
Memory at 4-bit~3.4 GB~3.3 GB
Context window1M tokens262K tokens
Inputtexttext, image, video
ReasoningHybrid (thinking on/off)Hybrid (thinking on/off)
LicenseApache-2.0Apache-2.0
API price / 1M tokensSelf-host onlySelf-host only
Hugging Face downloads (30 days)30.3K6.1M

Benchmarks

Higher is better. Bold marks the winner where both labs report a score. ≈ marks the index model's estimate for a score that wasn't reported, ✓ an independent measurement and * a score measured by another lab.

BenchmarkSpark-X2.5 4BQwen3.5 4B
MMLU-Pro Knowledge≈ 8279.1
GPQA Diamond Knowledge73.776.2
Humanity's Last Exam Reasoning12.3≈ 9
AIME Math90.7≈ 81
LiveCodeBench Coding≈ 7555.8
SWE-bench Verified Coding41.6≈ 42
τ²-Bench Agentic75.179.9
IFBench Instruction following75.059.2
MMMU-Pro Vision—65.4✓
IFEval Instruction following93.0—
BFCL Agentic65.1—
HMMT Math81.2—
AA-LCR Long context56.3—
SciCode Coding34.7—

Scores are mostly reported by each lab with its own settings, so small gaps are noise. See the methodology. Open in the interactive comparison to add more models.

Questions

Which is better, Spark-X2.5 4B or Qwen3.5 4B?

Spark-X2.5 4B scores higher on the Small LM Index: 65.5 vs 57.8, although their likely ranges overlap, so the lead is not certain. On the 3 benchmarks both labs report, Spark-X2.5 4B wins 1 and Qwen3.5 4B wins 2.

Which is cheaper to run?

Neither model has a hosted API on OpenRouter, so you would run both yourself. Both need about 3.4 GB of memory at 4-bit quantization.

Which has the longer context window?

Spark-X2.5 4B has the longer context window: 1M tokens against 262K.

Can I use Spark-X2.5 4B and Qwen3.5 4B commercially?

Both are released under the Apache-2.0 license. Apache 2.0 and MIT allow commercial use; other licenses can add conditions, so read the license before shipping a product.

Related comparisons

Guides featuring these models