Can I run it? / Ryzen AI Max+ 395 (Strix Halo)

Best LLMs to run on a Ryzen AI Max+ 395 (Strix Halo)

Updated November 2026

As of November 2026, the best model to run on a Ryzen AI Max+ 395 (Strix Halo) is Qwen3.8 27B by Alibaba (Qwen) (Small LM Index 74.6), at about 9 tokens/s with 4-bit weights. For faster replies, Kolibri-1 (71.1) runs at about 37 tokens/s.

Strix Halo mini PCs and laptops share up to 128 GB between CPU and GPU at 256 GB/s: room for 70B-class models, at speeds best suited to Mixture-of-Experts models. About 96 GB is usable for a model, at 256 GB/s. The figures below assume 4-bit weights and a 8K-token context, and only include models that generate at least 5 tokens per second.

Best quality · Best with Apache 2.0 or MIT
Qwen3.8 27B
Index 74.6 · Q4_K_M · 18 GB · ≈ 9 tok/s · Apache-2.0
Fast (20+ tok/s)
Kolibri-1
Index 71.1 · Q4_K_M · 50 GB · ≈ 37 tok/s · Apache-2.0

Models that run well on a Ryzen AI Max+ 395 (Strix Halo)

The 25 best of the 101 models that run at 5+ tokens/s, ranked by the Small LM Index.

#ModelIndexRuns atMemorySpeedLicense
1Qwen3.8 27B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.074.64-bit Q4_K_M18 GB≈ 9 tok/sApache-2.0
2Nemotron 3.5 Bolt 74B-A9B NVIDIANVIDIA · 4-bit · OpenMDW-1.173.44-bit Q4_K_M47 GB≈ 14 tok/sOpenMDW-1.1
3Ternary Bonsai 2 27B PrismMLPrismML · Q2_0 (as released) · Apache-2.071.2Q2_0 (as released) Q2_09.3 GB≈ 20 tok/sApache-2.0
4Kolibri-1 Aleph AlphaAleph Alpha · 4-bit · Apache-2.071.14-bit Q4_K_M50 GB≈ 37 tok/sApache-2.0
5Nanbeige4.3 33B Nanbeige (Kanzhun)Nanbeige (Kanzhun) · 4-bit · Apache-2.070.94-bit Q4_K_M23 GB≈ 8 tok/sApache-2.0
6Muse Glimmer 30B MetaMeta · 4-bit · Apache-2.070.14-bit Q4_K_M19 GB≈ 9 tok/sApache-2.0
7Qwen3.6 27B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.069.74-bit Q4_K_M18 GB≈ 9 tok/sApache-2.0
8Qwen3.6 35B-A3B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.068.34-bit Q4_K_M23 GB≈ 42 tok/sApache-2.0
9Qwen3.5 27B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.068.34-bit Q4_K_M18 GB≈ 9 tok/sApache-2.0
10Nanbeige4.2 3B Nanbeige (Kanzhun)Nanbeige (Kanzhun) · 4-bit · Apache-2.067.24-bit Q4_K_M3.8 GB≈ 61 tok/sApache-2.0
11Qwen3.5 35B-A3B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.066.94-bit Q4_K_M23 GB≈ 42 tok/sApache-2.0
12Spark-X2.6 4B SparkLLM (XHToken)SparkLLM (XHToken) · 4-bit · Apache-2.066.54-bit Q4_K_M3.4 GB≈ 62 tok/sApache-2.0
13Gemma 4 31B GoogleGoogle · 4-bit · Apache-2.066.24-bit Q4_K_M22 GB≈ 8 tok/sApache-2.0
14GLM-4.7-Flash Z.ai (GLM)Z.ai (GLM) · 4-bit · MIT66.04-bit Q4_K_M20 GB≈ 42 tok/sMIT
15Spark-X2.5 4B SparkLLM (XHToken)SparkLLM (XHToken) · 4-bit · Apache-2.065.94-bit Q4_K_M3.4 GB≈ 62 tok/sApache-2.0
16Granite 4.2 30B IBM (Granite)IBM (Granite) · 4-bit · Apache-2.065.84-bit Q4_K_M21 GB≈ 8 tok/sApache-2.0
17Qwen3 30B-A3B Thinking 2507 Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.065.44-bit Q4_K_M20 GB≈ 38 tok/sApache-2.0
18Gemma 4 26B-A4B GoogleGoogle · 4-bit · Apache-2.064.84-bit Q4_K_M17 GB≈ 33 tok/sApache-2.0
19North Mini Code CohereCohere · 4-bit · Unverified64.74-bit Q4_K_M21 GB≈ 42 tok/sUnverified
20gpt-oss-20b OpenAIOpenAI · 4-bit · Apache-2.064.74-bit Q4_K_M14 GB≈ 35 tok/sApache-2.0
21Nemotron 3 Nano 30B-A3B NVIDIANVIDIA · 4-bit · NVIDIA Open Model64.44-bit Q4_K_M20 GB≈ 36 tok/sNVIDIA Open Model
22Qwen3.5 9B Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.064.14-bit Q4_K_M6.4 GB≈ 28 tok/sApache-2.0
23Qwen3-Next 80B-A3B Thinking Alibaba (Qwen)Alibaba (Qwen) · 4-bit · Apache-2.063.74-bit Q4_K_M51 GB≈ 42 tok/sApache-2.0
24Nemotron 3.5 Lightning NVIDIANVIDIA · 4-bit · OpenMDW-1.163.34-bit Q4_K_M22 GB≈ 35 tok/sOpenMDW-1.1
25Apriel 1.6 15B Thinker ServiceNow (Apriel)ServiceNow (Apriel) · 4-bit · MIT63.34-bit Q4_K_M11 GB≈ 17 tok/sMIT

Change the context length or quantization, or see models that only just fit, in Can I run it? for this device.

How to run Qwen3.8 27B on a Ryzen AI Max+ 395 (Strix Halo)

  1. Ollama, LM Studio or llama.cpp. All three use the integrated GPU (Vulkan or ROCm on Ryzen, CUDA on DGX Spark).
    ollama run hf.co/ggml-org/Qwen3.8-27B-GGUF:Q4_K_M
  2. Give the GPU more memory. On Ryzen AI Max systems, raise the GPU memory allocation in the BIOS or driver so large models fit.

Every model page lists the same commands for its own files. Qwen3.8 27B's page also has a memory table for other context lengths.

Questions

What is the best LLM for a Ryzen AI Max+ 395 (Strix Halo)?

As of November 2026, the best model to run on a Ryzen AI Max+ 395 (Strix Halo) is Qwen3.8 27B by Alibaba (Qwen) (Small LM Index 74.6), at about 9 tokens/s with 4-bit weights. For faster replies, Kolibri-1 (71.1) runs at about 37 tokens/s.

What is the biggest model that runs on a Ryzen AI Max+ 395 (Strix Halo)?

Qwen3-Next 80B-A3B Thinking (80B parameters, 3B active) fits at 4-bit, needing 51 GB and generating about 42 tokens/s. Bigger models may fit at lower quality or run more slowly; try them in the Can I run it? tool.

How much memory can a model use on a Ryzen AI Max+ 395 (Strix Halo)?

About 96 GB of the 128 GB. Strix Halo mini PCs and laptops share up to 128 GB between CPU and GPU at 256 GB/s: room for 70B-class models, at speeds best suited to Mixture-of-Experts models.

How accurate are these speeds?

They are estimates from memory bandwidth (256 GB/s here), which limits how fast a model generates text, with a typical efficiency for this kind of hardware. Expect real speeds within about a third either way. Long prompts take longer to read before the first word appears.

Other devices