Qwen3.8-Flash-Next FP4-Local
Throughput
Decode tok/s after a fixed context fill (PBM) — same agent-style workload as bench v2.
Published evals
Vendor-card figures for qwen/qwen3.8-flash-next — not this pack. Not measured on this Spark.
- Terminal-Bench 2.1
- 82.9% NVIDIA NVFP4 model card ↗ 2026-08-31 NVIDIA NVFP4 column; temp=1.0, top_p=0.95, reasoning_effort=xhigh. FP8 baseline on the same card is 83.3. Not the Mia pack, not measured on Sparky.
- SWE-bench Pro
- 62.5% Qwen model card ↗ 2026-08-26 Claude Code harness; refined SWE-bench Pro set (vendor). DeepSWE 1.1 is 58.7 on the same card (not a site column).
- LiveCodeBench
- 91.9% Qwen model card ↗ 2026-08-26 LiveCodeBench v6 (vendor).
- GPQA Diamond
- 91.7% Qwen model card ↗ 2026-08-26
Independent board on Artificial Analysis ↗ — we do not copy their scores.
Recipe
- Profile
- nvidia-qwen3.8-flash-next-fp4-local-tensorfold
- Engine
- TensorFold
- Context
- 256k · fp8 KV
- Served as
- Qwen3.8-Flash-Next
- Draft
- MTP
Run on your Spark
spark inference up nvidia-qwen3.8-flash-next-fp4-local-tensorfold
Why we run it
NVIDIA QAD FP4-Local (~96 GiB) of Qwen3.8-Flash-Next on one Spark via MiaAI TensorFold. Native 262k, FP8 KV, vision on, MTP drafts, PARALLEL 5. PBM 45.4/22.6/13.8 tok/s (2026-10-18). Same weights on eugr measured 42.5/19.8/15.4. All-recipes pack of the Flash-Next family; INT4-AR is the ladder row. The Aug 31 datacenter NVFP4 is a different checkpoint.
Bench notes
PBM 4k @ 45.4 / 50k @ 22.6 / 100k @ 13.8 tok/s — perfbench-metrics — native 262k TensorFold FP4 QAD vision on, PARALLEL 5 — profile=nvidia-qwen3.8-flash-next-fp4-local-tensorfold