AutoTrust AI Lab has published a third-party AutoTrust release that pairs NVIDIA’s existing Qwen3.8-27B NVFP4 checkpoint with a faster Multi-Token Prediction drafter. The 21.9 GB target-model safetensors remain unchanged; the gains come from a smaller draft vocabulary, a quantized draft head, quantized MTP layers, and vLLM integration code.

The reported single-stream decode rate on a DGX Spark GB10 rises from 12.5 to 48.2 tokens per second at temperature 0. That 3.9x headline compares tuned MTP with speculative decoding disabled. The incremental gain over Qwen’s native MTP configuration, which plateaus around 37 tok/s, is approximately 30%.

Spark jumps from 12.5 to 48.2 tok/s

AutoTrust measured one active request at a time across 24 prompts, each containing 1,024 input tokens. Decoding used greedy sampling at temperature 0.

Workload-specific results at k=8 range from 44.4 to 56.9 tok/s. Here, k is the maximum number of speculative tokens proposed before the target model verifies them.

A 248k-token head taxes every draft

Memory bandwidth sets the DGX Spark’s decode ceiling. Its 128 GB of unified LPDDR5X supplies 273 GB/s of raw bandwidth to the entire system-on-chip, roughly one-seventh the bandwidth available on high-end HBM accelerators. Autoregressive decoding repeatedly streams the active model weights from memory, leaving a dense 27B model in the low tens of tokens per second even with 4-bit quantization.

Speculative decoding reduces that traffic by letting a cheaper model propose several tokens. The target model checks those proposals together, accepting correct tokens and replacing rejected ones. More accepted tokens per verification pass means fewer full-weight scans for each generated token.