Alibaba’s Qwen team released Qwen3-4B-Instruct-2507 in July 2025, and Unsloth converted the checkpoint into GGUF files for llama.cpp, Ollama, and Docker Model Runner. Unsloth’s GGUF repository displayed more than 838,000 downloads at the time of writing. Selected quantizations occupy roughly 2 to 3 GB, giving developers a practical local model with stronger reasoning, coding, and instruction-following scores than the previous 4B release.
The July checkpoint lifts 4B performance
Qwen3-4B-Instruct-2507 is a dense, 4 billion-parameter model tuned for direct responses without Qwen’s optional thinking mode. The Qwen model card lists a 262,144-token context window, multilingual support, tool-use capabilities, and an Apache 2.0 license.
Qwen’s published evaluations show substantial gains over the previous Qwen3-4B checkpoint running in non-thinking mode. The scores below use Qwen’s test settings and represent percentage-point changes where applicable.
The largest gains appear in logic, mathematics, and scientific reasoning. Qwen also reports an MMLU-Pro score of 62.8 for GPT-4.1-nano under its comparison setup, placing the refreshed 4B checkpoint 6.8 points higher on that test. Application-specific evaluation remains necessary because prompts, quantization levels, sampling settings, and retrieval quality can shift production results.