A new quantized model called Sharp-Spark repackages Spark-X2.5-4B for local coding workloads. The build combines a custom importance matrix, per-tensor bit allocation, and a patched Jinja chat template. Its repository lists an Apache 2.0 license.
GGUF is the model format commonly used by llama.cpp for local inference. Sharp-Spark’s practical pitch is memory efficiency: its Q6 file occupies 3.61 GB, leaving part of a 6 GB GPU available for context and runtime overhead while retaining scores close to the upstream model’s larger Q8 build.
Small benchmark, close scores
The repository reports results from limited slices of MMLU-Pro and SWE-bench-Live. Spark-Q8 refers to the upstream model’s 8-bit quantized build.
The MMLU-Pro difference falls within the reported statistical uncertainty. The SWE-bench-Live comparison carries more uncertainty because the available summary omits its sample size and raw results. These slices support a narrow efficiency claim; broader coding quality still requires full-suite testing on representative repositories.
The token reduction also reflects package behavior beyond quantization. Sharp-Spark injects a terseness instruction by default, which can shorten responses independently of weight precision.