Osaurus has released Diplodocus preview 4 as three GGUF builds for llama.cpp. The 7B model targets local workflows involving PDFs, spreadsheets, document edits, and calculator-backed financial arithmetic.

The model fine-tunes IFM’s K2-Horizon-7B on Osaurus’s workspace tools, including in-place workbook and document editing, a calculator, and optional reasoning. File operations still require a host application that implements those tools and executes the model’s calls. The release uses the Apache 2.0 license and supports llama.cpp-based runtimes such as Ollama, LM Studio, Jan, and Docker Model Runner once they include the required architecture support.

Three quantizations, one hard dependency

All three builds use an importance matrix, which applies calibration data during compression to preserve influential weights.

Actual memory use exceeds the file size because the runtime also allocates memory for the context window, KV cache, and other buffers. Longer contexts can therefore require partial CPU offloading even when the model file fits in VRAM.

Loading any build requires llama.cpp with K2 Horizon support from PR #29535, merged on October 6, 2026. Older llama.cpp builds will reject the k2-horizon architecture, including applications that bundle an outdated engine. Mac users running the Osaurus application can instead use the separate JANG_6M MLX package containing the same weights.