MOSS-Music gets a local GGUF port

Developer scragnog has converted MOSS-Music-8B-Instruct to GGUF for local inference through HOT-Step CPP. The desktop application runs the model with a native C++/GGML engine, without a Python runtime, cloud API, or API key. GGUF is a model format designed for efficient inference and quantized weights, which reduces storage and memory requirements.

MOSS-Music is an open-source music understanding model from MOSI.AI, the OpenMOSS team, and Shanghai Innovation Institute. Its continual pretraining and supervised fine-tuning cover music captioning, lyrics transcription, structural analysis, chord and key detection, tempo reasoning, and long-form question answering. Its output is text, with audio generation outside the model’s scope.

Two files, one custom runtime

The conversion separates the model into a Qwen3-based language model and a mandatory f16 audio tower. HOT-Step’s custom engine connects the audio encoder, SwiGLU adapter, DeepStack merger, and language model. Stock llama.cpp builds do not implement that multimodal wiring, so the files target HOT-Step’s Model Manager.