Handy Computer has released six GGUF builds of Parakeet Ultra for transcribe.cpp. The port runs local speech recognition from one C++ executable and one model file, without Python, a CUDA runtime, or a cloud request. Files range from a 2.51 GB F32 build to a 486 MB Q4_K_M quantized version.
Inside the port
The upstream Parakeet Ultra model is Moondream’s post-trained version of NVIDIA’s 600 million-parameter parakeet-tdt-0.6b-v3. Ultra retains the base model’s architecture, tokenizer, parameter count, and language set while replacing its weights with versions trained to reduce word error rate.
A FastConformer encoder converts audio frames into compact representations, while a Token-and-Duration Transducer decoder predicts both text tokens and their durations. Duration prediction lets the decoder advance through stretches that produce no token. A voice-activity detection head splits long recordings at pauses into segments of up to 30 seconds. The model accepts 16 kHz mono WAV audio and produces cased, punctuated transcripts with optional token-level timestamps.
Six files, a 0.02-point spread
Word error rate, or WER, measures substitutions, deletions, and insertions against a reference transcript; lower scores are better. On all 2,620 utterances in LibriSpeech test-clean, the reported results vary by only 0.02 percentage points from F32 to Q4_K_M.