Edge0 has released Audio8-TTS-Realistic-Air, a 601 million-parameter text-to-speech model that supports zero-shot voice cloning across 23 languages. Zero-shot cloning lets the model imitate a speaker from a reference recording and transcript without additional training.

Realistic Air fine-tunes Audio8-TTS-Preview-0.6B, with improved speech realism claimed by Edge0 while retaining the same compact architecture. The Apache 2.0 release bundles the model weights, tokenizer, custom Transformers code, and a neural audio codec that produces 44.1 kHz audio.

Dual autoregression keeps the model compact

Audio8 follows the DualAR architecture used by Fish Audio S2 Pro. A 24-layer autoregressive transformer predicts one semantic token for each audio frame, tracking content and timing across the utterance. A smaller four-layer transformer then predicts the codec codebooks that represent acoustic details such as timbre and intonation.

The codec reconstructs those codebook values into a waveform. Splitting sequence planning from frame-level detail allows the main model to remain relatively small while producing high-resolution audio.

Architecture and runtime specifications

  • Main model: 601 million parameters, excluding the codec
  • Slow transformer: 24 layers with a hidden width of 896
  • Fast transformer: 4 layers
  • Codec: 10 codebooks with 4,096 entries each
  • Audio: 44.1 kHz output at about 21.5 codec frames per second
  • Context: up to 2,048 combined text and audio positions
  • Precision: BF16
  • Tested hardware: NVIDIA H20

Text, reference audio, and generated audio share the 2,048-position context window, so longer prompts leave less room for synthesis. At 21.5 audio frames per second, 2,048 audio-only positions would represent roughly 95 seconds, although practical output limits are lower once the other inputs are included.