Files
voicebox/backend/backends
Charles Hasseandcapy-ai-staging[bot] 502123a943 fix(backend): retry runaway generations on the Chatterbox MLX backend
The qwen configs already set retries_runaway on MLX, with the reason in a comment:
mlx-audio can continue past an EOS miss and emit silence followed by codec noise.
The Chatterbox MLX backend added in this PR hits the same failure and did not have
the guard wired.

Observed on an M4 Max with a cloned pt-BR profile: a 145 character sentence took
18.0s and returned 5.3s of audio for text worth about 8s, and a short reply came
back as an endless hiss. With retries_runaway enabled the same sentence takes 3.4s
and returns the full 7.4s of speech.
2026-10-04 00:25:58 +00:00
..