jamiepineandcapy-ai-staging[bot] cf984885e9 fix(mlx): keep unload_model off the MLX worker so it cannot stall the event loop ...

Routing unload through the single MLX worker and waiting on the result
blocked the caller (the FastAPI event loop via /models/unload) for the
remainder of any in-flight generation — measured 3.7 s stall on a 16 s
clip on an M2 Ultra, unbounded for long texts. Dropping the model
reference inline is thread-safe (MLX frees buffers through its global
allocator) and is what main did before the thread-affinity change; the
generation in flight keeps its own reference and the next generate()
reloads on the worker.

2026-10-04 00:01:47 +00:00

..

__init__.py

fix(kokoro): trim edges only, keep inter-segment gaps

2026-10-04 00:01:24 +00:00

base.py

refactor(generation): simplify post-generation cache cleanup

2026-10-04 00:01:18 +00:00

chatterbox_backend.py

fix(backend): prevent unbounded memory accumulation over consecutive TTS generations (#923)

2026-10-04 00:01:18 +00:00

chatterbox_turbo_backend.py

fix(backend): prevent unbounded memory accumulation over consecutive TTS generations (#923)

2026-10-04 00:01:18 +00:00

hume_backend.py

fix(tada): run voice-prompt encode under torch.inference_mode (#955)

2026-07-26 23:31:20 -07:00

kokoro_backend.py

fix(kokoro): trim edges only, keep inter-segment gaps

2026-10-04 00:01:24 +00:00

luxtts_backend.py

fix(backend): prevent unbounded memory accumulation over consecutive TTS generations (#923)

2026-10-04 00:01:18 +00:00

mlx_backend.py

fix(mlx): keep unload_model off the MLX worker so it cannot stall the event loop

2026-10-04 00:01:47 +00:00

pytorch_backend.py

refactor(stt): name the Whisper sample rate and window constants

2026-10-04 00:01:34 +00:00

qwen_custom_voice_backend.py

fix(backend): prevent unbounded memory accumulation over consecutive TTS generations (#923)

2026-10-04 00:01:18 +00:00

qwen_llm_backend.py

fix: extend MLX thread-affinity fix to the Qwen3 LLM backend

2026-10-04 00:01:47 +00:00