mirror of
https://github.com/jamiepine/voicebox.git
synced 2026-09-16 21:30:39 -07:00
James Pine
4e7772a21d
Integrates HumeAI's TADA (Text-Acoustic Dual Alignment) speech-language model as a new TTS engine. TADA uses a novel 1:1 token-audio alignment that produces coherent speech over long sequences (700s+). Two model variants: - tada-1b: English-only, ~4GB, built on Llama 3.2 1B - tada-3b-ml: 10 languages, ~8GB, built on Llama 3.2 3B Backend uses the Encoder for voice prompt encoding with caching, and TadaForCausalLM with flow-matching diffusion for generation. Supports bf16 inference on CUDA, forces CPU on macOS (MPS compatibility). Installed with --no-deps due to torch>=2.7 pin conflict; descript-audio-codec and torchaudio added as explicit sub-dependencies.
54 lines
1.2 KiB
Plaintext
54 lines
1.2 KiB
Plaintext
# FastAPI and server
|
|
fastapi>=0.109.0
|
|
uvicorn[standard]>=0.27.0
|
|
pydantic>=2.5.0
|
|
|
|
# Database
|
|
sqlalchemy>=2.0.0
|
|
alembic>=1.13.0
|
|
|
|
# ML models
|
|
torch>=2.1.0
|
|
transformers>=4.36.0,<=4.57.6
|
|
accelerate>=0.26.0
|
|
huggingface_hub>=0.20.0
|
|
qwen-tts>=0.0.5
|
|
|
|
# LuxTTS (voice cloning engine)
|
|
# piper-phonemize needs custom index (no PyPI wheels)
|
|
--find-links https://k2-fsa.github.io/icefall/piper_phonemize.html
|
|
# linacodec is a git-only dep of Zipvoice (uv-only source, pip can't resolve it)
|
|
linacodec @ git+https://github.com/ysharma3501/LinaCodec.git
|
|
Zipvoice @ git+https://github.com/ysharma3501/LuxTTS.git
|
|
|
|
# Chatterbox TTS sub-dependencies (chatterbox-tts itself is installed
|
|
# --no-deps in the setup script because it pins numpy<1.26 / torch==2.6
|
|
# which are incompatible with Python 3.12+)
|
|
conformer>=0.3.2
|
|
diffusers>=0.29.0
|
|
omegaconf
|
|
pykakasi
|
|
resemble-perth>=1.0.1
|
|
s3tokenizer
|
|
spacy-pkuseg
|
|
pyloudnorm
|
|
|
|
# HumeAI TADA sub-dependencies (hume-tada itself is installed
|
|
# --no-deps in the setup script because it pins torch>=2.7,<2.8)
|
|
descript-audio-codec>=1.0.0
|
|
torchaudio
|
|
|
|
# Audio processing
|
|
librosa>=0.10.0
|
|
soundfile>=0.12.0
|
|
numpy>=1.24.0
|
|
numba>=0.60.0,<0.61.0
|
|
pedalboard>=0.9.0
|
|
|
|
# HTTP client (for CUDA backend download)
|
|
httpx>=0.27.0
|
|
|
|
# Utilities
|
|
python-multipart>=0.0.6
|
|
Pillow>=10.0.0
|