mirror of
https://github.com/jamiepine/voicebox.git
synced 2026-09-16 05:10:42 -07:00
Jamie PineandClaude Sonnet 4.5
2542f64e1b
Problem: The server binary with CUDA support was 2.9GB, causing: - MSI installer failures in CI (WiX can't handle 3GB files) - Massive downloads for all users (even those without GPUs) - Poor user experience Solution: Build two separate server binaries: - voicebox-server.exe (CPU-only, ~295MB) - ships with installer - voicebox-server-cuda.exe (CUDA, ~2.9GB) - optional download Changes: - backend/build_binary.py: Added 'variant' parameter for CPU/CUDA builds - backend/build_cpu.bat: Script to build CPU-only binary - backend/build_cuda.bat: Script to build CUDA binary - backend/build_both.bat: Script to build both binaries - backend/build_cpu.sh: Unix build script for CPU binary - .github/workflows/release.yml: Build both variants, upload CUDA separately - tauri/vite.config.ts: Externalize Tauri plugins to fix build - docs/dual-server-binaries.md: Complete documentation Results: - Installer size reduced from 3GB to ~500MB (6x smaller) - CI builds now succeed (WiX can handle 500MB) - GPU users can opt-in to download CUDA support - Better bandwidth usage for CPU-only users Next steps: - Frontend implementation to detect GPU and download CUDA binary - Settings UI to toggle between CPU/CUDA modes Co-Authored-By: Claude Sonnet 4.5 (1M context) <[email protected]>
23 lines
747 B
Batchfile
23 lines
747 B
Batchfile
@echo off
|
|
REM Build CUDA server binary for Windows
|
|
REM This creates a ~3GB binary with CUDA support
|
|
|
|
echo ============================================================
|
|
echo Building CUDA server binary
|
|
echo ============================================================
|
|
|
|
echo.
|
|
echo Step 1: Ensuring CUDA PyTorch is installed...
|
|
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 --upgrade
|
|
|
|
echo.
|
|
echo Step 2: Building binary with PyInstaller...
|
|
python build_binary.py cuda
|
|
|
|
echo.
|
|
echo ============================================================
|
|
echo CUDA binary built successfully!
|
|
echo Location: dist\voicebox-server-cuda.exe
|
|
echo Size: ~3GB
|
|
echo ============================================================
|