mirror of
https://github.com/jamiepine/voicebox.git
synced 2026-09-16 05:10:42 -07:00
Jamie PineandClaude Sonnet 4.5
2542f64e1b
Problem: The server binary with CUDA support was 2.9GB, causing: - MSI installer failures in CI (WiX can't handle 3GB files) - Massive downloads for all users (even those without GPUs) - Poor user experience Solution: Build two separate server binaries: - voicebox-server.exe (CPU-only, ~295MB) - ships with installer - voicebox-server-cuda.exe (CUDA, ~2.9GB) - optional download Changes: - backend/build_binary.py: Added 'variant' parameter for CPU/CUDA builds - backend/build_cpu.bat: Script to build CPU-only binary - backend/build_cuda.bat: Script to build CUDA binary - backend/build_both.bat: Script to build both binaries - backend/build_cpu.sh: Unix build script for CPU binary - .github/workflows/release.yml: Build both variants, upload CUDA separately - tauri/vite.config.ts: Externalize Tauri plugins to fix build - docs/dual-server-binaries.md: Complete documentation Results: - Installer size reduced from 3GB to ~500MB (6x smaller) - CI builds now succeed (WiX can handle 500MB) - GPU users can opt-in to download CUDA support - Better bandwidth usage for CPU-only users Next steps: - Frontend implementation to detect GPU and download CUDA binary - Settings UI to toggle between CPU/CUDA modes Co-Authored-By: Claude Sonnet 4.5 (1M context) <[email protected]>
31 lines
1018 B
Bash
31 lines
1018 B
Bash
#!/bin/bash
|
|
# Build CPU-only server binary
|
|
# This creates a ~500MB binary without CUDA support
|
|
|
|
set -e
|
|
|
|
echo "============================================================"
|
|
echo "Building CPU-only server binary"
|
|
echo "============================================================"
|
|
|
|
echo ""
|
|
echo "Step 1: Installing CPU-only PyTorch..."
|
|
pip uninstall -y torch torchvision torchaudio || true
|
|
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
|
|
|
|
echo ""
|
|
echo "Step 2: Building binary with PyInstaller..."
|
|
python build_binary.py cpu
|
|
|
|
echo ""
|
|
echo "Step 3: Restoring CUDA PyTorch for development..."
|
|
pip uninstall -y torch torchvision torchaudio || true
|
|
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
|
|
|
|
echo ""
|
|
echo "============================================================"
|
|
echo "CPU binary built successfully!"
|
|
echo "Location: dist/voicebox-server"
|
|
echo "Size: ~500MB"
|
|
echo "============================================================"
|