mirror of
https://github.com/jamiepine/voicebox.git
synced 2026-09-17 05:40:42 -07:00
James PineandClaude Opus 4.7
0cef2c9fe1
Mounts FastMCP at /mcp (Streamable HTTP) so Claude Code, Cursor, Windsurf, and the VS Code MCP extensions can call voicebox.speak, voicebox.transcribe, voicebox.list_captures, and voicebox.list_profiles against the running Voicebox server. Backend - new backend/mcp_server package (tools, middleware, profile resolve, pub/sub events); named mcp_server to avoid shadowing the installed mcp PyPI package FastMCP imports internally - app.py migrated from @app.on_event to lifespan= so FastMCP's session manager cohabits with Voicebox's startup/shutdown - new MCPClientBinding table + /mcp/bindings CRUD; ClientIdMiddleware reads X-Voicebox-Client-Id into a ContextVar and stamps last_seen_at - profile resolution precedence: explicit -> per-client binding -> capture_settings.default_playback_voice_id - POST /speak REST wrapper for non-MCP callers (shell, ACP, A2A) - GET /events/speak SSE broadcasts speak-start / speak-end so the pill surfaces agent-initiated speech - backend/mcp_shim proxy (plain httpx) for stdio-only MCP clients - PyInstaller spec updates + new --shim build target (~18 MB) Frontend - Settings -> MCP page with HTTP / stdio / claude-mcp-add copy snippets, default voice picker, per-client bindings table, connection status - useMCPBindings, useSpeakEvents hooks - CapturePill gains 'speaking' state; DictateWindow subscribes to SSE and emits dictate:show so the Rust side surfaces the pill window Native - tauri.conf.json externalBin now includes voicebox-mcp - show_dictate_window helper + dictate:show listener in main.rs - (also in this commit: InputMonitoringGate UX, hotkey_monitor tweaks, landing footer/navbar updates, new overview docs for captures / dictation / mcp-server / voice-personalities) Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
47 lines
2.7 KiB
Plaintext
47 lines
2.7 KiB
Plaintext
---
|
|
title: "Voicebox Documentation"
|
|
description: "Voicebox is the open-source, local-first AI voice studio — a free alternative to ElevenLabs and WisprFlow, running entirely on your machine."
|
|
---
|
|
|
|
Voicebox is the **open-source, local-first AI voice studio** — a free
|
|
alternative to ElevenLabs and WisprFlow in one app. Clone voices, generate
|
|
speech across 7 TTS engines, dictate into any app with a global hotkey,
|
|
compose multi-voice projects, and let any MCP-aware agent speak in a voice
|
|
you own. Everything runs on your hardware.
|
|
|
|
|
|
|
|
- **Dictation** — hold a chord anywhere on your machine, speak, release; the transcript pastes into the focused field
|
|
- **Captures tab** — paired audio + transcript archive, retranscribe / refine / play-as-voice
|
|
- **Voice personalities** — per-profile compose / rewrite / respond, powered by a local LLM
|
|
- **Agents speak back** — any MCP-aware agent can call Voicebox to speak in one of your cloned voices
|
|
- **7 TTS engines** — Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox Multilingual, Chatterbox Turbo, HumeAI TADA, Kokoro
|
|
- **Cloning and preset voices** — zero-shot cloning or 50+ curated preset voices
|
|
- **23 languages** — from English to Arabic, Japanese, Hindi, Swahili
|
|
- **Post-processing effects** — pitch shift, reverb, delay, chorus, compression, filters
|
|
- **Expressive speech** — paralinguistic tags (`[laugh]`, `[sigh]`) and natural-language delivery control
|
|
- **Unlimited length** — auto-chunking with crossfade for long scripts
|
|
- **Stories editor** — multi-track timeline for conversations, podcasts, narratives
|
|
- **API-first** — REST + WebSocket API, MCP server for agent integrations
|
|
- **Complete privacy** — models, audio, transcripts, LLM output never leave your machine
|
|
- **Runs everywhere** — macOS (MLX/Metal), Windows (CUDA / DirectML), Linux (ROCm / CPU), Intel Arc, Docker
|
|
|
|
## Download
|
|
|
|
| Platform | Download |
|
|
|----------|----------|
|
|
| macOS (Apple Silicon) | [Download DMG](https://voicebox.sh/download/mac-arm) |
|
|
| macOS (Intel) | [Download DMG](https://voicebox.sh/download/mac-intel) |
|
|
| Windows | [Download MSI](https://voicebox.sh/download/windows) |
|
|
| Docker | `docker compose up` |
|
|
|
|
[View all releases](https://github.com/jamiepine/voicebox/releases/latest)
|
|
|
|
## Get Started
|
|
|
|
- [Installation](/overview/installation) — download and install Voicebox
|
|
- [Quick Start](/overview/quick-start) — get up and running in 5 minutes
|
|
- [Dictation](/overview/dictation) — start talking to your computer
|
|
- [Voice Personalities](/overview/voice-personalities) — compose, rewrite, respond in any profile
|
|
- [API Reference](/api-reference) — integrate voice synthesis into your apps
|