mirror of
https://github.com/jamiepine/voicebox.git
synced 2026-09-15 21:00:42 -07:00
James PineandClaude Opus 4.7
87c582ad54
Ships the Capture release end to end. Global-hotkey dictation with synthetic paste into the focused app on macOS and Windows, an on-screen pill across recording / transcribing / refining, customizable push-to- talk and toggle chords, and an accessibility-permission prompt scoped to Settings → Captures with inline re-check feedback. Voice profiles gain optional personalities that power compose / rewrite / respond actions via a local Qwen3 LLM — shared with refinement, so there is one local LLM in the app, not two. Refinement hardened with deterministic Whisper-loop collapse before the LLM sees the transcript, per-capture flag snapshots for re-runs, and a ten-transcript evaluation harness across every bundled refinement size. Version bump 0.4.5 → 0.5.0. Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
16 lines
374 B
Python
16 lines
374 B
Python
"""
|
|
LLM inference module - delegates to backend abstraction layer.
|
|
"""
|
|
|
|
from ..backends import get_llm_backend, LLMBackend
|
|
|
|
|
|
def get_llm_model() -> LLMBackend:
|
|
"""Get LLM backend instance (MLX or PyTorch based on platform)."""
|
|
return get_llm_backend()
|
|
|
|
|
|
def unload_llm_model() -> None:
|
|
"""Unload LLM model to free memory."""
|
|
get_llm_backend().unload_model()
|