feat: voice-gateway service (bridge browser to Hermes over WebSocket+PCM) #4
1 Participants
Notifications
Due Date
No due date set.
Depends on
Reference: org1/hermes-voice-gateway#4
Reference in New Issue
Block a user
BLOCKED
Cannot merge until admin/ansible#7 (Gitea ROOT_URL fix) lands. The release workflow pushes images to Gitea Packages, which depends on the Gitea Container Registry endpoint emitting the public domain in
/v2/tokenURLs. With internal IP192.168.1.96in the token URL (current bug), Docker push cannot complete.Verified locally: run #121 of
.gitea/workflows/release.ymlfails ondocker/login-actionwithdial tcp 192.168.1.96:80: connection refused.Once #7 lands and
app.iniis redeployed, re-trigger this workflow by re-pushing tagv0.1.0(or bumping tov0.1.1).Scope (unchanged)
Single PR combining the gateway service (PR B) and the browser client (PR C) from Org1/hermes-voice-gateway#3. Both halves are useless without each other.
Architecture
Half-duplex: STT -> text -> LLM -> TTS -> audio. No barge-in, no duplex. ~2-5s turn latency.
Why STT/TTS bypass hermes-agent providers
Hermes-agent ships STT/TTS providers (OpenAI, Edge, Mistral, Piper, ...) but they all target file-based voice-bubble delivery (Telegram/Discord), not streaming PCM for a browser WebSocket. The gateway therefore uses faster-whisper + piper directly. The LLM step still goes through hermes-proxy because OpenAI-compatible chat-completions is exactly what the agent ships.
Files
gateway/server.py— aiohttp app:/wsWebSocket,/healthz,/static index.gateway/pipeline.py— STT / LLM / TTS adapter classes.gateway/config.py— env-driven config, no hidden defaults.gateway/static/index.html+app.js+styles.css— browser mic capture (VAD-based silence flush) and WS playback.Dockerfile— extendsnousresearch/hermes-agent:v2026.8.3; adds faster-whisper, piper-tts, onnxruntime.compose.yaml— Swarm stack, placementnode.hostname==rudolf-T, joinshermes_proxyoverlay to reach hermes-proxy by service name..gitea/workflows/release.yml— tag-triggered build & push togitea.rudolf.keenetic.link/Org1/hermes-voice-gateway.Related
feat: voice-gateway service (bridge browser to Hermes over WebSocket+PCM)to [blocked: admin/ansible#7] feat: voice-gateway service (bridge browser to Hermes over WebSocket+PCM)[blocked: admin/ansible#7] feat: voice-gateway service (bridge browser to Hermes over WebSocket+PCM)to feat: voice-gateway service (bridge browser to Hermes over WebSocket+PCM)Pull request closed