By Sagar Shankaran, Founder of CallSphere
RNNoise compiled to WASM and loaded into an AudioWorklet processes 48 kHz audio at ~13 ms latency, runs noise-gate hysteresis, and converts Float32 to Int16 PCM — all on a non-DOM audio thread.
Key takeaways
RNNoise compiled to WASM and loaded into an AudioWorklet processes 48 kHz audio at ~13 ms latency, runs noise-gate hysteresis, and converts Float32 to Int16 PCM — all on a non-DOM audio thread.
The 2026 production pattern for browser-side voice processing has converged on a tight stack: AudioWorkletProcessor as the host, RNNoise (a recurrent-neural-network denoiser, MIT license) compiled to WebAssembly as the DSP engine, plus a hysteresis noise gate to prevent rapid mute toggling. Reference implementations (Sokuji, Fluxer) report ~13 ms processing latency at 48 kHz, well below the 100 ms threshold for human-perceptible delay. The worklet runs on a high-priority audio thread isolated from DOM, so React rerenders, scrolling, and tab background-throttling do not produce audio glitches. The same processor handles Float32-to-Int16 PCM conversion, which is what every WebSocket-based AI voice API actually wants on the wire.
Production-grade noise suppression that does not depend on a server. RNNoise outperforms WebRTC's built-in noiseSuppression on background-conversation rejection (the canonical "open-plan office" case). Hysteresis with separate open/close thresholds (e.g. -45 dB open, -55 dB close) prevents the rapid-flapping pattern where ambient noise is right at the threshold. Off-loading PCM conversion to the worklet kills a common JS bottleneck — converting Float32 at 48 kHz on the main thread costs 2-4% CPU for nothing. Combined: cleaner audio uploaded to your AI gateway, 60% bandwidth savings during silence (because gated frames can be dropped), and main-thread CPU stays free for UI.
flowchart TD
A[Microphone · getUserMedia] --> B[AudioContext 48 kHz]
B --> C[AudioWorkletNode]
C --> D[AudioWorkletProcessor]
D --> E[WASM RNNoise · 13ms latency]
E --> F{Noise gate}
F -- above -45 dB --> G[Float32 to Int16 PCM]
F -- below -55 dB --> H[Drop frame · upstream silence]
G --> I[postMessage to main thread]
I --> J[WebSocket / WebCodecs]
CallSphere ships 37 agents · 90+ tools · 115+ tables · 6 verticals · HIPAA + SOC 2 aligned. Our browser voice client embeds RNNoise + a hysteresis gate inside one AudioWorkletProcessor compiled from Rust. Mean processing latency clocks 12-14 ms across M2 MacBook, Snapdragon X Elite, and ThinkPad X1. Background-noise rejection cut "could you repeat that" clarification turns by 22% in the Real Estate OneRoof Pion Go gateway 1.23 flow. Plans $149 / $499 / $1,499, 14-day trial, 22% affiliate Year 1.
opening = -45 dB, closing = -55 dB, with a 100ms close timerWhy not use the browser's built-in noise suppression? It targets human voice in moderate noise. RNNoise is stronger on dense background speech and constant fan/HVAC noise.
Hear it before you finish reading
Talk to a live CallSphere AI voice agent in your browser — 60 seconds, no signup.
What about Krisp / NVIDIA Broadcast? Stronger models, server-grade. RNNoise is the open-source baseline you can ship without per-seat fees.
Will hysteresis cause audio cutoff? With the close timer, no. The 100ms tail keeps trailing words audible.
Does WASM in worklet need cross-origin isolation? Yes if you use SharedArrayBuffer. Without it, postMessage is fine.
AudioWorklet for Low-Latency Voice Processing in 2026: RNNoise + WASM at 13ms sits on top of a regional VPC and a cold-start problem you only see at 3am. If your voice stack lives in us-east-1 but your customer is calling from a Sydney mobile network, the round-trip time alone wrecks turn-taking. Multi-region routing, GPU residency, and warm pools become the difference between "natural" and "robotic" — and it's all infra, not the model.
Production AI agents live or die on three loops: evals, retries, and handoff state. CallSphere runs 37 agents across 6 verticals, each with its own eval suite — synthetic call transcripts replayed nightly with assertion checks on extracted entities (date, time, party size, insurance, address). Without that loop, prompt regressions ship silently and you only find out when bookings drop.
Still reading? Stop comparing — try CallSphere live.
CallSphere ships complete AI voice agents per industry — 14 tools for healthcare, 10 agents for real estate, 4 specialists for salons. See how it actually handles a call before you book a demo.
Structured tools beat free-form text every time. Our 90+ function tools all enforce JSON schemas validated server-side; if the model hallucinates an integer where a string is required, we retry with a corrective system message before falling back to a deterministic path. For long-running flows, we treat agent handoffs as a state machine — booking → confirmation → SMS — so context survives turn boundaries.
The Realtime API vs. async decision usually comes down to "is the user holding the phone right now?" If yes, Realtime; if no (callback queue, after-hours voicemail), async wins on cost-per-conversation, which we track per agent in 115+ database tables spanning all 6 verticals.
Why does audioworklet for low-latency voice processing in 2026: rnnoise + wasm at 13ms matter for revenue, not just engineering? The IT Helpdesk product is built on ChromaDB for RAG over runbooks, Supabase for auth and storage, and 40+ data models covering tickets, assets, MSP clients, and escalation chains. For a topic like "AudioWorklet for Low-Latency Voice Processing in 2026: RNNoise + WASM at 13ms", that means you're not starting from scratch — you're configuring an agent template that's already been hardened across thousands of conversations.
What are the most common mistakes teams make on day one? Day one is integration mapping (scheduler, CRM, messaging) and prompt tuning against your top 20 real call transcripts. Day two through five is shadow-mode running, where the agent transcribes and recommends but a human still answers, so you can compare side-by-side. Go-live is the moment your eval pass-rate clears your internal bar.
How does CallSphere's stack handle this differently than a generic chatbot? The honest answer: it scales until your tool catalog gets stale. The agent is only as good as the integrations it can actually call, so the operational discipline is keeping schemas, webhooks, and fallback paths green. The platform handles the rest — observability, retries, multi-region routing — without your team owning the GPU layer.
Want to see how this maps to your stack? Book a live walkthrough at calendly.com/sagar-callsphere/new-meeting, or try the vertical-specific demo at sales.callsphere.tech. 14-day trial, no credit card, pilot live in 3–5 business days.
Written by
Sagar Shankaran· Founder, CallSphere
Sagar Shankaran is the founder of CallSphere, where he builds production AI voice and chat agents deployed across healthcare, hospitality, real estate, and home services. He writes about agentic AI, LLM engineering, and shipping voice agents that handle real calls in production.
See how AI voice agents work for your industry. Live demo available -- no signup required.
WebTransport is Baseline as of March 2026. Media Over QUIC ships in production within the year. Here is what changes for AI voice agents — and what stays the same.
Every 100ms of latency costs you. So does every cent per minute. Here is the decision matrix we use across 6 verticals to pick where to spend and where to save on voice AI infrastructure.
Vapi 465ms optimal, Retell 580-620ms, Bland ~800ms, ElevenLabs 400-600ms — but those are best-case. We design a fair benchmark harness, P95 measurement, and a reproducible methodology for 2026.
How to stream tokens, tool-call deltas, and intermediate steps from an agent — with code for both the OpenAI Agents SDK and LangChain — and the gotchas that bite in production.
Streaming changes the eval game — final-answer correctness isn't enough when users perceive the answer one token at a time. Here's the metric set that matters.
On May 4 2026 OpenAI published its Realtime stack rebuild — split-relay plus transceiver edge. Here is what changed and what it means for production voice agents.
© 2026 CallSphere LLC. All rights reserved.