By Sagar Shankaran, Founder of CallSphere
Matter 1.5.1 made WebRTC the official spec for smart-home cameras and two-way audio. Aqara's first Matter cameras shipped H1 2026. Here is the AI voice-control build pattern.
Key takeaways
Matter 1.5.1 made WebRTC the official transport for smart-home cameras and two-way audio in 2026. Home Assistant 2026.1 added native WebRTC camera streaming. Aqara shipped the first Matter-certified camera in H1 2026. Voice control is the consumer-facing surface; WebRTC is the plumbing.
Smart-home voice through 2024 was Alexa, Google Home, and Siri — three closed ecosystems. Matter 1.5.1 (December 2025) standardized the interop, including cameras with two-way audio and WebRTC transport. Now any Matter-compliant voice agent can talk to any Matter-compliant camera, lock, doorbell, or thermostat.
For a CallSphere-style architecture, this matters because the same Pion Go gateway 1.23 that runs voice-AI for real-estate or healthcare can be a Matter Controller — exposing a single voice agent that controls every device on a home network. Josh.ai already does this; the open-source path is now realistic.
```mermaid flowchart LR User[User Mic] -- WebRTC voice --> Gateway[Pion Go gateway 1.23] Gateway --> AI[Voice Agent + Tool Calls] AI --> Matter[Matter Controller] Matter -- IPv6 --> Camera[Matter Camera] Matter -- IPv6 --> Lock[Matter Lock] Camera -- WebRTC video+audio --> Gateway Gateway --> User ```
Hear it before you finish reading
Talk to a live CallSphere AI voice agent in your browser — 60 seconds, no signup.
CallSphere does not ship a smart-home product, but the pattern reuses three core components from the platform:
37 agents, 90+ tools, 115+ tables, 6 verticals, HIPAA. $149/$499/$1499 pricing; 14-day /trial; 22% /affiliate.
```typescript // 1. WebRTC voice agent that maps tool calls to Matter clusters import { OpenAIRealtime } from "@callsphere/realtime"; import { MatterController } from "@callsphere/matter"; const matter = new MatterController({ fabric: "home-1234" }); const agent = new OpenAIRealtime({ tools: [ { name: "set_light", description: "Turn a light on/off or set brightness", parameters: { roomId: "string", on: "boolean", level: "number" }, handler: async ({ roomId, on, level }) => { const node = await matter.findByRoom(roomId, "OnOffLight"); await node.cluster("OnOff").write({ onOff: on }); if (level) await node.cluster("LevelControl").write({ currentLevel: level }); }, }, { name: "stream_camera", description: "Stream a Matter camera to the user's browser via WebRTC", parameters: { cameraId: "string" }, handler: async ({ cameraId }) => { const cam = await matter.find(cameraId); const offer = await cam.cluster("WebRTCTransport").requestOffer(); return await rtc.bridgeToUser(offer); }, }, ], });
// 2. Matter 1.5.1 camera WebRTC bridge import { Camera } from "@matter/camera"; const cam = new Camera({ commissioner: matter }); cam.on("offer", async (offer) => { const answer = await pcUserSide.setRemoteAndAnswer(offer); cam.sendAnswer(answer); }); ```
Does Matter replace Alexa/Google? No — they support Matter as one of many ecosystems; Matter is interop, not UI.
Still reading? Stop comparing — try CallSphere live.
CallSphere ships complete AI voice agents per industry — 14 tools for healthcare, 10 agents for real estate, 4 specialists for salons. See how it actually handles a call before you book a demo.
Is WebRTC mandatory for Matter cameras? Per spec 1.5.1, WebRTC is the standardized transport for two-way audio + video.
Can I deploy this without a Matter controller? No — you need a Matter-certified controller (or a self-hosted one like Home Assistant + python-matter-server).
How do I handle multi-user homes? Per-user voice biometrics + per-user auth scope on the agent's tool calls.
Privacy concerns? Camera feeds stay on-network unless explicitly remoted; voice agent transcripts respect HIPAA-like local retention.
Written by
Sagar Shankaran· Founder, CallSphere
LinkedInSagar Shankaran is the founder of CallSphere, where he builds production AI voice and chat agents deployed across healthcare, hospitality, real estate, and home services. He writes about agentic AI, LLM engineering, and shipping voice agents that handle real calls in production.
See how AI voice agents work for your industry. Live demo available -- no signup required.
BrowserStack offers 30,000+ real devices; Sauce Labs ships deep Appium automation. Here is how AI voice agent teams use both for WebRTC mobile QA in 2026.
Real-time AI voices joining live podcast feeds is a 2026 trend. Here is the WebRTC + streaming TTS stack that makes them sound human and arrive in time.
Where every millisecond goes in a real voice-agent pipeline, and the 2026 techniques that get you under 500ms reliably.
Cleanly handling user interruptions is what separates a robotic voice agent from one that sounds human. The 2026 patterns and where they fail.
SolidStart 1.3 + Solid 1.9 deliver fine-grained reactivity with no VDOM — voice agents render at 30% lower CPU than React. Plug WebRTC into Solid signals.
WebRTC vs WebSocket for voice AI: when each transport wins on NAT traversal, jitter, codec choice and latency. CallSphere runs both, Vapi locks you in.
© 2026 CallSphere Inc. All rights reserved.
Made within San Francisco