By Sagar Shankaran, Founder of CallSphere
Skills teams need for self-hosted Claude agents: sandbox ops, MCP authoring, eval engineering, and agent SRE. A capability-based hiring guide.
Key takeaways
When a team decides to run Claude Managed Agents on its own infrastructure — self-hosted sandboxes that execute the agent's code, and MCP tunnels that bridge those sandboxes back to internal systems — the first surprise is rarely the model. It is the org chart. The agent works on day one. What breaks is that nobody owns the sandbox image, nobody can read an MCP server log, and the person who wrote the agent's instructions has never designed an eval in their life. The capability is real, but the team is staffed for a previous era of software.
This post is about the human side of that shift: what skills actually have to exist on a team before self-hosted Claude agents become a reliable production capability instead of a clever demo, and how hiring and role definitions move to support it. It is not a generic "AI will change everything" essay. It is a concrete inventory of the competencies you need and where to find or grow them.
A Claude Managed Agent is straightforward to prototype. You describe a task, give it a few tools through MCP, point it at a sandbox, and watch it work. The prototype hides the operational surface area because in a prototype the sandbox is your laptop, the MCP server runs as you with your credentials, and the only eval is "did it look right." Every one of those shortcuts becomes a job function when you move to production.
The self-hosted variant raises the stakes further. You are no longer renting a managed runtime; you own the container image the agent executes inside, the network path the MCP tunnel takes back to your databases, and the identity the agent presents to internal services. Each of those is a distinct discipline with its own failure modes. The gap is invisible in the demo and unavoidable in week three, which is exactly why teams under-hire for it.
For grounding: a Claude Managed Agent is a Claude-driven agent whose execution, tool access, and lifecycle are operated by your team rather than run only inside a vendor's hosted environment — meaning your team owns the sandbox it runs in and the connectors it reaches through.
Map the work to people before you map it to tools. These four clusters cover the real surface area of a self-hosted agent platform.
Hear it before you finish reading
Talk to a live CallSphere AI voice agent in your browser — 60 seconds, no signup.
flowchart TD
A["Agent task defined"] --> B["Sandbox ops: image, limits, isolation"]
A --> C["MCP authoring: tools, scopes, schemas"]
B --> D["Agent SRE: run it, watch it, page on it"]
C --> D
A --> E["Eval engineering: prove it works"]
E --> F{"Quality gate passed?"}
F -->|No| A
F -->|Yes| D
D --> G["Reliable production capability"]
Sandbox operations. Someone has to own the container or microVM the agent runs in: the base image, the resource limits, the egress rules, what filesystem it can touch, how secrets get injected without leaking into logs. This is platform engineering, not ML. A strong Kubernetes or container-platform engineer learns it fastest.
MCP server authoring. The tunnel is only as safe as the MCP server on the other end. Writing one means designing tool schemas a model can use unambiguously, scoping each tool to least privilege, and validating every argument the agent sends. This blends backend engineering with security review.
Eval engineering. The single highest-leverage skill, and the rarest. An eval engineer turns "the agent should handle refunds correctly" into a runnable test set with graded outcomes, so a prompt or model change can be measured instead of vibed. Without this role, you cannot safely change anything.
Agent SRE. Agents fail in ways services do not: they loop, they call a tool 40 times, they stall mid-task. You need someone who instruments runs, sets budgets, defines what "page me" means for an agent, and writes the runbook for a stuck sandbox.
Hiring managers reach for "prompt engineer" because it is the term they have heard. It is the wrong anchor. The durable competency is reasoning about boundaries — the process boundary the sandbox enforces and the network boundary the tunnel crosses — and proving behavior with evidence. Write the role around that.
Here is a capability-based snippet you can drop into a req. It screens for the thinking, not the tooling:
Role: Agent Platform Engineer
You will:
- Own the sandbox image Claude agents execute in (limits, egress, secrets)
- Author and review MCP servers that expose internal tools to agents,
with least-privilege scopes and strict argument validation
- Build eval suites that gate agent behavior changes before release
- Define SLOs, budgets, and runbooks for agent runs in production
We screen for:
- Designed an isolation boundary (container/microVM) under threat
- Turned a fuzzy quality goal into a graded, automated test set
- Debugged a system across a network boundary you did not fully control
Notice there is no model name, no SDK version, and no "X years of prompt engineering." Those details age out. The screening signals — isolation under threat, graded test sets, cross-boundary debugging — stay relevant across model generations and are far easier to interview for honestly.
Still reading? Stop comparing — try CallSphere live.
CallSphere ships complete AI voice agents per industry — 14 tools for healthcare, 10 agents for real estate, 4 specialists for salons. See how it actually handles a call before you book a demo.
Most teams cannot hire all four clusters at once, and they should not try. The good news is that three of the four grow well internally from people you likely already have. Use this to plan.
| Skill cluster | Best internal source | Grow or buy? | Time to competent |
|---|---|---|---|
| Sandbox operations | Platform / infra engineer | Grow | Weeks |
| MCP server authoring | Backend + security pairing | Grow | Weeks |
| Eval engineering | QA or data-minded engineer | Grow, sometimes buy | Months |
| Agent SRE | Existing SRE / on-call eng | Grow | Weeks |
The pattern that works fastest: take one backend engineer and one security engineer and have them ship a single real MCP server together, end to end, with scopes and validation. That one project teaches both the tunnel discipline and the threat model, and it produces an artifact the rest of the team can copy. Eval engineering is the one cluster where an external hire often pays off, because the muscle of designing graded test sets is genuinely scarce.
Usually no. Prompt quality matters, but it is one skill among several and rarely the bottleneck. The roles that gate success are sandbox ops, MCP authoring, eval engineering, and agent SRE. Spread prompt-writing across the engineers who own those areas rather than isolating it in one title.
Mostly yes, with a short ramp. Agents introduce new failure modes — loops, tool storms, stalls — but the core discipline of instrumentation, budgets, alerts, and runbooks is exactly what SREs already do. Give them a kill switch and a budget alert and they adapt quickly.
Eval engineering. Once you can grade agent behavior automatically, every other improvement becomes measurable and safe to ship. Without it, you are flying blind and will discover regressions through user complaints.
If you grow internally from existing infra, backend, security, and SRE people, a focused team can reach a reliable first production agent in roughly a quarter — most of that time spent on evals and the reference MCP server, not on the model.
CallSphere puts these same agentic-AI disciplines to work on voice and chat — assistants that answer every call and message, reach into your tools mid-conversation, and book work around the clock. See the live system at callsphere.ai.
Source & attribution: This is an independent, original explainer inspired by Anthropic's coverage on the Claude blog. Claude, Claude Code, Claude Cowork, Claude Opus, and the Model Context Protocol are products and trademarks of Anthropic. CallSphere is not affiliated with or endorsed by Anthropic.

Written by
Sagar Shankaran· Founder, CallSphere
LinkedInSagar Shankaran is the founder of CallSphere, where he builds production AI voice and chat agents deployed across healthcare, hospitality, real estate, and home services. He writes about agentic AI, LLM engineering, and shipping voice agents that handle real calls in production.
See how AI voice agents work for your industry. Live demo available -- no signup required.
Which solar roles change shape in 2026, what a new designer needs taught in week one, what stops being a hiring requirement, and the ramp-time arithmetic.
One reschedule text hits your scheduler, package balance, tutor shift and invoice. Here is what MCP changed for tutoring and test-prep center owners in 2026.
AI codes the bank feed now. What a bookkeeping firm should teach a new hire in week one, what comes off the job ad, and what a shorter ramp is worth per hire.
Anthropic's Claude Fable 5 and Mythos 5 explained: pricing, availability, frontier benchmarks, the dual-model safeguard architecture, and what they mean for AI agents.
AI adoption hit 66% of US small firms but 70% say staff need training. How the import coordinator desk at an NVOCC changes, and what to teach in week one.
Where Claude Code, MCP, and multi-agent systems are taking GTM engineering next, and how to prepare your team now for standing and multi-agent workflows.
© 2026 CallSphere Inc. All rights reserved.
Made within San Francisco
Watch how CallSphere handles real customer calls, schedules appointments, and processes payments — live.
Try Live DemoBook a DemoCalculate Your ROI