How to Build a Golden Dataset for Production AI Agents
A principal engineer's playbook for curating, versioning, and growing a golden dataset for an agent — from production trace mining to annotation queues in LangSmith.
Browse older CallSphere articles on AI voice agents, contact center automation, and conversational AI.
From the blog
A principal engineer's playbook for curating, versioning, and growing a golden dataset for an agent — from production trace mining to annotation queues in LangSmith.
A 'did the agent answer correctly?' pass/fail hides broken tool calls, wasted tokens, and silent retries. Here is how to evaluate intermediate steps.
Anthropic unveiled 10 pre-built finance agent templates on May 5, 2026 across pitchbook building, KYC screening, and month-end close. What each template does and the hours it replaces.
This week's NVIDIA + ServiceNow Project Arc news is about desktop agents for employees. CallSphere After-Hours covers the phone line. Here is how the two fit together.
Build a browser agent with LangGraph and Playwright that does multi-step web tasks, then ground-truth its work with visual diffs and DOM-based evaluators.
Step-by-step build of a working agent with the OpenAI Agents SDK — Agent class, tools, handoffs, tracing — plus an eval pipeline that catches regressions before merge.
OpenAI's new B2B Signals research finds frontier companies use 3.5x more AI intelligence per employee — what it means and how to close the gap.
Use LangGraph's checkpointer to make agents resumable across crashes and human-in-the-loop pauses, then replay any checkpoint into your eval pipeline.
mrc shipped IT-team-governed AI agents in May 2026 — what it means for who owns agents in the enterprise, and where customer-facing voice fits.
Get notified when we publish new articles on AI voice agents, automation, and industry insights. No spam, unsubscribe anytime.
Try our live demo -- no signup required. Talk to an AI voice agent right now.
© 2026 CallSphere Inc. All rights reserved.
Made within San Francisco