Testing and evals for Claude agents: gate every release
Measure Claude agent quality and gate releases with an eval loop — golden sets, deterministic checks, LLM-judges, and trajectory evaluation that catch regressions.
Agentic AI, LLM engineering, and the models behind modern automation — multi-agent systems, LLM evaluation and comparisons, RAG, fine-tuning, AI infrastructure, security, and production AI engineering.
From the blog
Measure Claude agent quality and gate releases with an eval loop — golden sets, deterministic checks, LLM-judges, and trajectory evaluation that catch regressions.
A practical security playbook for Claude Code agents: sandboxing, least privilege, secrets handling, and layered prompt-injection defense for production.
Slash Claude Code agent costs with prompt caching, model tiering, batching, and lean context. A practical guide to keeping agentic runs cheap and fast.
Fix the three Claude Code agent failure modes — runaway loops, wrong tool calls, and hallucinated arguments — with trace reading, stop conditions, and grounding.
What to put in Claude Code's context, what to leave out, and why — context-design lessons from a non-technical PM who shipped an app in six weeks.
How to wire tools and MCP servers into Claude Code: keep auth in the server, write typed schemas, return structured errors, and make every tool idempotent.
Reusable code-level patterns for Claude Code: outcome-plus-check prompts, narrow typed tools, layered context, and Skills that made a six-week build reliable.
A concrete week-by-week walkthrough of how a non-technical PM built, tested, and deployed a real app with Claude Code and MCP in six weeks.
The end-to-end architecture that let a non-technical PM ship a real app with Claude Code in six weeks: agent loop, tools, MCP, and context grounding.