Operate

Monitor, test, and optimize your agents at scale.

This section provides tools and best practices for running production agents, from testing and quality assurance to analytics and cost optimization.

Monitor and optimize

GoalGuideDescription
List users by external IDUsersSee end users and open their conversations
Search transcriptsSearching conversationsKeyword and semantic search in Conversation history
Run A/B testsExperimentsTest agent configuration changes with live traffic
Test agent behaviorTestingCreate and run automated tests for your agents
Analyze conversation qualityConversation analysisExtract insights and evaluate conversation outcomes
Track metrics & analyticsAnalyticsMonitor performance metrics and conversation history
Configure data retentionPrivacySet retention policies for conversations and audio
Reduce LLM costsCost optimizationMonitor and optimize language model expenses
Manage agents as codeCLIVersion control and deploy agents from your terminal
Manage agents from ClaudeHosted MCPCreate and update agents from any MCP client

Next steps