Testing & Operations

This section covers the full lifecycle of an AI Employee from pre-launch testing through post-launch monitoring, auditing, and continuous improvement.

In This Section

Testing & Evaluation

• Testing AI Employees -- How to build test datasets, run progressive tests, and validate AI Employees before launch.
• Evaluating AI Employees -- Running evaluation suites with scoring criteria and interpreting results.

Launch

• Launch Checklist -- Pre-launch verification steps organized by phase.
• Launching & Monitoring -- Post-launch rollout, user onboarding, and adoption tracking.

Debugging

• Debug Logs -- Reading and using debug logs to inspect workflow execution.

Metrics & Auditing

• Chat Metrics -- Tracking usage, feedback, and tool call metrics for chat AI Employees.
• Auditing Chat AI Employees -- Reviewing conversations, providing feedback, and tracking resolution.
• Metrics & Insights -- Overview of per-AI-Employee metrics by trigger type.

Operations

• Seamless Upgrade -- Safely testing and deploying changes to live AI Employees.

Configuration

• Chatbot Logo Configuration -- Upload and manage a brand logo for embedded chatbots.
• Customize In-Progress Messages -- Configure live progress updates shown to users while the AI Employee processes a request.