Prerequisites: You’ll need an active Tuner account to follow this guide. Sign up here if you haven’t already.
Overview
Here’s what we’ll accomplish:Set up Retell / Vapi keys (if needed)
For Retell or Vapi, add your platform key in Workspace Settings before you create an agent.
Step 1: Set up workspace keys
For Retell and Vapi, add your platform API key under Workspace Settings → API Keys & Integrations before you create an agent.
- No-Code (Retell)
- No-Code (Vapi)
- LiveKit, Pipecat & Custom API
Retell API key
- In the Retell dashboard, create or copy an API Key from Settings → API Keys.
- In Tuner, open Workspace Settings (gear icon in the sidebar).
- Under API Keys & Integrations, paste your key into Retell API Key, then click Save Changes.
Full walkthrough (Agent ID + create agent after keys): Connecting to Retell.
Step 2: Create Your Agent
If you use Retell or Vapi, save you platform API keys in Workspace Settings first. See Step 1.
Choose your integration
No-Code (Retell)
Connect your Retell account — Tuner receives call data automatically. ~2 min
No-Code (Vapi)
Connect your Vapi account — Tuner receives call data automatically. ~2 min
Custom API
Use our LiveKit SDK or Pipecat SDK (~2 min), or send data via the REST API directly (~5 min).
Fill in the form and create the agent
In the Create a New Agent modal, complete the required fields:- Agent Name — A display name for this agent in Tuner.
- Call Direction — Inbound or Outbound, depending on how the agent is used.
- Provider — retell, vapi, or API, matching how call data reaches Tuner.
-
Agent Remote ID — How this works depends on your provider:
- Retell / Vapi: Copy the agent ID from your provider’s dashboard and paste it here. The Agent Remote ID must match the identifier used in your voice platform so calls map to the right agent in Tuner
- Custom API / LiveKit / Pipecat: Tuner auto-generates this for you. You’ll use it in your API requests.
- Click Create agent.
Set up your agent (MCP or blank)
After the agent is created, you’ll see How do you want to configure this agent? Choose how to finish setup:- Configure via MCP (recommended) — Use your IDE (Cursor, Claude Code, Antigravity) or a chat app with the Tuner MCP server so MCP can generate and update outcomes, intents, evaluations, and alerts. Recommended for complex agents.
- Start from blank — Configure those items manually inside Tuner.
Step 3: Send Your First Call
- No-Code (Retell)
- No-Code (Vapi)
- SDK (LiveKit)
- SDK (Pipecat)
- API Integration
Make a Test Call
With your Retell account connected, simply make a test call to your Retell agent. The call data will automatically appear in Tuner within seconds.- Trigger a call to your Retell agent
- Complete a short conversation
- End the call
View Your Call in the Dashboard
Navigate to Call Logs in the sidebar. Your test call should appear within a few seconds. Click on it to see the full monitoring results, including:- Transcript with speaker labels
- Call duration and metadata
- Evaluation results (once configured)
Step 4: Customize Your Agent
Now that your integration is working, refine how Tuner monitors and analyzes calls. Open Agent Settings by clicking the gear icon next to your agent name. What you do here lines up with Step 2:- If you chose Configure via MCP — The Tuner MCP server can generate call outcomes, user intents, evaluations, guardrails, alerts, and related settings from your IDE or chat. In Agent Settings, review what was created, edit anything that should change, and add what is still missing. You can keep iterating with MCP or edit everything directly in the dashboard.
- If you chose Start from blank — You define the same pieces yourself in Agent Settings. Nothing is assumed; you have full control to build outcomes, intents, evaluations, and alerts from scratch.
Define Call Outcomes
Specify what “Success” and “Failure” mean for your agent. For example:| Outcome | Type | Description |
|---|---|---|
| Appointment Booked | Success | User successfully scheduled an appointment |
| User Hung Up | Failure | User ended the call before completing their goal |
| Transferred to Human | Neutral | Call was escalated to a human agent |
Set Up User Intents
Define the possible reasons users might call your agent:- Schedule Appointment
- Reschedule Appointment
- Cancel Appointment
- General Inquiry
Create Custom Evaluations
Add specific checks to evaluate agent behavior on every call. For example:- “Did the agent confirm the appointment details?”
- “Did the agent offer alternative times if the requested slot was unavailable?”
Configure Alerts
Set up real-time notifications to get alerted when critical issues occur:- Email alerts for failed calls
- Slack notifications for evaluation failures
For MCP-driven setup and updates, see Configure Your Agent Using Tuner MCP. For dashboard-only workflows, see Classifying Calls and Configuring Alerts.
🎉 Congratulations!
You’ve successfully integrated your voice AI with Tuner! Here’s what you’ve accomplished: ✅ Saved Retell or Vapi keys in Workspace Settings when using those providers ✅ Created your first agent ✅ Verified the integration with a test call or request ✅ Learned how to customize your agent — review MCP-generated config or edit settings you built from Start from blankWhat’s Next?
Now that your integration is complete, explore these resources to get the most out of Tuner:Connecting to Retell
Detailed guide for Retell integration.
Connecting to Vapi
Detailed guide for Vapi integration.
Connecting to LiveKit
SDK integration for LiveKit Agents.
Connecting to Pipecat
SDK integration for Pipecat Flows.
Custom Integration Guide
Deep dive into API integration options.
Classifying Calls
Set up call outcomes and user intents.
Best Practices
Tips for effective agent monitoring.