Skip to main content
Prerequisites: You’ll need an active Tuner account to follow this guide. Sign up here if you haven’t already.

Overview

Here’s what we’ll accomplish:
1

Set up Retell / Vapi keys (if needed)

For Retell or Vapi, add your platform key in Workspace Settings before you create an agent.
2

Create Your Agent

Add New Agent, enter name, Agent ID, and provider, then set up with MCP or blank.
3

Send Your First Call

Make a test call or send sample data to verify the integration.
4

Customize Your Agent

Review and edit what MCP created, or configure manually if you started blank — outcomes, intents, evaluations, alerts.
Estimated time: 5 minutes from start to finish

Step 1: Set up workspace keys

For Retell and Vapi, add your platform API key under Workspace SettingsAPI Keys & Integrations before you create an agent.
Choose the tab that matches how you ingest calls:

Retell API key

  1. In the Retell dashboard, create or copy an API Key from SettingsAPI Keys.
  2. In Tuner, open Workspace Settings (gear icon in the sidebar).
  3. Under API Keys & Integrations, paste your key into Retell API Key, then click Save Changes.
Full walkthrough (Agent ID + create agent after keys): Connecting to Retell.

Step 2: Create Your Agent

If you use Retell or Vapi, save you platform API keys in Workspace Settings first. See Step 1.
In the sidebar, click the Add New Agent. button

Choose your integration

No-Code (Retell)

Connect your Retell account — Tuner receives call data automatically. ~2 min

No-Code (Vapi)

Connect your Vapi account — Tuner receives call data automatically. ~2 min

Custom API

Use our LiveKit SDK or Pipecat SDK (~2 min), or send data via the REST API directly (~5 min).

Fill in the form and create the agent

In the Create a New Agent modal, complete the required fields:
  1. Agent Name — A display name for this agent in Tuner.
  2. Call DirectionInbound or Outbound, depending on how the agent is used.
  3. Providerretell, vapi, or API, matching how call data reaches Tuner.
  4. Agent Remote ID — How this works depends on your provider:
    • Retell / Vapi: Copy the agent ID from your provider’s dashboard and paste it here. The Agent Remote ID must match the identifier used in your voice platform so calls map to the right agent in Tuner
    • Custom API / LiveKit / Pipecat: Tuner auto-generates this for you. You’ll use it in your API requests.
  5. Click Create agent.

Set up your agent (MCP or blank)

After the agent is created, you’ll see How do you want to configure this agent? Choose how to finish setup:
  • Configure via MCP (recommended) — Use your IDE (Cursor, Claude Code, Antigravity) or a chat app with the Tuner MCP server so MCP can generate and update outcomes, intents, evaluations, and alerts. Recommended for complex agents.
  • Start from blank — Configure those items manually inside Tuner.
Click Continue after you choose. You can also pick I’ll do this later and configure from Agent Settings when you’re ready.

Step 3: Send Your First Call

Make a Test Call

With your Retell account connected, simply make a test call to your Retell agent. The call data will automatically appear in Tuner within seconds.
  1. Trigger a call to your Retell agent
  2. Complete a short conversation
  3. End the call

View Your Call in the Dashboard

Navigate to Call Logs in the sidebar. Your test call should appear within a few seconds. Click on it to see the full monitoring results, including:
  • Transcript with speaker labels
  • Call duration and metadata
  • Evaluation results (once configured)

Step 4: Customize Your Agent

Now that your integration is working, refine how Tuner monitors and analyzes calls. Open Agent Settings by clicking the gear icon next to your agent name. What you do here lines up with Step 2:
  • If you chose Configure via MCP — The Tuner MCP server can generate call outcomes, user intents, evaluations, guardrails, alerts, and related settings from your IDE or chat. In Agent Settings, review what was created, edit anything that should change, and add what is still missing. You can keep iterating with MCP or edit everything directly in the dashboard.
  • If you chose Start from blank — You define the same pieces yourself in Agent Settings. Nothing is assumed; you have full control to build outcomes, intents, evaluations, and alerts from scratch.
Both paths use the same tabs and screens below—you are either polishing MCP-generated configuration or filling it in by hand.

Define Call Outcomes

Specify what “Success” and “Failure” mean for your agent. For example:
OutcomeTypeDescription
Appointment BookedSuccessUser successfully scheduled an appointment
User Hung UpFailureUser ended the call before completing their goal
Transferred to HumanNeutralCall was escalated to a human agent

Set Up User Intents

Define the possible reasons users might call your agent:
  • Schedule Appointment
  • Reschedule Appointment
  • Cancel Appointment
  • General Inquiry

Create Custom Evaluations

Add specific checks to evaluate agent behavior on every call. For example:
  • “Did the agent confirm the appointment details?”
  • “Did the agent offer alternative times if the requested slot was unavailable?”

Configure Alerts

Set up real-time notifications to get alerted when critical issues occur:
  • Email alerts for failed calls
  • Slack notifications for evaluation failures
For MCP-driven setup and updates, see Configure Your Agent Using Tuner MCP. For dashboard-only workflows, see Classifying Calls and Configuring Alerts.

🎉 Congratulations!

You’ve successfully integrated your voice AI with Tuner! Here’s what you’ve accomplished: ✅ Saved Retell or Vapi keys in Workspace Settings when using those providers ✅ Created your first agent ✅ Verified the integration with a test call or request ✅ Learned how to customize your agent — review MCP-generated config or edit settings you built from Start from blank

What’s Next?

Now that your integration is complete, explore these resources to get the most out of Tuner:

Connecting to Retell

Detailed guide for Retell integration.

Connecting to Vapi

Detailed guide for Vapi integration.

Connecting to LiveKit

SDK integration for LiveKit Agents.

Connecting to Pipecat

SDK integration for Pipecat Flows.

Custom Integration Guide

Deep dive into API integration options.

Classifying Calls

Set up call outcomes and user intents.

Best Practices

Tips for effective agent monitoring.