Skip to main content
Sync your Retell agents into Bluejay and run simulations against them, in either direction. Every tool call the agent makes during a conversation lands in Bluejay’s Tool Adherence tab.

Ways to connect

The synced (direct) integration handles both directions; the Bluejay agent’s type picks the path automatically: For the direct integration, steps 1 to 3 below are the same for both directions. Then jump to Inbound or Outbound.

Quick Prerequisites

  • Retell API Key with the Webhook badge
  • At least one Retell agent
  • A Bluejay Account

Setup (both directions)

1. Generate Your Retell API Key

  1. In Retell, go to Settings then API Keys, and generate a new API key.
  2. Ensure the key has the Webhook badge next to it (Bluejay uses it to verify webhook signatures).

2. Set the Webhook URL on Your Retell Agent

  1. In Retell, open your agent and click Webhook Settings.
  2. Paste this URL into Agent Level Webhook URL:
  1. Keep the default events enabled: call_started, call_ended, call_analyzed.
  2. Save and publish the agent.

3. Save Your Key in Bluejay and Sync

  1. In Bluejay, go to Settings, then Integrations, then the Retell tab.
  2. Paste your Retell API key and click Save Changes.
  3. Click Sync Agents from Retell and confirm in the prompt.
  4. Within 5 to 15 seconds, every Retell agent in your workspace appears in Bluejay as a native agent.
Faster path: click the + button in the top left of Bluejay, select Retell, paste your API key, and click Save and Sync.

Inbound: run it

Your agent answers; the Digital Human calls in. Nothing else to configure.
  1. Open your synced agent in Bluejay and confirm its type is Inbound.
  2. Go to the Simulations page, click Create in the top right, and select your synced agent, then open the Goal Adherence Rate tab and click Auto-generate to create Digital Human personas from your agent’s prompt. Pick how many you want and click Save.
  3. Click Generate Digital Human and confirm it’s selected.
  4. Back in the Simulations tab, click Run on the simulation, then click Run calls (the button shows the call count, e.g. “Run 3 calls”).
  5. When the call finishes, review the transcript, tool calls, and metric scores.

Outbound: bind a number, then run

Your agent dials; the Digital Human answers. Bluejay uses your Retell API key to tell Retell to place the call, so the agent needs a number to dial from.

1. Bind a phone number to your agent in Retell

  1. In Retell, go to Phone Numbers and click into your phone number.
  2. Set both Inbound Call Agent AND Outbound Call Agent to your agent.
  3. Save.

2. Set the Bluejay agent to Outbound

Open the synced agent in Bluejay and set its type to Outbound. The Connection tab shows the number bound in Retell.

3. Run it

Create a simulation the same way as inbound (each Digital Human needs a phone number for your agent to dial). Then, in the Simulations tab, click Run on the simulation and click Run calls (the button shows the call count, e.g. “Run 3 calls”). Bluejay tells Retell to dial each Digital Human from your bound number, and the calls place automatically.

Phone connection

If your Retell agent is bound to a phone number, you can also skip the integration entirely and test it the way a real caller reaches it.
  1. Create an agent in Bluejay with type Inbound, mode Voice, and the Phone connection type.
  2. Paste the agent’s Retell phone number in full international format (e.g. +15551234567).
  3. Create a simulation and run it. Bluejay dials the number and the Digital Human holds the conversation.
Use this when you specifically want to exercise the real telephony path: carrier audio, DTMF, the exact number your customers dial. The tradeoff: tool calls aren’t linked to the result over a plain phone call, so results cover the conversation itself (transcript, recording, metrics). For tool call capture, use the synced integration above.

Caveats

Resources

Self-Improve

Let Bluejay automatically diagnose failures and improve this agent’s prompt.

Simulation Overview

Learn how simulations work in Bluejay end-to-end.

Tool Calls

Understand how Bluejay handles tool call enrichment.

Digital Humans

Configure the personas that converse with your agents.

Retell Observability

Set up production call evaluation with the Retell webhook.