Hang up on transfer is on by default
New simulations now hang up when the agent transfers the call, so a Digital Human never reaches your live team by accident. This applies to simulations created in the app, through Create Simulation and through Bluejay as Code. Passhangup_on_transfer: false to let transfers through. Existing simulations keep their setting.Create SimulationDigital Human tags
Thetag query parameter on GET /v1/digital-humans and the tag field on Create and Update Digital Human are deprecated. They stop working November 11, 2026. Use tags instead. A request that still uses tag returns a warning field in the response.The tags filter ignores case and accepts several tags. Repeat the parameter, as in ?tags=a&tags=b, or pass a JSON list. A Digital Human must have every tag you list.The tag field on Digital Human responses stays for now.List Digital Humans · Create Digital Human · Update Digital HumanAgent variables
Set values once on an agent in Agent Variables on the Simulation Settings tab, and every Digital Human of that agent uses them on its next run. A Digital Human’s trait with the same name overrides an agent variable. Write{{name}} in success criteria, intent, description, or personality, and Bluejay fills in the value before the Digital Human and the grader see it, for voice and text.Synced Retell conversation flow and ElevenLabs agents fill their agent variables from the provider’s default dynamic variables when they have none yet.Agent variables · Update Agentincident.io paging
Alerts and uptime monitors can now page through incident.io. Create an HTTP alert source in incident.io, paste its source ID and token under Settings → Integrations, then switch on incident.io Notifications on any alert or monitor. DOWN fires an alert and recovery resolves it.incident.io setupPersonas
A Digital Human is one test case, and personas are who calls. Give a Digital Human several personas and it runs once as each, so one test covers every kind of caller. Edit a persona once and every Digital Human that runs as it uses the change.Personalities are now personas. A simulation that had Personalities selected has those personas on each of its Digital Humans. The Digital Humans tab is now Test Cases, and uploading your own test cases is the quickest way to start.Digital Human Reference · Personas · Upload CSVSimulation plans
Say what to test, and Bluejay reads your agent, its calls and your existing tests, then writes a plan of test cases and the personas that call. Edit it by chat, comments or typing in place, compare versions, and generate the Digital Humans when it looks right.Create a SimulationPersonas in the API, MCP and Bluejay as Code
New/v1/personas endpoints and MCP tools. Digital Human create, update, bulk and generate take persona_ids, and reads return them. Bluejay as Code files carry a personas list.Removed: /v1/personalities and the simulation personalities endpoints. Use personas on each Digital Human instead.Personas API · Update Digital Human · Bluejay as CodeBluejay as Code in YAML
Bluejay as Code now reads and writes YAML. Pull withformat=yaml and push with Content-Type: application/yaml. System prompts and other long text come back as multi-line blocks, so a pull request shows a prompt change line by line.Deprecated: JSON payloads, on November 20th, 2026.Bluejay as Code · Move from JSON to YAMLA new look for the docs
We rebuilt these docs to be shorter, clearer, and easier to get around. Every page now matches the product, related pages are merged into one place, and the new quickstart gets your agent tested in a few steps. Old links still work, so your bookmarks take you to the right page.Quickstart · Glossary · MCP ServerItemized success criteria
Success criteria are bullets now. Each bullet is a workspacesuccess_criterion metric. Bluejay grades each expected behavior met / not met, stores success_score as passed-count / max_value, keeps overall pass/fail at 100%, and reports criteria_pass_rate (0–100) on /v2 retrieve./v1 digital human get, create, update, generate, and retrieve stay a string and a boolean. There is no public /v2 generate route yet.Success Criteria · Retrieve Results v2API key on HTTP text messages
POST /v1/send-http-text-message now requires your API key on every request. Send it as X-API-Key or Authorization: Bearer with each message and each tool-call log.A request without a key returns 401. A key from another organization, or a key limited to a workspace that doesn’t own the simulation, returns 404.If your agent already sends the same key you use to queue the simulation, nothing changes.Send HTTP Text Message · Chat testingAgent versions
New: agent versions live at/v1/agents/{id}/versions (create, list, get, delete, promote, labels).Same as before: POST /v1/evaluate and /evaluate-call. New optional integer version. label still works. Omit version and we use the version that currently has the production label. An unknown version uses the production version and returns a warning. An unknown label is created and attached to the production version.Deprecated: /v1/agents/{id}/prompts paths still work. Get-by-label stays on GET /prompts?label= (no /versions twin).New: create/queue simulation accepts agent_version_id.Deprecated: prompt_id on create/queue simulation. Same uuid, still works. If both are sent and they differ, the request is 400.Evaluate · Create Agent VersionBetter Stack paging
Alerts and uptime monitors can now page through Better Stack alongside PagerDuty. Paste a Better Stack Uptime API token under Settings → Integrations, then switch on Better Stack Notifications on any alert or monitor. DOWN opens an incident and recovery resolves it, with nothing to configure on the Better Stack side.Better Stack and PagerDuty setupIssues
Production failures now group into Issues you can triage. Patterns appear once the same problem recurs across calls, with a title. Known errors (a tool 500, a tool that should have run but never did) appear as soon as they are recognized. Open Monitor → Issues for the full list, grouped by status. The list is not paginated.Issues · Monitor → Issues · List Issues APITopics (early access)
Bluejay now clusters what’s happening across your production calls automatically. The Topics map is an interactive view of what your callers talked about: pan, zoom, search, and see trends against the prior window. Rolling out to select organizations first. Contact us for access.LogsExpanded language coverage
Digital Humans picked up a wave of new languages and dialects this summer: Urdu, Hebrew, Tagalog, Telugu, Tamil, Malayalam, Kannada, Marathi, and Gujarati, plus Egyptian and Levantine Arabic with native dialect voices. Vietnamese and Cantonese voice coverage was also filled out, and every non-English language received dialect-aware prompting for more authentic speech.Digital Humans overviewCustom SIP headers
Simulations can now attach custom SIP headers to the calls they place. Headers configured on the agent are delivered on the SIP INVITE, so agents behind infrastructure that routes or authenticates on custom headers can be tested exactly as they run in production.SIP connectionsCustom metrics judged on call audio
Audio custom metrics are now judged natively on the call recording by an audio-capable model, with optional knowledge-base grounding. Tone, pacing, pronunciation, and other things a transcript can’t capture are now first-class evaluation targets.Custom metrics overviewOutbound call-outcome metrics & spoken-phrase checks
Eight new library metrics for outbound calling: LLM-judged outcomes (human picked up, voicemail detected, transfer attempted, stuck call, abrupt termination, natural delivery) plus deterministic required-disclosure and prohibited-wording checks. Phrase metrics are authored by simply typing the words the agent must (or must not) say — Bluejay compiles the matching and absorbs ASR variance like punctuation and acronym spellings automatically.Metric typesPipecat improvements
Bluejay’s Pipecat Cloud integration now sends the run’s metadata in the start-call body, so your Pipecat agent can identify and branch on the Bluejay test run that’s calling it. Sessions also end cleanly when the agent hangs up or fails to start, instead of waiting for a timeout.Pipecat simulationsBland integration
Bland is now a fully supported provider. Connect from Create Agent with inline API key setup, pick a Conversational Pathway, and pull, edit, push, and publish pathway versions from an interactive canvas inside Bluejay. Simulations run over Bland’s native voice bridge (with PSTN dialing also supported) and record the exact path each call took through the pathway graph, and Bland production calls can be ingested into observability.Bland Observability · Bland SimulationsNatural-language log filtering
Filter your call logs by just typing. Plain-English queries are translated into structured log filters automatically, on top of the freeform full-text search over call summaries that shipped earlier in July.LogsAmelia integration
Test Amelia agents on Bluejay over both chat and voice. Enter your Amelia credentials in Settings → Integrations, pick a domain and flow, and sync agents into Bluejay. You can view and edit the agent’s flow on an interactive canvas and push changes back to Amelia.Amelia integrationDashboard widgets: histograms, filters, and 32 new metrics
A major dashboard upgrade: a histogram widget for numeric metric distributions, 32 newly graphable metrics in the widget dialogs, distribution aggregation for integer-scale custom metrics, per-widget conversation filters, metadata Group By, and click-a-threshold-bar to filter the explorer to that group. The Logs page also gained a Table | Chart toggle to chart whatever view you’ve filtered to.DashboardsHuman review overrides
Reviewers can override an automated metric verdict by hand. The human correction is stored alongside the original AI grade — both are preserved — and corrected values show up everywhere: tables, aggregates, and reports.Custom metrics overviewBluejay in Slack
Ask Bluejay about your agents, simulations, and production conversations directly from Slack. The per-org Slack bot supports threaded follow-ups without re-tagging, works in externally shared channels, and performs write actions safely via one-click approval messages.Bluejay in SlackOutbound trigger webhook
For agents that dial out from your own system, configure a trigger webhook in agent settings: Bluejay calls it to tell your infrastructure to place the call (or send the SMS) to the Digital Human. Works with any provider, so outbound agents are testable without Bluejay controlling the dialer.Google Cloud: selective sync & keyless setup
Choose exactly which Google Conversational Agents to sync (or toggle sync-all), and connect your Google Cloud project without service-account keys using least-privilege Workload Identity Federation, configured from the settings UI with a paste-and-run Cloud Shell flow.Keyless Google Cloud setupGrounded, customizable judging
LLM-judge custom metrics can now ground their evaluation in your knowledge base, so factual-accuracy metrics grade against your actual documentation. Standard hallucination and redundancy metrics accept per-org prompt overrides and are editable like custom metrics, and new default eval models improve text and audio judging quality.Prompting guideDigital Human management upgrades
A table view of Digital Humans with inline per-field editing, per-Digital-Human run history pages, duplicate-to-a-target-count, and two new generation sources: build Digital Humans from your knowledge base’s topics, or derive traits from your agent’s template variables so provider call variables are filled with each persona’s data.Digital Humans overviewTrace view v2 with token costs
A redesigned trace experience: per-leg latency dashboards, a rebuilt trace side panel with a standalone full view, and trace export alongside simulation results. Model spans now show token usage (input/cached/output, text/audio splits) with estimated cost per model and trace-level totals. ElevenLabs agent traces are ingested via OpenTelemetry, so their tool calls and spans appear like any other provider’s.TracesSelf-serve signup
Bluejay is open to self-serve signups. Sign up with email verification, land in a redesigned onboarding flow with Bluejay AI as your first experience, and start testing immediately against seeded sample agents — including read-only “Bug Bounty” challenge agents built to be probed.QuickstartMetrics Library
An app-store-style library at /metrics: browse standard and community-published metric templates, preview them, rate them, and add them to your org in one click. You can publish your own metrics to the library through a review queue, and My Metrics was restructured to match.Custom metrics overviewRed teaming revamp
A rebuilt red-team experience: a dedicated launch flow and results page with an OWASP/ATLAS-mapped scorecard and leak table, opt-in content-safety attacks as a distinct attack category, audio-native attacker behaviors, keypad (DTMF) attacks, and extension support for targets behind IVRs.Red teaming · Content safetyImport workflow diagrams & IVR test plans
Drop a workflow diagram (for example an IVR flowchart image) into Bluejay AI and it becomes an editable Agent Workflow with a generated checklist-style test plan covering the flow’s paths. Step-based IVR test-plan exports import too: Bluejay turns them into transcript-replay Digital Humans, so existing IVR test scripts become runnable simulations.Agent workflowsMultimodal journeys & follow-up SMS
Customer journeys can now mix voice and SMS — for example an SMS leg that ends when the call leg starts — with per-step success criteria and transition guards. Follow-up SMS gets full configuration: call association, a sender allowlist on the Phone Numbers page, and a per-simulation SMS inactivity timeout.Customer journeys · Follow-up SMSSmarter call endings
Whether a simulated call should end is now decided by a consensus of judges, with a transfer-intent classifier gating hangups on transfer — so Digital Humans stop hanging up prematurely on ambiguous turns. Chat simulations gained the same discipline: conversations no longer end while the agent’s question is still pending.Pay-as-you-go, auto-reload & plan limits
New orgs are provisioned straight onto pay-as-you-go with billing attached at signup, with an optional automatic credit top-up and a wallet-balance view. The billing tab was redesigned with new plan cards, credit codes are redeemable, plan switches reuse your saved card, and unused base allotment rolls over as credit. Plan entitlements — phone number counts, simulation concurrency, data retention — are now enforced in real time.Uptime Monitoring
Continuous health checks for production agents: Bluejay periodically places real calls (or SMS/webchat sessions) against your agent, detects incidents, and alerts on failures — Slack with optional @channel, a configurable consecutive-failure threshold, and latency tracking with 7-day aggregates. Health checks can run full conversations with your own Digital Human, grade with your custom metrics, respect day/hour active windows, and be paused and resumed.Uptime monitoringCustom telephony connections
For orgs with their own telephony: Bluejay can call a webhook you host at dial time to fetch a per-call SIP endpoint (dynamic routing, ephemeral endpoints), LiveKit agents can authenticate via API key or a token webhook, and outbound simulations can admit authenticated inbound SIP — so setups where your infrastructure originates or routes the call are fully testable.Dynamic SIP webhookTool Call metric & tool adherence
A new tool_call metric type deterministically checks whether the agent called the right tools — pick tool names from a combobox, no LLM prompt needed. Tool adherence supports expected tool calls with parameter comparison and an order-enforcement toggle, and grading waits for the expected tools’ traces to arrive before scoring.Tool callsVapi squads & Retell conversation flows
Multi-assistant Vapi squads render as editable workflow canvases, Retell conversation flows get a dedicated editor, and auto-sync keeps Retell, Vapi, and ElevenLabs agents current — with an org-level toggle controlling re-sync before every simulation.Vapi simulations · Retell integrationSelf-improve for Vapi agents
Bluejay can close the test-fix-retest loop for Vapi agents: it analyzes failed results, proposes prompt improvements, applies them, and announces runs when they finish.Self-improveUsage alerts
Get notified when your org crosses credit-usage thresholds, framed by credits remaining. Every org is seeded with default alerts at 80% and 100% of its allotment, with recipient selection including your whole team.Alerts overviewVoice scenes
Describe a voice as a scene — “tired commuter on a train” — and Bluejay generates a matching custom voice with bundled background ambience, giving Digital Humans situationally realistic audio.Digital Humans overviewCross-agent run comparison
Compare simulation runs across different agents: stage runs into a comparison tray that persists as you browse, then open a side-by-side comparison — with PDF export and instant email send.Simulation runsSimulation run controls
Finer control over how simulations run: a delay-between-tests setting, concurrency capped to your phone-number pool and org ceiling, an org-level max call length with per-simulation override, a per-simulation inactivity timeout, and scheduling restricted to chosen days and hours.CHIRP playback acknowledgments
The CHIRP websocket protocol gained a mark message: agents integrating over CHIRP receive playback acknowledgments confirming when queued audio has actually been played to the caller, enabling precise turn-taking and barge-in handling.Websocket connectionsGoogle Dialogflow CX integration
Run simulations against Dialogflow CX agents end-to-end. Connect your Google Cloud project via Service Account key, point Bluejay at your CX agent, and Bluejay handles session orchestration, audio transport, and evaluation. Outbound dialing, per-agent CES region, and CX-specific dispatch are all supported.Dialogflow CX simulationsKore.ai integration
Bluejay now integrates with Kore.ai for both simulations and observability. Connect your Kore platform host, bot ID, and webhook app credentials on the agent’s connection settings to start testing Kore-powered conversational agents.Kore.ai integrationRetell outbound support
Retell-connected agents can now run as outbound. Bluejay auto-derives the agent’s type (inbound vs. outbound) from your Retell bindings on sync, provisions always-on SIP for outbound Digital Humans, and preserves the synced phone number across connection saves. Outbound Digital Humans default to not speaking first.Retell integrationRetell observability + simulations refresh
We rewrote the Retell Observability page around the new UI flow and expanded the Retell Simulations guide with quick-sync steps, metrics coverage, and updated walkthroughs.Retell Observability · Retell SimulationsVapi simulations
Run simulations directly against Vapi assistants. Bluejay connects to your Vapi assistant, drives the conversation with a Digital Human, and evaluates the resulting transcript with your custom metrics.Vapi simulationsAudio quality metrics (Tyto risk score)
Call logs now include a Tytorisk_score as a headline audio-quality signal alongside latency and custom metrics. The score is plumbed end-to-end through the eval DTOs and aggregated on the call logs view so you can sort and filter production conversations by audio risk.LogsPagerDuty alert channel
Threshold alarms can now page on-call via PagerDuty Events API v2 in addition to Slack, email, and webhook. Connect your PagerDuty integration key on the notifications page and route specific alarms to PagerDuty for incident-grade escalation.Alerts overviewPercentage alarms + simulation alerts
Threshold alarms now support percentage-based thresholds (e.g. alert when goal success drops below 80% of calls) in addition to absolute values, and you can scope alarms to simulation metrics as well as observability. Percentage alarms gracefully recover when no agents have calls in the window.Alerts overviewCustomer Journeys
Customer Journeys let you chain multiple simulated calls into a single multi-step scenario, with prior-call context (entities, knowledge, and state) carried across steps. Build journeys from the dashboard or define them in Bluejay-as-Code.Customer Journeys guide · Bluejay-as-CodeVoice cloning in simulations
Digital Humans can now speak with a cloned voice during simulations. Upload a voice sample on the Digital Human, and Bluejay will use that cloned voice for all simulation runs — useful for accent coverage, brand-voice testing, and replicating known caller profiles.Digital Humans overviewCustom background noise
Upload your own background noise audio to play under simulation calls. Test how your agent handles call-center hum, traffic, household noise, or any acoustic environment you care about, instead of relying only on the built-in profiles.Simulations overviewBulk CSV upload for Digital Humans
Create Digital Humans in bulk by uploading a CSV from the Digital Humans page. Each row maps to one Digital Human (persona, scenario, traits, and success criteria), so you can stand up large evaluation populations without scripting against the API.Digital Humans overviewScenario Builder split from Workflows
We split Scenario Builder (single-agent conversational scripts) from Workflows (multi-agent automation pipelines) across the docs and API reference. The Workflows API was renamed to the Scenario Builder API where it referred to single-agent scenarios; multi-agent workflow endpoints stay under Workflows.Scenario Builder overview · Workflows overviewSimulation Statuses reference
Added a dedicated Simulation Statuses reference page covering every terminal status, the error codes that map to each failure bucket, and what to do when a simulation lands in System Error. Useful when triaging failed runs or building dashboards on top of the API.Simulation statusesDTMF tool for Digital Humans
Digital Humans can now be configured to send DTMF tones during a call via a newallow_dtmf_tool field, aligned with how allow_end_call_tool and allow_silence_tool are stored and returned. Create and bulk-create default to allow_dtmf_tool: true when omitted; updates treat the field as optional (omit to leave unchanged). OpenAPI schemas DigitalHumanRequestData, DigitalHumanResponseData, and UpdateDigitalHumanRequest include the new property.Create Digital Human · Update Digital HumanRuns per Digital Human
Simulations now support executing multiple runs for each selected Digital Human in a single batch. Setruns_per_digital_human on the simulation (persisted in simulations.settings) to control the default, or pass an explicit per-run override when queuing a run. Values must be positive integers; when unset, each Digital Human runs once. The Bluejay dashboard exposes the new control on the simulation settings page and the “Create simulation” and “Create new run” dialogs.Simulations overviewDigital Human intelligence upgrade
We upgraded the reasoning quality of Digital Humans during both simulations and observability replays. Expect more coherent multi-turn behavior, better adherence to persona and objectives, and steadier tool-use decisions across longer conversations. No configuration changes are required — the upgrade applies automatically to all Digital Humans.Digital Humans overviewScripted silence in workflows
When a Digital Human is running in workflow mode, the silence tool now evaluates only at end-of-turn instead of firing from timeout-based checks mid-turn. This removes a class of false silence triggers on scripted workflow steps and keeps silence decisions aligned with the workflow’s turn boundaries. Non-workflow Digital Humans are unchanged.Workflows overviewWorkflow latency fix
Fixed a latency regression in workflow-mode conversations where session-handler state could delay turn transitions. Workflow runs now advance between agent and user turns without the extra wait, improving perceived responsiveness on branching paths.Workflows overviewDigital Human: silence tool fields
Digital Human create, read, update, delete, and bulk APIs now exposeallow_silence_tool and silence_tool_instructions, aligned with how allow_end_call_tool and hangup_instructions are stored and returned. Create and bulk-create default to allow_silence_tool: false and silence_tool_instructions: "default" when omitted; updates treat fields as optional (omit to leave unchanged). OpenAPI schemas DigitalHumanRequestData, DigitalHumanResponseData, and UpdateDigitalHumanRequest include the new properties.Create Digital Human · Update Digital HumanRedesigned Workflows
Workflows are a structured way to test your agent along a conversation path.- Agent and user turns — you define what the agent should say or do (so simulations can check it) and what the Digital Human says on each step.
- Branching — options nodes capture different things the caller might do next (speech, DTMF, silence).
- Coverage — each distinct path through the graph becomes its own Digital Human, so every branch gets exercised.
- Docs — cookbook and API reference refreshed; older workflow endpoints are under Deprecated.
Revamped documentation
We completely overhauled the Bluejay docs with improved navigation, expanded guides, and new content across the board. Highlights include:- Restructured navigation with dedicated tabs for Documentation, API Reference, and Changelog
- Expanded integration guides covering all supported providers and simulation transports
- Cookbook recipes for common workflows like GitHub Actions CI, API-driven evaluations, and webhook setup
SMS simulation support
Bluejay now supports SMS-based simulations, enabling you to test text-based agent flows end-to-end. Configure SMS simulations the same way you configure voice simulations — define Digital Humans, set up custom metrics, and run batch evaluations against your SMS agent.SMS simulations support all existing integrations including telephony providers and HTTP webhooks.Read the docsThreshold alarms
Set threshold-based alarms on any custom metric to get alerted when agent performance degrades. Define upper or lower bounds, choose your notification channel (Slack, email, or webhook), and Bluejay will trigger alerts automatically when production metrics cross your thresholds.Alarms work across both observability and simulation metrics, so you can catch regressions in production and in testing.Read the docsFaster call log evaluation
We made significant performance improvements to the observability evaluation pipeline:- 3x faster evaluation for call logs with custom metrics
- Parallel metric execution — multiple custom metrics now evaluate concurrently instead of sequentially
- Reduced API latency for the
/evaluateand/re-evaluateendpoints by approximately 40%
Miro integration for simulation visualization
You can now connect Bluejay to Miro to automatically generate visual conversation flow diagrams from your simulation results. Each simulation run produces a Miro board showing the conversation tree, branching paths, and metric outcomes.Connect your Miro workspace from the Integrations page in your Bluejay dashboard.Read the docsWorkflow scheduling improvements
Workflows now support cron-based scheduling with finer granularity. You can schedule simulation runs and observability evaluations to execute at specific intervals — hourly, daily, or on a custom cron expression.Additional improvements include:- Retry logic for failed workflow steps
- Execution history with detailed step-level logs
- Webhook notifications on workflow completion or failure
Community-based simulation runs
You can now run simulations against an entire community of Digital Humans in a single batch. Previously, simulations ran against individual Digital Humans or manually selected groups. Community-based runs let you test your agent against a diverse, pre-configured population in one click.Combine communities with custom metrics to get aggregate performance scores across demographic segments, persona types, or behavioral profiles.Read the docsCustom metric formulas
Custom metrics now support formula-based definitions in addition to LLM-as-a-Judges. Define metrics using arithmetic expressions over existing metric scores, enabling composite metrics like weighted averages or pass/fail thresholds without writing evaluation prompts.Formula metrics evaluate instantly and do not consume LLM credits.Read the docsPipecat integration
Bluejay now integrates natively with Pipecat for running simulations against Pipecat-powered voice agents. Connect your Pipecat pipeline endpoint and Bluejay will handle session orchestration, audio transport, and evaluation.Read the docsKnowledge base versioning API
The Knowledge Base API lets you create knowledge bases, add documents, and attach them to agents. Knowledge bases ground your agents’ answers and power hallucination detection during evaluation.Read the docsDashboard redesign
We redesigned the Bluejay dashboard with a focus on surfacing actionable insights. The new layout includes:- At-a-glance health scores for each agent across simulation and production metrics
- Trend sparklines showing metric performance over time
- Alert badges highlighting agents that need attention
- Quick-launch actions for running simulations and viewing recent call logs
ElevenLabs observability integration
Bluejay now supports direct observability integration with ElevenLabs Conversational AI. Connect your ElevenLabs account to automatically ingest call logs, evaluate them with custom metrics, and surface quality issues in your dashboard.Read the docsDigital Human generation improvements
The Digital Human generation engine has been upgraded with better persona diversity and more realistic conversational styles:- Expanded trait library with 40+ new customer traits including emotional tone, technical proficiency, and communication preferences
- Scenario-aware generation — Digital Humans now adapt their behavior based on the simulation scenario context
- Bulk generation — generate up to 100 Digital Humans in a single API call
Slack alerting integration
Connect Bluejay to Slack to receive real-time alerts when production metrics drop below thresholds or simulation runs complete. Configure per-channel routing so the right team gets the right alerts.Read the docsWebSocket simulation support
Bluejay now supports WebSocket-based simulations for testing real-time, bidirectional agent communication. Configure your WebSocket endpoint, define the message protocol, and run simulations with full transcript capture and metric evaluation.Read the docsPrompt versioning and labels
The Prompt API now supports versioning and labeling. Create multiple versions of a prompt, tag them with labels likeproduction or staging, and reference them by label in your agent configuration. Roll back to any previous version instantly.Read the docsWebhook-based log ingestion
You can now send call logs to Bluejay via webhook for evaluation. Configure a webhook endpoint in your dashboard, point your agent platform at it, and Bluejay will automatically ingest, evaluate, and store the results.This is the fastest way to get observability running if your platform isn’t covered by a native integration.Read the docsLiveKit simulation integration
Run simulations against LiveKit-powered voice agents. Bluejay connects to your LiveKit room, manages participant sessions, and captures full audio transcripts for evaluation.Read the docsMetrics Lab
Introducing Metrics Lab — an interactive environment for prototyping and testing custom metrics before deploying them. Write evaluation prompts, test them against sample transcripts, and iterate on scoring criteria without affecting production data.Read the docsFolder-based agent organization
Agents can now be organized into folders for better workspace management. Create folders, move agents between them, and filter your agent list by folder. Folders are available in both the dashboard and the API.Read the docsRetell observability integration
Bluejay now integrates directly with Retell for production call monitoring. Connect your Retell account to automatically pull call logs, run evaluations, and track agent performance over time.Read the docsVapi observability integration
Bluejay now integrates with Vapi for production call monitoring. Connect your Vapi account to automatically ingest call logs, run custom metric evaluations, and track agent quality over time.Read the docsBland observability integration
You can now connect Bluejay to Bland for production observability. Call logs from your Bland-powered agents are automatically ingested, evaluated against your custom metrics, and surfaced in the dashboard.Read the docsCommunities and workflows API endpoints
New API endpoint groups for managing communities and workflows:- Communities — create, update, add members, list, and delete communities programmatically
- Workflows — define, schedule, and manage automation workflows through the API
SIP simulation integration
Bluejay now supports SIP-based simulations. Connect your SIP trunk and run simulations directly over the SIP protocol, enabling testing for enterprise telephony deployments and contact center agents.Read the docsTelephony simulation support
Run simulations over PSTN by connecting your telephony provider to Bluejay. Dial into your agent’s phone number, capture the full conversation, and evaluate it with custom metrics — all without changing your agent’s infrastructure.Read the docsObservability and evaluation API endpoints
New API endpoint groups for observability and evaluation workflows:- Observability — evaluate and re-evaluate call logs, manage call log lifecycle
- Custom Metrics — create, bulk-create, update, list, and delete custom metrics via API
Digital Humans and simulation runs API endpoints
New API endpoint groups for simulation orchestration:- Digital Humans — create, generate, update, list, and manage Digital Human personas
- Simulation Runs — queue voice and SMS runs, retrieve results, and manage active conversations
Agents and simulations API endpoints
The first set of public API endpoints is now available:- Agents — create, update, list, move, and delete agents
- Simulations — create, configure, list, and manage simulations programmatically