Skip to main content
Use a deterministic metric to check a fixed fact of the conversation without writing a prompt. Each of these metrics returns Pass or Fail, and no LLM grades it. To create one, click Create on the Metrics page, then Create manually, and set Type to the metric you want.

Phrase Match

Checks whether specific words were said in the transcript. The Create Metric dialog with Type set to Phrase Match and one phrase entered The Create Metric dialog with Type set to Phrase Match and one phrase entered
  • Add each phrase under Phrases. A phrase matches its words in order within one sentence, so a phrase split across two sentences does not match.
  • To fail the metric when a phrase is said, such as a word the agent must never use, turn off Pass when the phrase is said.
  • For a pattern that phrases cannot describe, click Write a regular expression instead.

Tool Call

Passes when the agent called every tool you list. The Create Metric dialog with Type set to Tool Call and one tool name added The Create Metric dialog with Type set to Tool Call and one tool name added
  • Under Tool name(s), add each tool by the name your agent sends in tool_calls.
  • A transcript does not show tool calls, so send them to Bluejay with the conversation, as in Tool calls, events, and metadata.

Transfer Landed

Passes when the Digital Human you choose answers the transfer within a time limit counted from the start of the call. The Create Metric dialog with Type set to Transfer Landed, a receiving Digital Human ID, and a window in seconds The Create Metric dialog with Type set to Transfer Landed, a receiving Digital Human ID, and a window in seconds
  • In Receiving digital human ID, enter the ID of the Digital Human that the agent transfers to. The ID is in the URL of the Digital Human’s page.
  • Window (seconds) defaults to 180, and the maximum is 900.
Last modified on October 26, 2026