foundry_task_adherence: Check an agent transcript for task adherence

In foundryR: Data Frame Workflows for 'Microsoft Foundry'

Check an agent transcript for task adherence

Description

Evaluate whether an agent's tool calls and responses stayed aligned with the user's request using the Azure AI Content Safety task-adherence detector. This flags agents that take unrequested or unsafe actions.

Usage

foundry_task_adherence(
  messages,
  tools = NULL,
  endpoint = NULL,
  api_key = NULL,
  api_version = "2025-09-15-preview"
)

Arguments

messages	List. The conversation turns to analyze. Build each turn with foundry_agent_message(), or supply raw lists matching the Content Safety schema.
tools	List. Optional tool definitions available to the agent. Build each with foundry_agent_tool(), or supply raw lists. Default NULL.
endpoint	Character. Optional Content Safety endpoint.
api_key	Character. Optional Content Safety key.
api_version	Character. API version. Defaults to "2025-09-15-preview".

Value

A tibble with one row:

task_risk_detected

Logical. TRUE when misaligned tool use was detected.

details

Character. Explanation of the detected risk, or NA when none.

raw_response

List. The parsed API response.

Preview API

This operation is documented only in the Azure AI Content Safety Learn quickstart and has no published OpenAPI specification. It requires the 2025-09-15-preview api-version and its contract may change.

Examples

## Not run: 
# Requires a configured Azure Content Safety endpoint and credentials
# with access to the task-adherence preview API.
foundry_task_adherence(
  tools = list(
    foundry_agent_tool("get_credit_card_limit", "Get the user's credit limit")
  ),
  messages = list(
    foundry_agent_message("Prompt", "User", "What is my limit?"),
    foundry_agent_message(
      "Completion", "Assistant", "Checking now",
      tool_calls = list(
        foundry_agent_tool_call("get_credit_card_limit", id = "call_001")
      )
    )
  )
)

## End(Not run)

foundryR documentation built on Sept. 25, 2026, 1:10 a.m.