foundry_grader_label_model: Label-model grader

In foundryR: Data Frame Workflows for 'Microsoft Foundry'

Label-model grader

Description

Use a model to assign one of a fixed set of labels to each row, then treat a subset of those labels as passing. The model must support structured outputs.

Usage

foundry_grader_label_model(name, model, input, labels, passing_labels)

Arguments

name	Character. Grader name.
model	Character. Deployment name of a model that supports structured outputs.
input	List. A list of items from foundry_eval_item() (or a single item), forming the grading prompt.
labels	Character vector. The complete set of labels the model may assign.
passing_labels	Character vector. The labels that count as a pass. Must be a subset of labels.

Value

A named list describing a label_model grader.

Examples

foundry_grader_label_model(
  name = "relevance-label",
  model = "gpt-5-nano",
  input = list(
    foundry_eval_item("Is the answer relevant? {{sample.output_text}}")
  ),
  labels = c("relevant", "irrelevant"),
  passing_labels = "relevant"
)

foundryR documentation built on Sept. 25, 2026, 1:10 a.m.