vitals-package: vitals: Large Language Model Evaluation

In vitals: Large Language Model Evaluation

vitals: Large Language Model Evaluation

Description

A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.

Author(s)

Maintainer: Simon Couch [e-mail] (ORCID)

Authors:

• Simon Couch [e-mail] (ORCID)

Other contributors:

• Max Kuhn [e-mail] [contributor]

• Hadley Wickham [e-mail] (ORCID) [contributor]

• Mine Cetinkaya-Rundel [e-mail] (ORCID) [contributor]

• Posit Software, PBC (ROR) [copyright holder, funder]

See Also

Useful links:

• https://github.com/tidyverse/vitals

• https://vitals.tidyverse.org

• Report bugs at https://github.com/tidyverse/vitals/issues

vitals documentation built on Sept. 3, 2026, 1:06 a.m.