Nothing
vitals: Large Language Model Evaluation
A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.
Getting started
Browse package contents
Package details |
|
|---|---|
| Author | Simon Couch [aut, cre] (ORCID: <https://orcid.org/0000-0001-5676-5107>), Max Kuhn [ctb], Hadley Wickham [ctb] (ORCID: <https://orcid.org/0000-0003-4757-117X>), Mine Cetinkaya-Rundel [ctb] (ORCID: <https://orcid.org/0000-0001-6452-2420>), Posit Software, PBC [cph, fnd] (ROR: <https://ror.org/03wc8by49>) |
| Maintainer | Simon Couch <simon.couch@posit.co> |
| License | MIT + file LICENSE |
| Version | 0.1.0 |
| URL | https://github.com/tidyverse/vitals https://vitals.tidyverse.org |
| Package repository | View on CRAN |
| Installation |
Install the latest version of this package by entering the following in R:
|
Try the vitals package in your browser
Any scripts or data that you put into this service are public.
