inst/README.md

In vitals: Large Language Model Evaluation

Package system files

test/

The package uses a number of cached objects during testing in test/.

The .json files in inspect-example/logs are the resulting log file from running evals in inst/test/inspect, e.g. with:

inspect eval inst/test/inspect/basics.py  --model anthropic/claude-3-5-sonnet-latest --log-format=json

...or:

inspect eval test/inspect/tools.py  --model anthropic/claude-3-5-sonnet-latest --log-format=json

dist/

/dist is a bundled version of the Inspect viewer. (See here for more information.)

regenerate-example-objects.R

The package defines a function regenerate_example_objects() in the source that sources the script inst/regenerate-example-objects.R.

vitals documentation built on June 24, 2025, 9:08 a.m.