API for vitals
Large Language Model Evaluation
| Global functions | |
|---|---|
| .onLoad | Source code |
| .rlang_as_friendly_type | Source code |
| .rlang_check_is_string | Source code |
| .rlang_purrr_args_recycle | Source code |
| .rlang_purrr_index | Source code |
| .rlang_purrr_map_mold | Source code |
| .rlang_purrr_probe | Source code |
| .rlang_stop_unexpected_typeof | Source code |
| .stop_not_number | Source code |
| Task | Man page |
| accumulate | Source code |
| accumulate_right | Source code |
| accuracy | Source code |
| active_file | Source code |
| add_working_start_to_turns | Source code |
| add_working_times_to_turns | Source code |
| are | Man page |
| as_metadata | Source code |
| bind_token_usage | Source code |
| check_arg | Source code |
| check_bool | Source code |
| check_call | Source code |
| check_character | Source code |
| check_closure | Source code |
| check_data_frame | Source code |
| check_dataset | Source code |
| check_environment | Source code |
| check_formula | Source code |
| check_function | Source code |
| check_inherits | Source code |
| check_log_dir | Source code |
| check_logical | Source code |
| check_metrics | Source code |
| check_name | Source code |
| check_number_decimal | Source code |
| check_number_whole | Source code |
| check_string | Source code |
| check_symbol | Source code |
| compact | Source code |
| copy_dir_contents | Source code |
| copy_log_files | Source code |
| create_init_begin_event | Source code |
| create_init_end_event | Source code |
| create_model_event | Source code |
| create_sample_init_event | Source code |
| create_score_event | Source code |
| create_scorer_begin_event | Source code |
| create_scorer_end_event | Source code |
| create_scoring_model_event | Source code |
| create_solver_begin_event | Source code |
| create_solver_end_event | Source code |
| create_tool_event | Source code |
| create_tool_state_event | Source code |
| create_use_tools_begin_event | Source code |
| create_use_tools_end_event | Source code |
| detect | Source code |
| detect_answer | Man page Source code |
| detect_answer_impl | Source code |
| detect_exact | Man page Source code |
| detect_exact_impl | Source code |
| detect_includes | Man page Source code |
| detect_includes_impl | Source code |
| detect_index | Source code |
| detect_match | Man page Source code |
| detect_match_impl | Source code |
| detect_pattern | Man page Source code |
| detect_pattern_impl | Source code |
| diff_token_usage | Source code |
| discard | Source code |
| eval_log | Source code |
| eval_log_filename | Source code |
| eval_log_read | Source code |
| eval_log_read_headers | Source code |
| eval_log_timestamp | Source code |
| eval_log_write | Source code |
| events_timestamp | Source code |
| every | Source code |
| fact_default_template | Source code |
| first_text_contents | Source code |
| generate | Man page Source code |
| generate_id | Source code |
| has_last_task | Source code |
| has_tool_calls | Source code |
| imap | Source code |
| inject_configuration | Source code |
| input_string | Source code |
| is_positron | Source code |
| is_testing | Source code |
| join_epochs | Source code |
| keep | Source code |
| list_c | Source code |
| logged | Source code |
| map | Source code |
| map2 | Source code |
| map2_chr | Source code |
| map2_dbl | Source code |
| map2_int | Source code |
| map2_lgl | Source code |
| map_chr | Source code |
| map_dbl | Source code |
| map_if | Source code |
| map_int | Source code |
| map_lgl | Source code |
| model_graded_fact | Man page Source code |
| model_graded_qa | Man page Source code |
| model_graded_qa_impl | Source code |
| move_output | Source code |
| negate | Source code |
| numeric_price | Source code |
| obj_type_friendly | Source code |
| obj_type_oo | Source code |
| oxford_comma | Source code |
| parse_query_string | Source code |
| pmap | Source code |
| print.Task | Source code |
| qa_default_instructions | Source code |
| qa_default_template | Source code |
| qa_extract_grade | Source code |
| qa_format_prompt | Source code |
| reduce | Source code |
| reduce_right | Source code |
| regenerate_example_objects | Source code |
| rename_metric_fields | Source code |
| rename_token_fields | Source code |
| results_scores | Source code |
| scorer_detect | Man page |
| scorer_model | Man page |
| set_id_column | Source code |
| set_reasonable_names | Source code |
| solver_chat | Source code |
| some | Source code |
| stop_input_type | Source code |
| sum_model_usage | Source code |
| translate_assistant_choices | Source code |
| translate_events_initialize | Source code |
| translate_events_scorer | Source code |
| translate_events_solver | Source code |
| translate_events_tool_use | Source code |
| translate_to_eval | Source code |
| translate_to_eval_scorers | Source code |
| translate_to_events | Source code |
| translate_to_message | Source code |
| translate_to_messages | Source code |
| translate_to_metadata_grading | Source code |
| translate_to_metrics | Source code |
| translate_to_model_usage | Source code |
| translate_to_output | Source code |
| translate_to_plan | Source code |
| translate_to_plan_steps | Source code |
| translate_to_results | Source code |
| translate_to_sample | Source code |
| translate_to_samples | Source code |
| translate_to_score | Source code |
| translate_to_stats | Source code |
| transpose | Source code |
| turn_tokens | Source code |
| vec_type_friendly | Source code |
| vitals | Man page |
| vitals-package | Man page |
| vitals_bind | Man page Source code |
| vitals_bundle | Man page Source code |
| vitals_log_dir | Man page Source code |
| vitals_log_dir_set | Man page Source code |
| vitals_view | Man page Source code |
| vitals_view_impl | Source code |
| walk | Source code |
| write_log_dir_manifest | Source code |
| write_robots_txt | Source code |
