calc_baseline_check: Compute check of whether predictive performance is comparable...

View source: R/model_eligibility.R

calc_baseline_checkR Documentation

Compute check of whether predictive performance is comparable to a baseline model

Description

Compute check of whether predictive performance is comparable to a baseline model

Usage

calc_baseline_check(
  qfm,
  observed_by_location_target_end_date,
  baseline_tol = 1
)

Arguments

qfm

matrix of model forecasts of class QuantileForecastMatrix

observed_by_location_target_end_date

data frame of observed values

baseline_tol

numeric; for baseline check, model's mean WIS for forecasts within the window size must be at most baseline_tol times the mean wis for the baseline model on the corresponding forecasts

Value

data frame with a row for each combination of location and model, and a character column called 'baseline_eligibility' with entry 'windowed wis greater than baseline' if the mean wis for forecasts made by this model in the past window weeks is greater than the mean wis for the corresponding forecasts from a baseline model


reichlab/covidEnsembles documentation built on Jan. 31, 2024, 7:21 p.m.