tidyposterior-package: tidyposterior: Bayesian Analysis to Compare Models using...

In topepo/tidyposterior: Bayesian Analysis to Compare Models using Resampling Statistics

tidyposterior: Bayesian Analysis to Compare Models using Resampling Statistics

Description

Bayesian analysis used here to answer the question: "when looking at resampling results, are the differences between models 'real'?" To answer this, a model can be created were the performance statistic is the resampling statistics (e.g. accuracy or RMSE). These values are explained by the model types. In doing this, we can get parameter estimates for each model's affect on performance and make statistical (and practical) comparisons between models. The methods included here are similar to Benavoli et al (2017) https://jmlr.org/papers/v18/16-305.html.

Author(s)

Maintainer: Max Kuhn [e-mail] (ORCID)

Other contributors:

• Posit Software, PBC [copyright holder, funder]

See Also

Useful links:

• https://tidyposterior.tidymodels.org

• https://github.com/tidymodels/tidyposterior

• Report bugs at https://github.com/tidymodels/tidyposterior/issues

topepo/tidyposterior documentation built on Oct. 18, 2023, 8:30 p.m.