In tidymodels/baguette: Efficient Model Functions for Bagging

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  fig.path = "man/figures/README-",
  out.width = "100%"
)

baguette

Introduction

The goal of baguette is to provide efficient functions for bagging (aka bootstrap aggregating) ensemble models.

The model objects produced by baguette are kept smaller than they would otherwise be through two operations:

The butcher package is used to remove object elements that are not crucial to using the models. For example, some models contain copies of the training set or model residuals when created. These are removed to save space.
For ensembles whose base models use a formula method, there is a built-in redundancy because each model has an identical terms object. However, each one of these takes up separate space in memory and can be quite large when there are many predictors. The baguette package solves this problem by replacing each terms object with the object from the first model in the ensemble. Since the other terms objects are not modified, we get the same functional capabilities using far less memory to save the ensemble.

Installation

You can install the released version of baguette from CRAN with:

install.packages("baguette")

Install the development version from GitHub with:

# install.packages("pak")
pak::pak("tidymodels/baguette")

Available Engines

The baguette package provides engines for the models in the following table.

library(parsnip)

parsnip_models <- get_from_env("models") |>
  setNames(., .) |>
  purrr::map_dfr(get_from_env, .id = "model")

library(baguette)

baguette_models <- get_from_env("models") |>
  setNames(., .) |>
  purrr::map_dfr(get_from_env, .id = "model")

dplyr::anti_join(
  baguette_models, parsnip_models, 
  by = c("model", "engine", "mode")
) |>
  knitr::kable()

Example

Let's build a bagged decision tree model to predict a continuous outcome.

library(baguette)

bag_tree() |> 
  set_engine("rpart") # C5.0 is also available here

set.seed(123)
bag_cars <- 
  bag_tree() |> 
  set_engine("rpart", times = 25) |> # 25 ensemble members 
  set_mode("regression") |> 
  fit(mpg ~ ., data = mtcars)

bag_cars

The models also return aggregated variable importance scores.

Contributing

This project is released with a Contributor Code of Conduct. By contributing to this project, you agree to abide by its terms.

For questions and discussions about tidymodels packages, modeling, and machine learning, please post on Posit Community.
If you think you have encountered a bug, please submit an issue.
Either way, learn how to create and share a reprex (a minimal, reproducible example), to clearly communicate about your code.
Check out further details on contributing guidelines for tidymodels packages and how to get help.