In liuyanguu/SHAPforxgboost: SHAP Plots for 'XGBoost'

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>",
  warning = FALSE,
  message = FALSE,
  fig.width = 5,
  fig.height = 4
)

Introduction

This vignette shows how to use SHAPforxgboost for interpretation of models trained with LightGBM, a hightly efficient gradient boosting implementation [@ke2017lightgbm].

library("ggplot2")
library("SHAPforxgboost")
library("lightgbm")

set.seed(9375)

Training the model

Let's train a small model to predict the first column in the iris data set, namely Sepal.Length.

head(iris)

X <- data.matrix(iris[, -1])

fit <- lgb.train(
  params = list(objective = "regression"),
  data = lgb.Dataset(X, label = iris[[1]]),
  nrounds = 50,
  verbose = -2
)

SHAP analysis

Now, we can prepare the SHAP values and analyze the results. All this in just very few lines of code!

# Crunch SHAP values
shap <- shap.prep(fit, X_train = X)

# SHAP importance plot
shap.plot.summary(shap)

# Dependence plots in decreasing order of importance
for (x in shap.importance(shap, names_only = TRUE)) {
  p <- shap.plot.dependence(
    shap, 
    x = x, 
    color_feature = "auto", 
    smooth = FALSE, 
    jitter_width = 0.01, 
    alpha = 0.4
    ) +
  ggtitle(x)
  print(p)
}