Basic usage of grpSLOPE In grpSLOPE: Group Sorted L1 Penalized Estimation

Introduction

Group SLOPE (gSLOPE) is a penalized linear regression method that is used for adaptive selection of groups of significant predictors in a high-dimensional linear model. A unique property of the Group SLOPE method is that it offers group false discovery rate (gFDR) control (i.e., control of the expected proportion of irrelevant groups among the total number of groups selected by Group SLOPE). A detailed description of the method can be found in D. Brzyski, A. Gossmann, W. Su, and M. Bogdan (2016) Group SLOPE — adaptive selection of groups of predictors.

Group SLOPE is implemented in the R package grpSLOPE. As an introduction to the R package, in the following we will walk through a basic usage demonstration. First, we will simulate some data, before we feed it into grpSLOPE, and subsequently examine the output.

Data generation

We simulate a $500 \times 500$ SNP-data-like model matrix.

set.seed(17082016)

p     <- 500
probs <- runif(p, 0.1, 0.5)
probs <- t(probs) %x% matrix(1,p,2)
X0    <- matrix(rbinom(2*p*p, 1, probs), p, 2*p)
X     <- X0 %*% (diag(p) %x% matrix(1,2,1))


For example, the upper left $10 \times 10$ corner of $X$ looks as follows.

pander::pandoc.table(X[1:10, 1:10])


Note: In fact, with the default settings, the Group SLOPE method is guaranteed to control gFDR only when applied to a data matrix, where the columns corresponding to different groups of predictors are nearly uncorrelated. The relevant theoretical results can be found in Brzyski et. al. (2016). Only for the brevity of exposition we neither check for nor enforce low between-group correlations in this example.

We divide the 500 predictor variables into 100 groups of sizes ranging from 3 to 7.

group <- c(rep(1:20, each=3),
rep(21:40, each=4),
rep(41:60, each=5),
rep(61:80, each=6),
rep(81:100, each=7))
group <- paste0("grp", group)
str(group)


For further usage we keep additional information about the grouping structure of predictors, such as the total number of groups and the group sizes.

# this generates a list containing a vector of indices for each group:
group.id <- grpSLOPE::getGroupID(group)
# this extracts the total number of groups:
n.group <- length(group.id)
# this vector collects the sizes of every group of predictors:
group.length <- sapply(group.id, FUN=length)
# this vector collects the group names:
group.names <- names(group.id)


In order to simulate a response variable, we randomly select 10 groups to be truly significant.

ind.relevant <- sort(sample(1:n.group, 10)) # indices of relevant groups


The randomly selected truly significant groups are:

pander::pandoc.table(group.names[ind.relevant])


Then we generate the vector of regression coefficients, by sampling effect sizes for the significant groups from the Uniform(0,1) distribution.

b <- rep(0, p)
for (j in ind.relevant) {
b[group.id[[j]]] <- runif(group.length[j])
}


Finally, we generate the response vector according to a linear model with i.i.d. $\mathcal{N}(0, 1)$ noise terms.

y <- X %*% b + rnorm(p)


Fitting the Group SLOPE model

We fit the Group SLOPE model to the simulated data. The function argument fdr signifies the target group-wise false discovery rate (gFDR) of the variable selection procedure.

library(grpSLOPE)

model <- grpSLOPE(X=X, y=y, group=group, fdr=0.1)


Model fit results

The resulting object model of class "grpSLOPE" contains a lot of information about the resulting Group SLOPE model. Some of these parameters are shown below.

• Groups that were selected as significant by the Group SLOPE method.

r model$selected Notice that the model has correctly identified all significant groups, and additionally has falsely reported the group "grp11" as significant. • The estimated noise level$\hat{\sigma}$(true$\sigma$is equal to one). r sigma(model) # or equivalently: model$sigma

• The regression coefficients, which can be displayed either on the normalized scale (i.e., the scale corresponding to the normalized versions of $X$ and $y$, on which all the parameter estimates are computed internally),

r

the first 13 coefficient estimates

coef(model)[1:13] 

or on the original scale of $X$ and $y$,

r

intercept and the first 13 coefficient estimates

coef(model, scaled = FALSE)[1:14] 

(notice that the coefficients are named corresponding to the given grouping structure). As expected from a penalized regression method, we observe some shrinkage, when we compare the above to the true parameters.

r

true first 13 coefficients

b[1:13] 

• It might also be interesting to plot the first few elements of the regularizing sequence $\lambda$ used by the Group SLOPE method for the given inputs.

r plot(model$lambda[1:10], xlab = "Index", ylab = "Lambda", type="l") We can further check the performance of the method by computing the resulting group false discovery proportion (gFDP) and power. true.relevant <- group.names[ind.relevant] truepos <- intersect(model$selected, true.relevant)

n.truepos  <- length(truepos)

Try the grpSLOPE package in your browser

Any scripts or data that you put into this service are public.

grpSLOPE documentation built on May 17, 2022, 1:06 a.m.