DPOET: Distributed POET covariance matrix estimation

View source: R/DPOET.R

DPOETR Documentation

Distributed POET covariance matrix estimation

Description

Estimates a high-dimensional covariance matrix using a distributed Principal Orthogonal complEment Thresholding (POET) procedure. Local subsets are randomly sampled from the full dataset, and their covariance estimates are averaged.

Usage

DPOET(data, r.max = 10, n1, K, delta = 0.01, eps = 1e-08)

Arguments

data

A numeric matrix or data frame. Rows represent observations and columns represent variables. All values must be finite.

r.max

A positive integer specifying the maximum number of latent factors considered by the information criterion. The effective maximum is limited to min(r.max, n1 - 1, p - 1), where p is the number of variables. Default is 10.

n1

An integer between 2 and the total sample size. The number of observations randomly sampled without replacement for each local subset.

K

A positive integer specifying the number of local subsets. Each subset is sampled independently from the full dataset.

delta

A non-negative finite numeric value added to the diagonal entries of the thresholded residual covariance matrix. Default is 0.01.

eps

A positive finite numeric value used as a numerical lower bound for factor eigenvalues and residual covariance diagonal entries. Default is 1e-8.

Details

For each local subset, the number of latent factors is selected using an information criterion. The residual covariance matrix is estimated using hard thresholding with threshold sqrt(log(p) / n1). Local subsets may overlap because they are independently sampled. For reproducibility, call set.seed() before running DPOET().

Value

A list containing:

Abar

A p by r_common matrix obtained by averaging the zero-padded local factor loading matrices, where r_common is the maximum local factor number.

Dbar

A p by p matrix representing the average thresholded residual covariance estimate.

Sigmahatbar

A p by p symmetric matrix representing the average local POET covariance estimate.

rbar

The mean of the estimated local factor numbers.

Examples

set.seed(123)
n <- 100; p <- 10; r <- 3
F <- matrix(rnorm(n * r), nrow = n, ncol = r)
A <- matrix(runif(p * r, -1, 1), nrow = p, ncol = r)
U <- matrix(rnorm(n * p, sd = 0.5), nrow = n, ncol = p)
X <- F %*% t(A) + U
result1 <- DPOET(data = X, r.max = 3, n1 = 50, K = 2, delta = 0.01, eps = 1e-8)
dim(result1$Sigmahatbar)
result1$rbar
result2 <- DPOET(data = X, r.max = 5, n1 = 50, K = 2)
dim(result2$Abar)
result2$rbar

CoFM documentation built on Nov. 18, 2026, 5:08 p.m.

Related to DPOET in CoFM...