A Path Following Algorithm for Sparse Pseudo-Likelihood Inverse Covariance Estimation (SPLICE)

Citations Over Time

Abstract

Given n observations of a p-dimensional random vector, the covariance matrix and its inverse (precision matrix) are needed in a wide range of applications.Sample covariance (e.g. its eigenstructure) can misbehave when p is comparable to the sample size n.Regularization is often used to mitigate the problem.In this paper, we proposed an 1 penalized pseudo-likelihood estimate for the inverse covariance matrix.This estimate is sparse due to the 1 penalty, and we term this method SPLICE.Its regularization path can be computed via an algorithm based on the homotopy/LARS-Lasso algorithm.Simulation studies are carried out for various inverse covariance structures for p = 15 and n = 20, 1000.We compare SPLICE with the 1 penalized likelihood estimate and a 1 penalized Cholesky decomposition based method.SPLICE gives the best overall performance in terms of three metrics on the precision matrix and ROC curve for model selection.Moreover, our simulation results demonstrate that the SPLICE estimates are positive-definite for most of the regularization path even though the restriction is not enforced.

Related Papers

• → Covariance estimation with limited training samples(1999)167 cited
• → On the inverse of the covariance matrix of a first order moving average(1969)56 cited
• → Efficient distributed estimation of inverse covariance matrices(2016)8 cited
• → Positive definite maximum likelihood covariance estimators(1985)2 cited
• 3D kriging of the ionosphere based on maximum likelihood and restricted maximum likelihood estimation of a non-stationary covariance model(2016)