Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Network Inference with the Lasso

View through CrossRef
Calculating confidence intervals and p-values of edges in networks is useful to decide their presence or absence and it is a natural way to quantify uncertainty. Since Lasso estimation is often used to obtain edges in a network, and the underlying distribution of Lasso estimates is discontinuous and has probability one at zero when the estimate is zero, obtaining p-values and confidence intervals is problematic. It is also not always desirable to use the Lasso to select the edges because there are assumptions required for correct identification of network edges that may not be warranted for the data at hand. Here we review three methods that either use a modified Lasso estimate (desparsified or debiased Lasso) or a method that uses the Lasso for selection and then determines p-values without the Lasso. We compare these three methods with popular methods to estimate Gaussian Graphical Models in simulations and conclude that the desparsified Lasso and its bootstrapped version appear to be the best choices for selection and quantifying uncertainty with confidence intervals and p-values.
Title: Network Inference with the Lasso
Description:
Calculating confidence intervals and p-values of edges in networks is useful to decide their presence or absence and it is a natural way to quantify uncertainty.
Since Lasso estimation is often used to obtain edges in a network, and the underlying distribution of Lasso estimates is discontinuous and has probability one at zero when the estimate is zero, obtaining p-values and confidence intervals is problematic.
It is also not always desirable to use the Lasso to select the edges because there are assumptions required for correct identification of network edges that may not be warranted for the data at hand.
Here we review three methods that either use a modified Lasso estimate (desparsified or debiased Lasso) or a method that uses the Lasso for selection and then determines p-values without the Lasso.
We compare these three methods with popular methods to estimate Gaussian Graphical Models in simulations and conclude that the desparsified Lasso and its bootstrapped version appear to be the best choices for selection and quantifying uncertainty with confidence intervals and p-values.

Related Results

Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
Abstract Background Statistical analyses of biological problems in life sciences often lead to high-dimensional linear models. To solve the corresponding system of equations, penal...
Méthodes quasi-Monte Carlo et Monte Carlo : application aux calculs des estimateurs Lasso et Lasso bayésien
Méthodes quasi-Monte Carlo et Monte Carlo : application aux calculs des estimateurs Lasso et Lasso bayésien
La thèse contient 6 chapitres. Le premier chapitre contient une introduction à la régression linéaire et aux problèmes Lasso et Lasso bayésien. Le chapitre 2 rappelle les algorithm...
Latency-Critical Inference Serving for Deep Learning
Latency-Critical Inference Serving for Deep Learning
Deep learning (DL) technology has made remarkable strides in terms of accuracy through the advancement of sophisticated and large deep neural networks (DNNs). Yet, its adoption in ...
Bayesian LASSO with Categorical Predictors: Coding Strategies, Uncertainty Quantification, and Healthcare Applications
Bayesian LASSO with Categorical Predictors: Coding Strategies, Uncertainty Quantification, and Healthcare Applications
There is a growing interest in applying statistical machine learning methods, such as LASSO regression and its extensions, to analyze healthcare datasets. One representative recent...
Canal-LASSO: A sparse noise-resilient online linear regression model
Canal-LASSO: A sparse noise-resilient online linear regression model
Least absolute shrinkage and selection operator (LASSO) is one of the most commonly used methods for shrinkage estimation and variable selection. Robust variable selection methods ...
Variable Selection using Lasso Regression
Variable Selection using Lasso Regression
This study employs Lasso regression to analyze highdimensional genetic data for predicting flowering time in maize, specifically Days to Anthesis (DtoA). Lasso, or Least Absolute S...
Evolutionary Grammatical Inference
Evolutionary Grammatical Inference
Grammatical Inference (also known as grammar induction) is the problem of learning a grammar for a language from a set of examples. In a broad sense, some data is presented to the ...

Back to Top