Javascript must be enabled to continue!
Comparative Analysis of Ridge, Bridge and Lasso Regression Models In the Presence of Multicollinearity
View through CrossRef
Aims: This research work investigated the best regression technique in handling multicollinearity using the Ridge, Least Absolute Shrinkage and Selection Operator (LASSO) and Bridge regression models in comparison to Analysis and Prediction. Study Design: Two sets of secondary data on Body Size and Heart Rate gotten from the Lulu Briggs Health Center, University of Port Harcourt were used for comparison for model fit and in handling multicollinearity between the regression techniques. Tables were used to present Comparisons made using MSE, RMSE, VIF, AIC and BIC for efficiency. Scatter plots were employed to show fitted regression models. R Software was used to perform data analysis. Methodology: The data were tested for the presence of Multicollinearity using VIF respectively, before proceeding to apply Ridge, LASSO and Bridge regression techniques to solve the problem of multicollinearity. Then comparison was made in analysis and prediction between the regression techniques. Results: The results from the study show that, for analysis on body size, we found that none of the Regression Techniques handled the problem of multicollinearity, even though the degree of multicollinearity present in the data set reduces, with VIF values of 11.36762 for Ridge, 10.8042 for LASSO, and Bridge which are 10.95578, 11.24945, 12.22628 and 12.14645 respectively. For Heart Rate analysis, we see that all the regularized regression techniques handled the problem of multicollinearity. The results show that the Bridge regression technique performed better with a VIF of 1.744461 when
IPS Intelligentsia Publishing Services
Title: Comparative Analysis of Ridge, Bridge and Lasso Regression Models In the Presence of Multicollinearity
Description:
Aims: This research work investigated the best regression technique in handling multicollinearity using the Ridge, Least Absolute Shrinkage and Selection Operator (LASSO) and Bridge regression models in comparison to Analysis and Prediction.
Study Design: Two sets of secondary data on Body Size and Heart Rate gotten from the Lulu Briggs Health Center, University of Port Harcourt were used for comparison for model fit and in handling multicollinearity between the regression techniques.
Tables were used to present Comparisons made using MSE, RMSE, VIF, AIC and BIC for efficiency.
Scatter plots were employed to show fitted regression models.
R Software was used to perform data analysis.
Methodology: The data were tested for the presence of Multicollinearity using VIF respectively, before proceeding to apply Ridge, LASSO and Bridge regression techniques to solve the problem of multicollinearity.
Then comparison was made in analysis and prediction between the regression techniques.
Results: The results from the study show that, for analysis on body size, we found that none of the Regression Techniques handled the problem of multicollinearity, even though the degree of multicollinearity present in the data set reduces, with VIF values of 11.
36762 for Ridge, 10.
8042 for LASSO, and Bridge which are 10.
95578, 11.
24945, 12.
22628 and 12.
14645 respectively.
For Heart Rate analysis, we see that all the regularized regression techniques handled the problem of multicollinearity.
The results show that the Bridge regression technique performed better with a VIF of 1.
744461 when.
Related Results
การเปรียบเทียบประสิทธิภาพของวิธีการสร้างช่วงความเชื่อมั่นสำหรับสัมประสิทธิ์การถดถอยลอจิสติกในข้อมูลที่มีมิติสูง โดยใช้การประมาณสองขั้นตอนด้วยวิธี lasso + MLE and a bootstrap lasso + partial ridge
การเปรียบเทียบประสิทธิภาพของวิธีการสร้างช่วงความเชื่อมั่นสำหรับสัมประสิทธิ์การถดถอยลอจิสติกในข้อมูลที่มีมิติสูง โดยใช้การประมาณสองขั้นตอนด้วยวิธี lasso + MLE and a bootstrap lasso + partial ridge
งานวิจัยนี้มีวัตถุประสงค์เพื่อเปรียบเทียบวิธีการสร้างช่วงความเชื่อมั่นสำหรับสัมประสิทธิ์การถดถอยลอจิสติกในข้อมูลที่มีมิติสูง โดยใช้การประมาณสองขั้นตอนด้วยวิธี Lasso+MLE และวิธี Las...
Primerjalna književnost na prelomu tisočletja
Primerjalna književnost na prelomu tisočletja
In a comprehensive and at times critical manner, this volume seeks to shed light on the development of events in Western (i.e., European and North American) comparative literature ...
Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
Abstract
Background
Statistical analyses of biological problems in life sciences often lead to high-dimensional linear models. To solve the corresponding system of equations, penal...
New ridge parameter estimators for the quasi-Poisson ridge regression model
New ridge parameter estimators for the quasi-Poisson ridge regression model
AbstractThe quasi-Poisson regression model is used for count data and is preferred over the Poisson regression model in the case of over-dispersed count data. The quasi-likelihood ...
Variable Selection using Lasso Regression
Variable Selection using Lasso Regression
This study employs Lasso regression to analyze highdimensional genetic data for predicting flowering time in maize, specifically Days to Anthesis (DtoA). Lasso, or Least Absolute S...
The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Multicollinearity: A Simulation and Application
The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Multicollinearity: A Simulation and Application
This research aims to compare the performance of Ordinary Least Square (OLS), Least Absolute Shrinkage and Selection Operator (LASSO), Ridge Regression (RR) and Elastic-Net in cont...
Méthodes quasi-Monte Carlo et Monte Carlo : application aux calculs des estimateurs Lasso et Lasso bayésien
Méthodes quasi-Monte Carlo et Monte Carlo : application aux calculs des estimateurs Lasso et Lasso bayésien
La thèse contient 6 chapitres. Le premier chapitre contient une introduction à la régression linéaire et aux problèmes Lasso et Lasso bayésien. Le chapitre 2 rappelle les algorithm...
The Alpha Ridge is not a spreading centre
The Alpha Ridge is not a spreading centre
A sediment-corrected mean water depth profile across the Alpha Ridge is obtained using water depths from four submarine echograms and an assumed sediment distribution. The sediment...

