Using ridge least median squares to estimate the parameter by solving multicollinearity and outliers problems

Abstract

In the multiple linear regression analysis, the ridge regression estimator is often used to address the problem of multicollinearity. Besides multicollinearity, outliers also constitute a problem in the multiple linear regression analysis. We propose a new biased estimators of the robust ridge regression called the Ridge Least Median Squares (RLMS) estimator in the presence of multicollinearity and outliers. For this purpose, a simulation study is conducted in order to see the difference between the proposed method and the existing methods in terms of their effectiveness measured by the mean square error. In our simulation studies the performance of the proposed method RLMS is examined for different number of observations and the different percentage of outliers. The results of different illustrative cases are presented. This paper also provides the results of the RLMS on a real-life data set. The results show that RLMS is better than the existing methods of Ordinary Least Squares (OLS), Ridge Least Absolute Value (RLAV) and Ridge Regression (RR) in the presence of multicollinearity and outliers.