A STUDY ON TESTS OF HYPOTHESIS BASED ON RIDGE ESTIMATOR

Year 2016, Volume: 29 Issue: 4, 769 - 781, 19.12.2016

Esra Gökpınar , Meral Ebegil

Abstract

The literature of Ridge regression include many articles that deal with point estimation of the coefficients vector . However, few of them tackle the statistical inference problem about or some of its components. One of them is introduced by Halawa and Basuiouni[1] who present non-exact tests based on Ridge regression by using two different biasing parameters (k) which are proposed by Hoerl and Kennard [2] and Hoerl et al. [3]. Thus, we investigate others popular k values used the Ridge regression for testing significance of regression coefficients. We compare tests in terms of type I error rates and powers by using Monte Carlo simulation. In addition, a real data example is presented.

Keywords

Biasing factors, Ridge regression, Hypothesis testing, Type I error, Power of test

References

• A.M. Halawa and M.Y.E. Basuiouni, “Tests of
• Regression Coefficients under Ridge Regression
• Models”, Journal of Statistical Computation and
• Simulation, 65, 2000, pp. 341-356.
• A.E. Hoerl and R.W. Kennard, “Ridge regression:
• biased estimation for non-orthogonalproblems”,
• Technometrics,12, 1970, pp. 55–67.
• A.E. Hoerl, R.W. Kennard and K.F. Baldwin, “Ridge
• regression: some simulation”, Communications in
• Statistics, 5, 1975,pp. 105–123.
• C.M. Theobald, “Generalizations of Mean Square
• Error Applied to Ridge Regression”, Journal of the
• Royal Statistical Society. Series B
• (Methodolojical), 36, 1974,pp.103-106.
• J.F. Lawless and P. Wang, “A Simulation Study of
• Ridge and Other Regression Estimators”,
• Communications in Statistics: Theory and
• Methods,7, 1976, pp. 139-164.
• A.P. Dempster, M. Schatzoff and N. Wermuth, “A
• Simulation Study of Alternatives to Ordinary Least
• Squares”, Journal of the American Statistical
• Association, 72, 1977,pp. 77-91.
• D.G. Gibbons, “A Simulation Study of Some Ridge
• Estimators”, Journal of the American Statistical
• Association, 76, 1981,pp.131-139.
• A. K. Md. E. Saleh and B.M.G. Kibria,
• “Performances of Some New Preliminary Test
• Ridge Regression Estimators and Their Properties”,
• Communicationsin Statistics: Theory and Methods,
• , 1993,pp. 2747-2764.
• B.M.G. Kibria, “Performance of Some New Ridge
• Regression Estimators”, Communications in
• Statistics: Simulation and Computation, 32,
• ,pp. 419-435.
• G. Khalaf and G. Shukur, “Choosing Ridge
• Parameters for Regression Problems”,
• Communications in Statistics: Theory and Methods,
• , 2005,pp.1177-1182.
• J. Zhang and M. Ibrahim, “A Simulation Study on
• SPSS Ridge Regression and Ordinary Least
• Squares Regression Procedures for Multicolliearity
• data”, Journal of Applied Statistics, 32, 2005,pp.
• -588.
• A.K.Md.E. Saleh, “Theory of Preliminary Test and
• Stein-Type Estimation with Applications”, Wiley,
• New York, 2006.
• M. Alkhamisi, G. Khalaf and G. Shukur, “Some
• Modifications for Choosing Ridge Parameters”,
• Communications in Statistics-Theory and Methods,
• , 2006,pp. 2005-2020.
• M. Alkhamisi and G. Shukur, “Developing Ridge
• Parameters for SUR Model”, Communications in
• Statistics -Theory and Methods, 37, 2008,pp. 544-
• G. Muniz and B.M.G. Kibria, “On Some Ridge
• Regression Estimators: An Empirical
• Comparisons”, Communications in Statistics-
• Simulation and Computation, 38, 2009,pp. 621-
• F. Gökpınar and M. Ebegil, “A Comparative Study
• on Ridge Estimators in Regression Problems”,
• Journal of SainsMalaysiana, 2014 (in submission).
• E.P. Liski, “A Test of the Mean Square Error
• Criterion for shrinkage Estimators”,
• Communications in Statistics: Theory and Methods,
• , 1982,pp. 543-562.
• E.P. Liski, “Choosing a shrinkage Estimator-a test
• of the Mean Square Error Criterion”, Proc. First
• Tampere Sem. Linear Models, 1983,pp. 245-262.
• R.L. Obenchain, “Classical F-Tests and Confidence
• Regions for Ridge Regression”, Technometrics, 19,
• , pp. 429-439.
• D. Coutsourides and C.G. Troskie, “F and t Tests
• for a General Class of Estimators”, South African
• Statistical Journal, 13, 1979,pp. 113-119.
• A. Ullah, R.A.L. Carter and V.K. Srivastova, “The
• Sampling Distribution of Shrinkage Estimators and
• their F Ratio in Regression Model”, Journal of
• Econometrics, 25, 1984,pp. 109-122.
• M. Karakuş, A. Bayrak, E. Çalıkoğlu and M.
• Kıralan, “Comparison of oxidation stability of
• virgin olive oils from different locations of
• Turkey”, ActaAlimentaria, 43, 2014, pp. 133-141.
• H.Woods, H.H. Steinour, and H.R. Starke, “Effect
• of composition of Portland cement on heat evolved
• during hardening, Ind. Eng. Chem.”, 24, 1932, pp.
• –1214.
• M. Ebegil, F. Gökpınar, “A Test Statistic to Choose
• Between Liu-Type and Least Squares Estimator
• Based on Mean Square Error Criteria”, Journal of
• Applied Statistics, 39(10), 2012, pp. 2081-2096.