Contributions to Theil-Sen Regression Analysis Parameter Estimation with Weighted Median

Abstract

Regression analysis is one of the most commonly used estimation methods. In statistical studies, some assumptions must be fully met to make good estimations with regression analysis. Some of these assumptions are not always fulfilled in real life data. For such cases, alternative methods are used. One of them is Theil-sen method, which is one of the non-parametric regression analysis techniques. In this study, different analysis techniques were proposed by using the weighted median parameter instead of the median parameter used in the Theil-Sen regression method. With the proposed four different algorithms, new approaches to Theil-Sen regression analysis estimation have been introduced. It has been seen that the obtained results are successful compared to the classical Theil-Sen results.

Keywords

• Theil-Sen Method
• Weighted Median
• Non-Parametric Regression
• MAE

References

1. Akritas, M.G., Murphy, S.A., LaValley, M.P. (1995). J. Am. Stat. Assoc., 90, 170.
2. Alakuş K, Erilli N.A. (2014). Non‐Parametric Regression Estimation for Data with Equal Value, European Scientific Journal (ESJ) ,2014, 4, 1857‐ 7431.
3. Birkes D., Dodge Y. (1993). Alternative Methods of Regression. John Wiley and Sons Inc., NY. USA.
4. Bowerman, B.L., O’Connell, R.T., Murphree, E.S., Orris, J.B. (2013). İşletme İstatistiğinin Temelleri. Çeviri editörleri: Neyran Orhunbilge, Mustafa Can, Şebnem Er. Nobel yayınları, Ankara.
5. Erilli, N.A., Alakuş, K. (2016). Parameter Estimation In Theil-Sen regression analysis with Jackknife method. Eurasian Econometrics, Statistics & Empirical Economics Journal, 5, 28-41.
6. Erilli, N.A. (2015). İstatistik-2. Seçkin Yayıncılık, Ankara.
7. Fernandes, R., Leblanc, S.G. (2005). Parametric (modified least squares) and non‐parametric (Theil‐Sen) linear regressions for predicting biophysical parameters in the presence of measurement errors. Remote Sensing of Environment, (95), 3, 303‐316.
8. Gujarati, D. (1999). Temel Ekonometri. Çevirenler: Ümit Şenesen, G. Günlük Şenesen. Literatür Yayıncılık, İstanbul.

9. Hardle, W. (1994). Applied Nonparametric Regression. Cambridge University, UK.
10. Horowitz, J.L. (1993). Semiparametric Estimation of a Work‐Trip Mode Choice Model, Journal of Econometrics, 58, 49‐70.
11. Hussain, S.S., Sprent, P. (1983). Non-Parametric Regression. Journal of The Royal Statistical Society. Ser., A., 146, 182-191.
12. Lavagnini, I., Badocco, D., Pastore, P., Magno, F. (2011). Theil‐Sen nonpara‐metric regression technique on univariate calibration, inverse regression and detection limits Talanta, Volume 87, Pages 180‐188.
13. Sen, P.K. (1968). Estimates of The Regression Coefficient Based on Kendall’s Tau. J. Amer. Statist. Ass., 63, 1379-1389.
14. Shen, G. (2009). Asymptotics of a Theil‐Sen‐type estimate in multiple linear regression Statistics & Probability Letters, volume 79, Issue 8, pp. 1053‐1064.
15. Takezawa, K. (2006). Introduction to Nonparametric Regression. Wiley‐Interscience, Canada.
16. Theil, H. (1950). A Rank Invariant Method of Linear and Polynomial Regression Analysis. III. Nederl. Akad. Wetensch. Proc., Series A, 53, 1397-1412.
17. Zhou, W., Serfling, R. (2008). Multivariate spatial U‐quantiles: A Bahadur–Kiefer representation, a Theil‐ Sen estimator for multiple regression, and a robust dispersion estimator. Journal of Statistical Planning and Inference, 138:6, Pages 1660‐1678.
18. Wilcox, R. (1998). A note on the Theil-Sen regression estimator when the regressor is random and the error term is heteroscedastic. Biometrical J. 40, 261–268.