OUTLIER DETECTION METHOD BY USING DEEP NEURAL NETWORKS

Abstract

Detecting outliers in the data set is quite important for building effective predictive models. Consistent prediction can not be made through models created with data sets containing outliers, or robust models can not be created. In such cases, it may be possible to exclude observations that are determined to be outlier from the data set, or to assign less weight to these points of observation than to other points of observation. Lower and upper boundaries can be created to exclude outliers from the dataset, and models can be created using the data between those boundaries. In this study, it was aimed to propose a different perspective on outlier detection methods by creating upper bounds with the aid of deep neural networks using skewness, kurtosis and standard deviation values obtained from the dataset with trained models.

 

Keywords

• Deep neural network,outliers,outlier detection,modelling,predictive modelling

References

1. Aggarwal, C.C. (2013), Outlier Analysis, Springer-Verlag New York
2. Hawkins, D. (1980), Identification of Outliers Chapman and Hall Hawkins, D. Identification of Outliers.
3. Chapman and Hall. http://www.cse.yorku.ca/~jarek/courses/6412/lectures/Outliers.ppt http://deeplearning.net/tutorial/
4. http://www.iro.umontreal.ca/~pift6266/H10/notes/deepintro.html
5. Ben-Gal, Irad. "Outlier detection." Data mining and knowledge discovery handbook (2005): 131-146.
6. Osborne, Jason W., and Amy Overbay. "The power of outliers (and why researchers should always check for them)." Practical assessment, research & evaluation 9.6 (2004): 1-12.