Feature Selection for Comment Spam Filtering on YouTube
Abstract
Spam filtering is one of the most popular domains for text classification. While there exist some many studies on classification of spam e-mails and short text messages, comment spam filtering on YouTube is relatively a new topic as there are limited number of annotated datasets. As it is valid for all text classification problems, feature space’s high dimensionality is one of the biggest problems for spam filtering due to accuracy considerations. The contribution of this study is the analysis of the performance of five state-of-the-art text feature selection methods for spam filtering on YouTube using two widely-known classifiers namely naïve Bayes (NB) and decision tree (DT). Five datasets including spam comments belonging to different subjects were utilized in the experiments. These datasets are named as Psy, KatyPerry, LMFAO, Eminem, and Shakira. For evaluation, Macro-F1 success measure were used. Also, 3-fold cross-validation is preferred for a fair performance evaluation. Experiments indicated that distinguishing feature selector (DFS) and Gini Index (GI) methods are superior to the other three feature selection methods for spam filtering on YouTube. However, the performance of DT classifier is better than NB classifier in most cases for spam filtering on YouTube.
Keywords
Feature selection , pattern recognition , spam filtering , YouTube
Kaynakça
- [1] A. K. Uysal ve Y. L. Murphey, "Sentiment classification: Feature selection based approaches versus deep learning," in 17th IEEE International Conference on Computer and Information Technology (CIT), 2017, ss. 23-30.
- [2] B. Parlak ve A. K. Uysal, "The impact of feature selection on medical document classification," in 2016 11th Iberian Conference on Information Systems and Technologies (CISTI), 2016, ss. 1-5.
- [3] B. K. Akkuş ve R. Cakici, "Categorization of Turkish news documents with morphological analysis," in 51st Annual Meeting of the Association for Computational Linguistics Proceedings of the Student Research Workshop, 2013, ss. 1-8.
- [4] P. P. K. Chan, C. Yang, D. S. Yeung ve W. W. Y. Ng, "Spam filtering for short messages in adversarial environment," Neurocomputing, cilt 155, ss. 167-176, 2015.
- [5] A. K. Uysal, S. Gunal, S. Ergin ve E. S. Gunal, "The impact of feature extraction and selection on SMS spam filtering," Elektronika ir Elektrotechnika (Electronics and Electrical Engineering), 2013.
- [6] T. C. Alberto, J. V. Lochter ve T. A. Almeida, "Tubespam: Comment spam filtering on YouTube," in Machine Learning and Applications (ICMLA), 2015 IEEE 14th International Conference on, 2015, ss. 138-143: IEEE.
- [7] A. Serbanoiu ve T. Rebedea, "Relevance-based ranking of video comments on YouTube," in Control Systems and Computer Science (CSCS), 2013 19th International Conference on, 2013, ss. 225-231: IEEE.
- [8] C. Rădulescu, M. Dinsoreanu ve R. Potolea, "Identification of spam comments using natural language processing techniques," in Intelligent Computer Communication and Processing (ICCP), 2014 IEEE International Conference on, 2014, ss. 29-35: IEEE.
- [9] M. Alsaleh, A. Alarifi, F. Al-Quayed ve A. Al-Salman, "Combating comment spam with machine learning approaches," in Machine Learning and Applications (ICMLA), 2015 IEEE 14th International Conference on, 2015, ss. 295-300: IEEE.
- [10] S. Sharmin ve Z. Zaman, "Spam detection in social media employing machine learning tool for text mining," in Signal-Image Technology & Internet-Based Systems (SITIS), 2017 13th International Conference on, 2017, ss. 137-142: IEEE.