Mapping the Emotional Landscape of Voter Behavior: A Transformer-Based Sentiment Analysis of Reddit Discourse in the 2024 U.S. Presidential Election

Abstract

This study examines voter behavior in the context of the 2024 United States Presidential Election by analyzing Reddit user comments. Owing to the platform’s anonymity and community diversity, Reddit provides signals that reflect a wide range of socio-demographic perspectives on the electoral process. A dataset of 7,788 comments was collected through the Reddit API and the PRAW library, then preprocessed (cleaning, normalization, stopword removal, and labeling) for sentiment analysis. In the experimental stage, five transformer-based models (BERT, RoBERTa, DeBERTa, ALBERT, and GPT-2) were comparatively evaluated. Results show that DeBERTa achieved the highest accuracy and F1 scores, while GPT-2 performed relatively poorly in classification tasks. Statistical analyses revealed that 51.6% of Trump-related comments were positive, whereas comments on Harris displayed a more fragmented distribution. Neutral sentiments dominated the “Unknown” category. These findings indicate that Reddit sentiment signals reflect not only descriptive observations but also statistically robust evidence for electoral forecasting. Beyond methodological contributions, the study integrates emotional indicators into the rational-actor assumptions of public choice theory, demonstrating that voter behavior is shaped by both rational and emotional factors. In doing so, it provides an interdisciplinary framework that validates the applicability of artificial intelligence methods to political behavior analysis.

Keywords

• Reddit
• U.S. elections
• Sentiment analysis
• Transformer models
• Public choice theory

Ethical Statement

It is declared that during the preparation of this study, scientific and ethical principles were followed, and all studies cited are listed in the bibliography.

References

1. J. M. Buchanan and G. Tullock, The Calculus of Consent: Logical Foundations of Constitutional Democracy. Ann Arbor, MI, USA: Univ. Michigan Press, 1962.
2. A. Downs, An Economic Theory of Democracy. New York, NY, USA: Harper & Row, 1957.
3. A. Khan, H. Zhang, N. Boudjellal, A. Ahmad, and M. Khan, “Improving sentiment analysis in election-based conversations on Twitter with ElecBERT language model,” Comput., Mater. Continua, vol. 76, no. 3, pp. 3345–3361, 2023, doi: 10.32604/cmc.2023.041520. [Online]. Available: https://doi.org/10.32604/cmc.2023.041520
4. I. Sabuncu and E. Şen, “Derin makine öğrenmesi metoduyla sosyal medya verilerine dayalı seçim sonucu tahmini,” Bus. Manage. Stud.: Int. J., vol. 9, no. 4, pp. 1582–1598, 2021, doi: 10.15295/bmij.v9i4.1957. [Online]. Available: https://doi.org/10.15295/bmij.v9i4.1957
5. R. H. Ali et al., “A large-scale sentiment analysis of tweets pertaining to the 2020 US presidential election,” J. Big Data, vol. 9, no. 1, Art. no. 79, 2022, doi: 10.1186/s40537-022-00633-z. [Online]. Available: https://doi.org/10.1186/s40537-022-00633-z
6. H. N. Chaudhry et al., “Sentiment analysis of before and after elections: Twitter data of U.S. election 2020,” Electronics, vol. 10, no. 17, Art. no. 2082, 2021, doi: 10.3390/electronics10172082. [Online]. Available: https://doi.org/10.3390/electronics10172082
7. L. Belcastro et al., “Analyzing voter behavior on social media during the 2020 US presidential election campaign,” Soc. Netw. Anal. Min., vol. 12, Art. no. 83, 2022, doi: 10.1007/s13278-022-00913-9. [Online]. Available: https://doi.org/10.1007/s13278-022-00913-9
8. A. Singh, A. Kumar, N. Dua, V. K. Mishra, D. Singh, and A. Agrawal, “Predicting election results using social media activitya case study: USA presidential election 2020,” in Proc. 7th Int. Conf. Adv. Comput. Commun. Syst. (ICACCS), 2021, pp. 314–319, doi: 10.1109/ICACCS51430.2021.9441835. [Online]. Available: https://doi.org/10.1109/ICACCS51430.2021.9441835

9. A. Sharma and U. Ghose, “Sentimental analysis of Twitter data with respect to general elections in India,” Procedia Comput. Sci., vol. 173, pp. 325–334, 2020, doi: 10.1016/j.procs.2020.06.038. [Online]. Available: https://doi.org/10.1016/j.procs.2020.06.038
10. A. Agarwal, D. Toshniwal, and J. Bedi, “Can Twitter help to predict the outcome of the 2019 Indian general election: A deep learning-based study,” in Machine Learning and Knowledge Discovery in Databases: ECML PKDD 2019 Workshops, P. Cellier and K. Driessens, Eds., Commun. Comput. Inf. Sci., vol. 1168. Cham, Switzerland: Springer, 2020, pp. 50–65, doi: 10.1007/978-3-030-43887-6 4. [Online]. Available: https://doi.org/10.1007/978-3-030-43887-6_4
11. H. Ali et al., “Deep learning-based election results prediction using Twitter activity,” Soft Comput., vol. 26, no. 13, pp. 7535–7543, 2022, doi: 10.1007/s00500-021-06569-5. [Online]. Available: https://doi.org/10.1007/s00500-021-06569-5
12. K. K. Mohbey, “Multi-class approach for user behavior prediction using deep learning framework on Twitter election dataset,” J. Data Inf. Manage., vol. 2, no. 1, pp. 1–14, 2020, doi: 10.1007/s42488-019-00013-y. [Online]. Available: https://doi.org/10.1007/s42488-019-00013-y
13. P. Chauhan, N. Sharma, and G. Sikka, “The emergence of social media data and sentiment analysis in election prediction,” J. Ambient Intell. Humaniz. Comput., vol. 12, no. 7, pp. 2601–2627, 2021, doi: 10.1007/s12652-020-02423-y. [Online]. Available: https://doi.org/10.1007/s12652-020-02423-y
14. T. Brader, “Striking a responsive chord: How political ads motivate and persuade voters by appealing to emotions,” Amer. J. Political Sci., vol. 49, no. 2, pp. 388–405, 2005, doi: 10.1111/j.0092-5853.2005.00130.x. [Online]. Available: https://doi.org/10.1111/j.0092-5853.2005.00130.x
15. G. E. Marcus and M. B. MacKuen, “Anxiety, enthusiasm, and the vote: The emotional underpinnings of learning and involvement during presidential campaigns,” Amer. Political Sci. Rev., vol. 87, no. 3, pp. 672–685, 1993, doi: 10.2307/2938743. [Online]. Available: https://doi.org/10.2307/2938743
16. P. Barberá, J. T. Jost, J. Nagler, J. A. Tucker, and R. Bonneau, “Tweeting from left to right: Is online political communication more than an echo chamber?” Psychol. Sci., vol. 26, no. 10, pp. 1531–1542, 2015, doi: 10.1177/0956797615594620. [Online]. Available: https://doi.org/10.1177/0956797615594620
17. N. A. Valentino, V. L. Hutchings, A. J. Banks, and A. K. Davis, “Is a worried citizen a good citizen? Emotions, political information seeking, and learning via the Internet,” Political Psychol., vol. 29, no. 2, pp. 247–273, 2008, doi: 10.1111/j.1467-9221.2008.00625.x. [Online]. Available: https://doi.org/10.1111/j.1467-9221.2008.00625.x
18. L. Huddy, S. Feldman, and E. Cassese, “On the distinct political effects of anxiety and anger,” in The Affect Effect: Dynamics of Emotion in Political Thinking and Behavior, W. R. Neuman, G. E. Marcus, A. N. Crigler, and M. MacKuen, Eds. Chicago, IL, USA: Univ. Chicago Press, 2007, pp. 202–230.
19. D. Kahneman, “Maps of bounded rationality: Psychology for behavioral economics,” Amer. Econ. Rev., vol. 93, no. 5, pp. 1449–1475, 2003, doi: 10.1257/000282803322655392. [Online]. Available: https://doi.org/10.1257/000282803322655392
20. A. Halevy, P. Norvig, and F. Pereira, “The unreasonable effectiveness of data,” IEEE Intell. Syst., vol. 24, no. 2, pp. 8–12, Mar./Apr. 2009, doi: 10.1109/MIS.2009.36. [Online]. Available: https://doi.org/10.1109/MIS.2009.36
21. M. Matassi and P. J. Boczkowski, “An agenda for comparative social media studies: The value of understanding practices from cross-national, cross-media, and cross-platform perspectives,” Int. J. Commun., vol. 15, Art. no. 22, 2021.
22. A. Bruns, G. Enli, E. Skogerbø, A. O. Larsson, and C. Christensen, Eds., The Routledge Companion to Social Media and Politics. New York, NY, USA: Routledge, 2016, doi: 10.4324/9781315716299. [Online]. Available: https://doi.org/10.4324/9781315716299
23. M. A. Russell, Mining the Social Web: Analyzing Data from Facebook, Twitter, LinkedIn, and Other Social Media Sites. Sebastopol, CA, USA: O’Reilly Media, 2011.
24. J. Singh, “Social media analysis using natural language processing techniques,” in Proc. 20th Python Sci. Conf. (SciPy), 2021, pp. 74–80.
25. Reddit, “Reddit API documentation,” 2024. [Online]. Available: https://www.reddit.com/dev/api/
26. M. Adedoyin-Olowe, M. M. Gaber, and F. Stahl, “A survey of data mining techniques for social media analysis,” J. Data Mining Digit. Humanit., 2014, arXiv:1312.4617. [Online]. Available: https://arxiv.org/abs/1312.4617
27. S. Vijayarani, M. J. Ilamathi, and M. Nithya, “Preprocessing techniques for text mining—An overview,” Int. J. Comput. Sci. Commun. Netw., vol. 5, no. 1, pp. 7–16, 2015.
28. C. A. Flores, R. L. Figueroa, J. E. Pezoa, and Q. Zeng-Treitler, “CREGEX: A biomedical text classifier based on automatically generated regular expressions,” IEEE Access, vol. 8, pp. 29270–29280, 2020, doi: 10.1109/ACCESS.2020.2972205. [Online]. Available: https://doi.org/10.1109/ACCESS.2020.2972205
29. J. Camacho-Collados and M. T. Pilehvar, “On the role of text preprocessing in neural network architectures: An evaluation study on text categorization and sentiment analysis,” in Proc. 2018 EMNLP Workshop BlackboxNLP: Analyzing Interpreting Neural Netw. NLP, Brussels, Belgium, 2018, pp. 40–46, doi: 10.18653/v1/W18-5406. [Online]. Available: https://doi.org/10.18653/v1/W18-5406
30. H. Zhang, R. Sproat, A. H. Ng, F. Stahlberg, X. Peng, K. Gorman, and B. Roark, “Neural models of text normalization for speech applications,” Comput. Linguist., vol. 45, no. 2, pp. 293–337, 2019, doi: 10.1162/coli a 00349. [Online]. Available: https://doi.org/10.1162/coli_a_00349
31. S. Sarica and J. Luo, “Stopwords in technical language processing,” PLOS ONE, vol. 16, no. 8, Art. no. e0254937, 2021, doi: 10.1371/journal.pone.0254937. [Online]. Available: https://doi.org/10.1371/journal.pone.0254937
32. M. Siino, I. Tinnirello, and M. La Cascia, “Is text preprocessing still worth the time? A comparative survey on the influence of popular preprocessing methods on Transformers and traditional classifiers,” Inf. Syst., vol. 121, Art. no. 102342, 2024, doi: 10.1016/j.is.2023.102342. [Online]. Available: https://doi.org/10.1016/j.is.2023.102342
33. J. R. Jim, M. A. R. Talukder, P. Malakar, M. M. Kabir, K. Nur, and M. F. Mridha, “Recent advancements and challenges of NLP-based sentiment analysis: A state-of-the-art review,” Nat. Lang. Process. J., vol. 6, Art. no. 100059, 2024, doi: 10.1016/j.nlp.2024.100059. [Online]. Available: https://doi.org/10.1016/j.nlp.2024.100059
34. A. Gasparetto, M. Marcuzzo, A. Zangari, and A. Albarelli, “A survey on text classification algorithms: From text to predictions,” Information, vol. 13, no. 2, Art. no. 83, 2022, doi: 10.3390/info13020083. [Online]. Available: https://doi.org/10.3390/info13020083
35. S. Loria, “TextBlob: Simplified text processing,” 2014. [Online]. Available: https://textblob.readthedocs.io/
36. B. Liu, Sentiment Analysis and Opinion Mining. Cham, Switzerland: Springer Nature, 2022.
37. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008, doi: 10.1017/CBO9780511809071. [Online]. Available: https://doi.org/10.1017/CBO9780511809071
38. V. Gupta and G. S. Lehal, “A survey of text mining techniques and applications,” J. Emerg. Technol. Web Intell., vol. 1, no. 1, pp. 60–76, Aug. 2009, doi: 10.4304/jetwi.1.1.60-76. [Online]. Available: https://doi.org/10.4304/jetwi.1.1.60-76
39. A. Vaswani et al., “Attention is all you need,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 30, 2017, pp. 5998–6008, doi: 10.48550/arXiv.1706.03762. [Online]. Available: https://arxiv.org/abs/1706.03762
40. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. 2019 Conf. North Amer. Chapter Assoc. Comput. Linguist.: Human Lang. Technol. (NAACL-HLT), Minneapolis, MN, USA, 2019, pp. 4171–4186, doi: 10.18653/v1/N19-1423. [Online]. Available: https://doi.org/10.18653/v1/N19-1423
41. Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” 2019, arXiv:1907.11692, doi: 10.48550/arXiv.1907.11692. [Online]. Available: https://arxiv.org/abs/1907.11692
42. P. He, X. Liu, J. Gao, and W. Chen, “DeBERTa: Decoding-enhanced BERT with disentangled attention,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2021, arXiv:2006.03654, doi: 10.48550/arXiv.2006.03654. [Online]. Available: https://arxiv.org/abs/2006.03654
43. Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, “ALBERT: A lite BERT for self-supervised learning of language representations,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2020, arXiv:1909.11942, doi: 10.48550/arXiv.1909.11942. [Online]. Available: https://arxiv.org/abs/1909.11942
44. A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, “Language models are unsupervised multitask learners,” OpenAI, San Francisco, CA, USA, Tech. Rep., 2019. [Online]. Available: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
45. H. A. Simon, “A behavioral model of rational choice,” Quart. J. Econ., vol. 69, no. 1, pp. 99–118, 1955, doi: 10.2307/1884852. [Online]. Available: https://doi.org/10.2307/1884852
46. H. A. Simon, “Rationality as process and as product of thought,” Amer. Econ. Rev., vol. 68, no. 2, pp. 1–16, May 1978.
47. D. Kahneman and A. Tversky, “Prospect theory: An analysis of decision under risk,” Econometrica, vol. 47, no. 2, pp. 263–291, Mar. 1979, doi: 10.2307/1914185. [Online]. Available: https://doi.org/10.2307/1914185
48. A. Tversky and D. Kahneman, “Advances in prospect theory: Cumulative representation of uncertainty,” J. Risk Uncertainty, vol. 5, no. 4, pp. 297–323, Oct. 1992, doi: 10.1007/BF00122574. [Online]. Available: https://doi.org/10.1007/BF00122574