<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.4 20241031//EN"
        "https://jats.nlm.nih.gov/publishing/1.4/JATS-journalpublishing1-4.dtd">
<article  article-type="research-article"        dtd-version="1.4">
            <front>

                <journal-meta>
                                                                <journal-id>saucis</journal-id>
            <journal-title-group>
                                                                                    <journal-title>Sakarya University Journal of Computer and Information Sciences</journal-title>
            </journal-title-group>
                                        <issn pub-type="epub">2636-8129</issn>
                                                                                            <publisher>
                    <publisher-name>Sakarya University</publisher-name>
                </publisher>
                    </journal-meta>
                <article-meta>
                                        <article-id pub-id-type="doi">10.35377/saucis...1747068</article-id>
                                                                <article-categories>
                                            <subj-group  xml:lang="en">
                                                            <subject>Computer Software</subject>
                                                    </subj-group>
                                            <subj-group  xml:lang="tr">
                                                            <subject>Bilgisayar Yazılımı</subject>
                                                    </subj-group>
                                    </article-categories>
                                                                                                                                                        <title-group>
                                                                                                                                                            <article-title>BERT-Based Sentiment Analysis of Turkish  e-Commerce Reviews: Star Ratings Versus Text</article-title>
                                                                                                    </title-group>
            
                                                    <contrib-group content-type="authors">
                                                                        <contrib contrib-type="author">
                                                                    <contrib-id contrib-id-type="orcid">
                                        https://orcid.org/0000-0002-1925-4305</contrib-id>
                                                                <name>
                                    <surname>Öcal</surname>
                                    <given-names>Ayşe</given-names>
                                </name>
                                                                    <aff>YILDIZ TECHNICAL UNIVERSITY</aff>
                                                            </contrib>
                                                                                </contrib-group>
                        
                                        <pub-date pub-type="pub" iso-8601-date="20251229">
                    <day>12</day>
                    <month>29</month>
                    <year>2025</year>
                </pub-date>
                                        <volume>8</volume>
                                        <issue>4</issue>
                                        <fpage>677</fpage>
                                        <lpage>687</lpage>
                        
                        <history>
                                    <date date-type="received" iso-8601-date="20250721">
                        <day>07</day>
                        <month>21</month>
                        <year>2025</year>
                    </date>
                                                    <date date-type="accepted" iso-8601-date="20250825">
                        <day>08</day>
                        <month>25</month>
                        <year>2025</year>
                    </date>
                            </history>
                                        <permissions>
                    <copyright-statement>Copyright © 2018, Sakarya University Journal of Computer and Information Sciences</copyright-statement>
                    <copyright-year>2018</copyright-year>
                    <copyright-holder>Sakarya University Journal of Computer and Information Sciences</copyright-holder>
                </permissions>
            
                                                                                                                        <abstract><p>This study examines sentiment analysis in Turkish e-commerce product reviews by comparing two distinct approaches: classification based on star ratings and textual sentiment using a BERT-based model. Two models were fine-tuned for this purpose: Model 1, trained on numerical star ratings, and Model 2, trained on manually labeled sentiment in review texts, to evaluate their performance in accurately capturing customer sentiment. The results reveal that star ratings often fail to reflect true sentiment, as many users assign high ratings despite expressing negative opinions in the text. Model 1 tended to overclassify reviews as negative, while Model 2, which used direct text sentiment labels, provided a more balanced classification across sentiment categories. Chi-square tests confirmed a statistically significant difference between the predictions of the two models, highlighting the impact of labeling methods on model behavior. Furthermore, our findings reinforce the value of deep learning approaches, particularly transformer-based models like BERT, in processing Turkish-language texts, which pose challenges for traditional dictionary-based methods due to their complex morphology and syntax. From a business perspective, relying solely on star ratings may lead to an inaccurate interpretation of sentiment. Incorporating text-based analysis can offer more precise insights into customer satisfaction. Future research may explore multimodal sentiment analysis by integrating visual or video data and examining how AI-driven sentiment systems influence decision-making processes across different sectors.</p></abstract>
                                                            
            
                                                                                        <kwd-group>
                                                    <kwd>Sentiment analysis</kwd>
                                                    <kwd>  BERT</kwd>
                                                    <kwd>  Turkish language</kwd>
                                                    <kwd>  E-Commerce</kwd>
                                                    <kwd>  Natural language processing</kwd>
                                            </kwd-group>
                            
                                                                                                                                                    </article-meta>
    </front>
    <back>
                            <ref-list>
                                    <ref id="ref1">
                        <label>1</label>
                        <mixed-citation publication-type="journal">M. S. Akin, “Enhancing e-commerce competitiveness: A comprehensive analysis of customer experiences and strategies in the Turkish market,” Journal of Open Innovation: Technology, Market, and Complexity, vol. 10, no. 1, p. 100222, Mar. 2024, doi: 10.1016/j.joitmc.2024.100222.</mixed-citation>
                    </ref>
                                    <ref id="ref2">
                        <label>2</label>
                        <mixed-citation publication-type="journal">N. Yücel and Ö. Cömert, “Müşteri Duyarlılığını Keşfetmek İçin Yapay Zeka Destekli Analiz ile Çevrimiçi Ürün İncelemelerinden Anlamlı Bilgiler Elde Etme,” Fırat Üniversitesi Mühendislik Bilimleri Dergisi, vol. 35, no. 2, pp. 679–690, Sep. 2023, doi: 10.35234/fumbd.1305932.</mixed-citation>
                    </ref>
                                    <ref id="ref3">
                        <label>3</label>
                        <mixed-citation publication-type="journal">M. T. Barutcu and B. Basak, “Customer Complaints about E-Commerce Sites: Content Analysis,” 2018.</mixed-citation>
                    </ref>
                                    <ref id="ref4">
                        <label>4</label>
                        <mixed-citation publication-type="journal">Elif Ayanoğlu, Zeynep Çolak, Toygar Tanyel, Hasan Yunus Sarıoğlu, and Banu Diri, “Detection and Classification of Customer Comments Containing Complaints,” Nov. 2023, doi: 10.5281/ZENODO.10254498.</mixed-citation>
                    </ref>
                                    <ref id="ref5">
                        <label>5</label>
                        <mixed-citation publication-type="journal">M. Demircan, A. Seller, F. Abut, and M. F. Akay, “Developing Turkish sentiment analysis models using machine learning and e-commerce data,” International Journal of Cognitive Computing in Engineering, vol. 2, pp. 202–207, Jun. 2021, doi: 10.1016/j.ijcce.2021.11.003.</mixed-citation>
                    </ref>
                                    <ref id="ref6">
                        <label>6</label>
                        <mixed-citation publication-type="journal">J. R. Jim, M. A. R. Talukder, P. Malakar, M. M. Kabir, K. Nur, and M. F. Mridha, “Recent advancements and challenges of NLP-based sentiment analysis: A state-of-the-art review,” Natural Language Processing Journal, vol. 6, p. 100059, Mar. 2024, doi: 10.1016/j.nlp.2024.100059.</mixed-citation>
                    </ref>
                                    <ref id="ref7">
                        <label>7</label>
                        <mixed-citation publication-type="journal">A. Ocal, “Perceptions of the Future of Artificial Intelligence on Social Media: A Topic Modeling and Sentiment Analysis Approach,” IEEE Access, vol. 12, pp. 182386–182409, 2024, doi: 10.1109/ACCESS.2024.3510526.</mixed-citation>
                    </ref>
                                    <ref id="ref8">
                        <label>8</label>
                        <mixed-citation publication-type="journal">A. Ocal, “Framing, Emotions, Salience: The Future of AI as Seen by Redditors,” Ph.D., Syracuse University, United States -- New York, 2023. Accessed: Oct. 19, 2023. [Online]. Available: https://www.proquest.com/docview/2845416849</mixed-citation>
                    </ref>
                                    <ref id="ref9">
                        <label>9</label>
                        <mixed-citation publication-type="journal">A. Ocal and K. Crowston, “Framing and feelings on social media: the futures of work and intelligent machines,” ITP, vol. 37, no. 7, pp. 2462–2488, Apr. 2024, doi: 10.1108/ITP-01-2023-0049.</mixed-citation>
                    </ref>
                                    <ref id="ref10">
                        <label>10</label>
                        <mixed-citation publication-type="journal">A. Öcal, L. Xiao, and J. Park, “Reasoning in social media: insights from Reddit ‘Change My View’ submissions,” Online Information Review, vol. 45, no. 7, pp. 1208–1226, Jan. 2021, doi: 10.1108/OIR-08-2020-0330.</mixed-citation>
                    </ref>
                                    <ref id="ref11">
                        <label>11</label>
                        <mixed-citation publication-type="journal">A. Ocal, “Perceptions of AI Ethics on Social Media,” in 2023 IEEE International Symposium on Ethics in Engineering, Science and Technology (ETHICS), IEEE, 2023. doi: 10.1109/ETHICS57328.2023.10155069.</mixed-citation>
                    </ref>
                                    <ref id="ref12">
                        <label>12</label>
                        <mixed-citation publication-type="journal">S. F. Yilmaz, E. B. Kaynak, A. Koc, H. Dibeklioglu, and S. S. Kozat, “Multi-Label Sentiment Analysis on 100 Languages With Dynamic Weighting for Label Imbalance,” IEEE Trans. Neural Netw. Learning Syst., vol. 34, no. 1, pp. 331–343, Jan. 2023, doi: 10.1109/TNNLS.2021.3094304.</mixed-citation>
                    </ref>
                                    <ref id="ref13">
                        <label>13</label>
                        <mixed-citation publication-type="journal">İ. Yurtseven, S. Bagriyanik, and S. Ayvaz, “A Review of Spam Detection in Social Media,” in 2021 6th International Conference on Computer Science and Engineering (UBMK), Sep. 2021, pp. 383–388. doi: 10.1109/UBMK52708.2021.9558993.</mixed-citation>
                    </ref>
                                    <ref id="ref14">
                        <label>14</label>
                        <mixed-citation publication-type="journal">S. Ayvaz, S. Yıldırım, and Y. B. Salman, “Türkçe Duygu Kütüphanesi Geliştirme: Sosyal Medya Verileriyle Duygu Analizi Çalışması,” European Journal of Science and Technology, pp. 51–60, Aug. 2019, doi: 10.31590/ejosat.537085.</mixed-citation>
                    </ref>
                                    <ref id="ref15">
                        <label>15</label>
                        <mixed-citation publication-type="journal">N. Öztürk and S. Ayvaz, “Sentiment analysis on Twitter: A text mining approach to the Syrian refugee crisis,” Telematics and Informatics, vol. 35, no. 1, pp. 136–147, Apr. 2018, doi: 10.1016/j.tele.2017.10.006.</mixed-citation>
                    </ref>
                                    <ref id="ref16">
                        <label>16</label>
                        <mixed-citation publication-type="journal">S. M. Mohammad and P. D. Turney, “Crowdsourcing A Word–Emotion Association Lexicon,” Computational Intelligence, vol. 29, no. 3, pp. 436–465, Aug. 2013, doi: 10.1111/j.1467-8640.2012.00460.x.</mixed-citation>
                    </ref>
                                    <ref id="ref17">
                        <label>17</label>
                        <mixed-citation publication-type="journal">W. van Atteveldt, M. A. C. G. van der Velden, and M. Boukes, “The Validity of Sentiment Analysis: Comparing Manual Annotation, Crowd-Coding, Dictionary Approaches, and Machine Learning Algorithms,” Communication Methods and Measures, vol. 15, no. 2, pp. 121–140, Apr. 2021, doi: 10.1080/19312458.2020.1869198.</mixed-citation>
                    </ref>
                                    <ref id="ref18">
                        <label>18</label>
                        <mixed-citation publication-type="journal">J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of NAACL-HLT, Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4171–4186.</mixed-citation>
                    </ref>
                                    <ref id="ref19">
                        <label>19</label>
                        <mixed-citation publication-type="journal">U. U. Acikalin, B. Bardak, and M. Kutlu, “Turkish Sentiment Analysis Using BERT,” in 2020 28th Signal Processing and Communications Applications Conference (SIU), Gaziantep, Turkey: IEEE, Oct. 2020. doi: 10.1109/siu49456.2020.9302492.</mixed-citation>
                    </ref>
                                    <ref id="ref20">
                        <label>20</label>
                        <mixed-citation publication-type="journal">B. Ciftci and M. S. Apaydin, “A Deep Learning Approach to Sentiment Analysis in Turkish,” in 2018 International Conference on Artificial Intelligence and Data Processing (IDAP), Malatya, Turkey: IEEE, Sep. 2018, pp. 1–5. doi: 10.1109/idap.2018.8620751.</mixed-citation>
                    </ref>
                                    <ref id="ref21">
                        <label>21</label>
                        <mixed-citation publication-type="journal">G. Yavuz, “Web Kazima Ve Duygu Analizi Temelli Ürün Analiz Sistemi,” 2023. Master&#039;s Thesis.</mixed-citation>
                    </ref>
                                    <ref id="ref22">
                        <label>22</label>
                        <mixed-citation publication-type="journal">M. Masarifoglu et al., “Sentiment Analysis of Customer Comments in Banking using BERT-based Approaches,” in 2021 29th Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkey: IEEE, Jun. 2021, pp. 1–4. doi: 10.1109/siu53274.2021.9477890.</mixed-citation>
                    </ref>
                                    <ref id="ref23">
                        <label>23</label>
                        <mixed-citation publication-type="journal">M. Arzu and M. Aydoğan, “Türkçe Duygu Sınıflandırma İçin Transformers Tabanlı Mimarilerin Karşılaştırılmalı Analizi,” JCS, Aug. 2023, doi: 10.53070/bbd.1350405.</mixed-citation>
                    </ref>
                                    <ref id="ref24">
                        <label>24</label>
                        <mixed-citation publication-type="journal">N. Paker and B. Kizilirmak, “Çevrim İçi Müşteri Yorumlarını Etkileyen Faktörler Üzerine Keşifsel Bir Çalışma: Trendyol Örneği,” Anadolu Üniversitesi Sosyal Bilimler Dergisi, vol. 23, no. 4, pp. 1393–1414, Dec. 2023, doi: 10.18037/ausbd.1309934.</mixed-citation>
                    </ref>
                                    <ref id="ref25">
                        <label>25</label>
                        <mixed-citation publication-type="journal">S. İLhan Omurca, E. Eki̇Nci̇, E. Yakupoğlu, E. Arslan, and B. Çapar, “Automatic Detection of the Topics in Customer Complaints with Artificial Intelligence,” Balkan Journal of Electrical and Computer Engineering, vol. 9, no. 3, pp. 268–277, Jul. 2021, doi: 10.17694/bajece.832274.</mixed-citation>
                    </ref>
                                    <ref id="ref26">
                        <label>26</label>
                        <mixed-citation publication-type="journal">B. Teke, S. N. Yazıcı, G. Zamir, A. B. Budak, and I. Karabey Aksakallı, “BERTurk-Based Sentiment Analysis on E-Commerce Multi Domain Product Reviews,” Afyon Kocatepe University Journal of Sciences and Engineering, vol. 25, no. 3, pp. 497–509, May 2025, doi: 10.35414/akufemubid.1537513.</mixed-citation>
                    </ref>
                                    <ref id="ref27">
                        <label>27</label>
                        <mixed-citation publication-type="journal">S. Yildirim, “Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks,” Jan. 30, 2024, arXiv: arXiv:2401.17396. doi: 10.48550/arXiv.2401.17396.</mixed-citation>
                    </ref>
                                    <ref id="ref28">
                        <label>28</label>
                        <mixed-citation publication-type="journal">P. Savci and B. Das, “Prediction of the customers’ interests using sentiment analysis in e-commerce data for comparison of Arabic, English, and Turkish languages,” Journal of King Saud University - Computer and Information Sciences, vol. 35, no. 3, pp. 227–237, Mar. 2023, doi: 10.1016/j.jksuci.2023.02.017.</mixed-citation>
                    </ref>
                                    <ref id="ref29">
                        <label>29</label>
                        <mixed-citation publication-type="journal">S. Sinha, A. Jayan, and R. Kumar, “An Analysis and Comparison of Deep-Learning Techniques and Hybrid Model for Sentiment Analysis for Movie Review,” in 2022 3rd International Conference for Emerging Technology (INCET), May 2022, pp. 1–5. doi: 10.1109/INCET54531.2022.9824630.</mixed-citation>
                    </ref>
                                    <ref id="ref30">
                        <label>30</label>
                        <mixed-citation publication-type="journal">T. Tanyel, B. Alkurdi, and S. Ayvaz, Linguistic-based Data Augmentation Approach for Offensive Language Detection. 2022, p. 6. doi: 10.1109/UBMK55850.2022.9919562.</mixed-citation>
                    </ref>
                                    <ref id="ref31">
                        <label>31</label>
                        <mixed-citation publication-type="journal">M. Gürbüz and M. Kotan, “Multi-Category E-Commerce Insights via Social Media Analysis using Machine Learning and BERT,” acin, vol. 0, no. 0, pp. 0–0, Feb. 2025, doi: 10.26650/acin.1483488.</mixed-citation>
                    </ref>
                                    <ref id="ref32">
                        <label>32</label>
                        <mixed-citation publication-type="journal">A. Dalgali and K. Crowston, “Sharing Open Deep Learning Models,” presented at the Hawai’i International Conference on System Science., Jan. 2019. doi: 10.24251/HICSS.2019.256.</mixed-citation>
                    </ref>
                                    <ref id="ref33">
                        <label>33</label>
                        <mixed-citation publication-type="journal">A. Dalgali and K. Crowston, “Algorithmic Journalism and Its Impacts on Work,” Computation + Journalism Symposium, 2020, [Online]. Available: https://cj2020.northeastern.edu/</mixed-citation>
                    </ref>
                                    <ref id="ref34">
                        <label>34</label>
                        <mixed-citation publication-type="journal">A. Dalgali and K. Crowston, “Factors Influencing Approval of Wikipedia Bots,” in The Hawaii International Conference on System Sciences, 2020, p. 10. [Online]. Available: http://hdl.handle.net/10125/63757</mixed-citation>
                    </ref>
                                    <ref id="ref35">
                        <label>35</label>
                        <mixed-citation publication-type="journal">M. Bozuyla, “Sentiment Analysis of Turkish Drug Reviews with Bidirectional Encoder Representations from Transformers,” ACM Trans. Asian Low-Resour. Lang. Inf. Process., vol. 23, no. 1, pp. 1–17, Jan. 2024, doi: 10.1145/3626523.</mixed-citation>
                    </ref>
                                    <ref id="ref36">
                        <label>36</label>
                        <mixed-citation publication-type="journal">H. A. Love et al., “The Future of Work in the Age of Automation: Proceedings of a Workshop on Norbert Wiener’s 21st Century Legacy,” IEEE Trans. Technol. Soc., pp. 1–23, 2024, doi: 10.1109/TTS.2024.3476041.</mixed-citation>
                    </ref>
                            </ref-list>
                    </back>
    </article>
