<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.4 20241031//EN"
        "https://jats.nlm.nih.gov/publishing/1.4/JATS-journalpublishing1-4.dtd">
<article  article-type="research-article"        dtd-version="1.4">
            <front>

                <journal-meta>
                                                                <journal-id>saucis</journal-id>
            <journal-title-group>
                                                                                    <journal-title>Sakarya University Journal of Computer and Information Sciences</journal-title>
            </journal-title-group>
                                        <issn pub-type="epub">2636-8129</issn>
                                                                                            <publisher>
                    <publisher-name>Sakarya University</publisher-name>
                </publisher>
                    </journal-meta>
                <article-meta>
                                        <article-id pub-id-type="doi">10.35377/saucis...1564138</article-id>
                                                                <article-categories>
                                            <subj-group  xml:lang="en">
                                                            <subject>Software Engineering (Other)</subject>
                                                    </subj-group>
                                            <subj-group  xml:lang="tr">
                                                            <subject>Yazılım Mühendisliği (Diğer)</subject>
                                                    </subj-group>
                                    </article-categories>
                                                                                                                                                        <title-group>
                                                                                                                                                            <article-title>Turkish Stance Detection on Social Media Using BERT Models: A Case Study of Stray Animals Law</article-title>
                                                                                                    </title-group>
            
                                                    <contrib-group content-type="authors">
                                                                        <contrib contrib-type="author">
                                                                    <contrib-id contrib-id-type="orcid">
                                        https://orcid.org/0009-0009-1521-032X</contrib-id>
                                                                <name>
                                    <surname>Alav</surname>
                                    <given-names>Selma</given-names>
                                </name>
                                                                    <aff>FIRAT UNIVERSITY</aff>
                                                            </contrib>
                                                    <contrib contrib-type="author">
                                                                    <contrib-id contrib-id-type="orcid">
                                        https://orcid.org/0000-0001-6282-6703</contrib-id>
                                                                <name>
                                    <surname>Benli</surname>
                                    <given-names>Kristin Surpuhi</given-names>
                                </name>
                                                                    <aff>USKUDAR UNIVERSITY, FACULTY OF ENGINEERING AND NATURAL SCIENCES</aff>
                                                            </contrib>
                                                                                </contrib-group>
                        
                                        <pub-date pub-type="pub" iso-8601-date="20250328">
                    <day>03</day>
                    <month>28</month>
                    <year>2025</year>
                </pub-date>
                                        <volume>8</volume>
                                        <issue>1</issue>
                                        <fpage>76</fpage>
                                        <lpage>88</lpage>
                        
                        <history>
                                    <date date-type="received" iso-8601-date="20241009">
                        <day>10</day>
                        <month>09</month>
                        <year>2024</year>
                    </date>
                                                    <date date-type="accepted" iso-8601-date="20250305">
                        <day>03</day>
                        <month>05</month>
                        <year>2025</year>
                    </date>
                            </history>
                                        <permissions>
                    <copyright-statement>Copyright © 2018, Sakarya University Journal of Computer and Information Sciences</copyright-statement>
                    <copyright-year>2018</copyright-year>
                    <copyright-holder>Sakarya University Journal of Computer and Information Sciences</copyright-holder>
                </permissions>
            
                                                                                                                        <abstract><p>Recently, social media has transformed into an essential platform for information dissemination, allowing individuals to articulate their opinions and apprehensions on a wide array of subjects. Stance detection, which refers to the automated examination of text to ascertain the author’s perspective regarding a specific proposition or subject, has emerged as a significant area of research. Within the scope of this study, a Turkish-labeled dataset was created to determine the stances of social media users regarding the Stray Animals Law and various pre-trained BERT models were fine-tuned on this dataset, four of which were Turkish (BERTurk 32k and 128k, ConvBERTurk and ConvBERTurk mC4), one multilingual (mBERT) and one base (BERT-Base). The BERTurk 128k model outperformed other BERT models by achieving a remarkable accuracy rate of 87.10%, along with 87.11% precision, 87.10% recall, and 87.10% F1 score. In conclusion, this study has accomplished a contribution in the limited field of Turkish stance detection research by comparing various BERT models in the context of Turkish texts that has not been previously undertaken to our knowledge. The promising results that were obtained from this and similar studies could contribute to the automatic extraction of public opinions, thereby assisting policymakers in formulating efficient policies.</p></abstract>
                                                            
            
                                                                                        <kwd-group>
                                                    <kwd>Stance detection</kwd>
                                                    <kwd>  BERT</kwd>
                                                    <kwd>  Text mining</kwd>
                                                    <kwd>  Social media analysis</kwd>
                                                    <kwd>  Turkish dataset</kwd>
                                            </kwd-group>
                            
                                                                                                                                                    </article-meta>
    </front>
    <back>
                            <ref-list>
                                    <ref id="ref1">
                        <label>1</label>
                        <mixed-citation publication-type="journal">D. Küçük and F. Can, “Stance detection: A survey,” ACM Computing Surveys (CSUR), vol. 53, no.1, pp. 1-37, 2020.</mixed-citation>
                    </ref>
                                    <ref id="ref2">
                        <label>2</label>
                        <mixed-citation publication-type="journal">S. Mohammad et al., “Semeval-2016 task 6: Detecting stance in tweets,” Proceedings of the 10th international workshop on semantic evaluation (SemEval-2016). 2016.</mixed-citation>
                    </ref>
                                    <ref id="ref3">
                        <label>3</label>
                        <mixed-citation publication-type="journal">R. Cao et al., “Stance detection for online public opinion awareness: An overview,” International Journal of Intelligent Systems, vol. 37 pp. 11944-11965, 2022.</mixed-citation>
                    </ref>
                                    <ref id="ref4">
                        <label>4</label>
                        <mixed-citation publication-type="journal">D. Küçük and F. Can, “Stance detection on tweets: An svm-based approach,” arXiv preprint arXiv:1803.08910, 2018.</mixed-citation>
                    </ref>
                                    <ref id="ref5">
                        <label>5</label>
                        <mixed-citation publication-type="journal">S. Ghosh et al., “Stance detection in web and social media: a comparative study,” Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, September 9–12, 2019, Proceedings 10. Springer International Publishing, 2019.
L-A. Cotfas et al., “The longest month: analyzing COVID-19 vaccination opinions dynamics from tweets in the month following the first vaccine announcement,” Ieee Access, vol. 9, pp. 33203-33223, 2021.
L. Grimminger and R. Klinger, “Hate towards the political opponent: A Twitter corpus study of the 2020 US elections on the basis of offensive speech and stance detection,” arXiv preprint arXiv:2103.01664, 2021.</mixed-citation>
                    </ref>
                                    <ref id="ref6">
                        <label>6</label>
                        <mixed-citation publication-type="journal">K.K. Polat, N. G. Bayazıt, and O. T. Yıldız, “Türkçe duruş tespit analizi,” Avrupa Bilim ve Teknoloji Dergisi vol. 23, pp.99-107, 2021</mixed-citation>
                    </ref>
                                    <ref id="ref7">
                        <label>7</label>
                        <mixed-citation publication-type="journal">D. Küçük, and N. Arıcı, “Sentiment analysis and stance detection in Turkish tweets about COVID-19 vaccination,” Handbook of research on opinion mining and text analytics on literary works and social media. IGI Global, 371-387, 2022.</mixed-citation>
                    </ref>
                                    <ref id="ref8">
                        <label>8</label>
                        <mixed-citation publication-type="journal">D. Küçük, and N. Arıcı, “Deep learning-based sentiment and stance analysis of Tweets about Vaccination,” International Journal on Semantic Web and Information Systems (IJSWIS), vol. 19, no.1, pp.1-18, 2023.</mixed-citation>
                    </ref>
                                    <ref id="ref9">
                        <label>9</label>
                        <mixed-citation publication-type="journal">M. S. Zengin, B. U. Yenisey, and M. Kutlu, “Exploring the impact of training datasets on Turkish stance detection,” Turkish Journal of Electrical Engineering and Computer Sciences, vol. 31, no.7, pp.1206-1222, 2023.</mixed-citation>
                    </ref>
                                    <ref id="ref10">
                        <label>10</label>
                        <mixed-citation publication-type="journal">S. Arslan and E. Fırat, “Stance Detection on Short Turkish Text: A Case Study of Russia-Ukraine War,” Afyon Kocatepe Üniversitesi Fen Ve Mühendislik Bilimleri Dergisi, vol. 24, no. 3, pp. 602-619, 2024.</mixed-citation>
                    </ref>
                                    <ref id="ref11">
                        <label>11</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “29 temmuz 2024 sokak hayvanları yasası değişikliği,” Available at https://eksisozluk.com/entry/166760652 (Accessed Date: 08.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref12">
                        <label>12</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “29 temmuz 2024 sokak hayvanları yasası değişikliği,” Available at https://eksisozluk.com/entry/166761830 (Accessed Date: 08.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref13">
                        <label>13</label>
                        <mixed-citation publication-type="journal">J. Devlin, M.-W. Chang, K. Lee and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.</mixed-citation>
                    </ref>
                                    <ref id="ref14">
                        <label>14</label>
                        <mixed-citation publication-type="journal">A. Vaswani et al., “Attention is all you need.” Advances in neural information processing systems, 30, 2017.</mixed-citation>
                    </ref>
                                    <ref id="ref15">
                        <label>15</label>
                        <mixed-citation publication-type="journal">P. Savci and B. Das, “Comparison of pre-trained language models in terms of carbon emissions, time and accuracy in multi-label text classification using AutoML,” Heliyon, vol. 9, issue. 5, 2023.</mixed-citation>
                    </ref>
                                    <ref id="ref16">
                        <label>16</label>
                        <mixed-citation publication-type="journal">Hugging Face, “Models,” Available at https://huggingface.co/models?other=bert (Accessed Date: 12.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref17">
                        <label>17</label>
                        <mixed-citation publication-type="journal">Z-H. Jiang et al., “Convbert: Improving bert with span-based dynamic convolution,” Advances in Neural Information Processing Systems, vol. 33, pp. 12837-12848, 2020.</mixed-citation>
                    </ref>
                                    <ref id="ref18">
                        <label>18</label>
                        <mixed-citation publication-type="journal">Hugging Face, “dbmdz Turkish ConvBERT model,” Available at https://huggingface.co/dbmdz/convbert-base-turkish-cased (Accessed Date: 12.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref19">
                        <label>19</label>
                        <mixed-citation publication-type="journal">X. Chen, P. Cong and S. Lv, “A Long-Text Classification Method of Chinese News Based on BERT and CNN,” Ieee Access, vol. 10, pp. 34046-34057, 2022.</mixed-citation>
                    </ref>
                                    <ref id="ref20">
                        <label>20</label>
                        <mixed-citation publication-type="journal">Medium, “Handle Long Text Corpus for Bert Model,” Available at https://medium.com/@priyatoshanand/handle-long-text-corpus-for-bert-model-3c85248214aa (Accessed Date: 13.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref21">
                        <label>21</label>
                        <mixed-citation publication-type="journal">Medium, “Fine-tuning BERT model for arbitrarily long texts, Part 1,” Available at https://medium.com/mim-solutions-blog/fine-tuning-bert-model-for-arbitrarily-long-texts-part-1-299f1533b976 (Accessed Date: 13.08.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref22">
                        <label>22</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “29 temmuz 2024 sokak hayvanları yasası değişikliği”, Available at https://eksisozluk.com/entry/166761830 (Accessed Date: 29.09.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref23">
                        <label>23</label>
                        <mixed-citation publication-type="journal">Y. B. Kaya and A. C. Tantuğ, “Eﬀect of Tokenization Granularity for Turkish Large Language Models,” Journal of Intelligent Systems with Applications, vol. 21, 2024.</mixed-citation>
                    </ref>
                                    <ref id="ref24">
                        <label>24</label>
                        <mixed-citation publication-type="journal">M. T. Ribeiro, S. Singh, and C. Guestrin, “ Why should I trust you?” Explaining the predictions of any classifier, In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135-1144, 2016.</mixed-citation>
                    </ref>
                                    <ref id="ref25">
                        <label>25</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “sahipsiz hayvanlara yönelik kanun teklifi,” Available at https://eksisozluk.com/entry/166275172 (Accessed Date: 23.09.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref26">
                        <label>26</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “sokak hayvanları uyutulacak,” Available at https://eksisozluk.com/entry/164628545 (Accessed Date: 23.09.2024)</mixed-citation>
                    </ref>
                                    <ref id="ref27">
                        <label>27</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “sokak hayvanları uyutulacak,” Available at https://eksisozluk.com/entry/164641295 (Accessed Date: 11.01.2025)</mixed-citation>
                    </ref>
                                    <ref id="ref28">
                        <label>28</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “sahipsiz hayvanlara yönelik kanun teklifi,” Available at https://eksisozluk.com/entry/166318051 (Accessed Date: 11.01.2025)</mixed-citation>
                    </ref>
                                    <ref id="ref29">
                        <label>29</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “14 günde sahiplenilmeyen köpeklerin uyutulması,” Available at https://eksisozluk.com/entry/159777438 (Accessed Date: 11.01.2025)</mixed-citation>
                    </ref>
                                    <ref id="ref30">
                        <label>30</label>
                        <mixed-citation publication-type="journal">Ekşi Sözlük, “sokak hayvanları uyutulacak”, Available at https://eksisozluk.com/entry/164651341 (Accessed Date: 11.01.2025)</mixed-citation>
                    </ref>
                            </ref-list>
                    </back>
    </article>
