<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.4 20241031//EN"
        "https://jats.nlm.nih.gov/publishing/1.4/JATS-journalpublishing1-4.dtd">
<article  article-type="research-article"        dtd-version="1.4">
            <front>

                <journal-meta>
                                                                <journal-id>j higher edu sci</journal-id>
            <journal-title-group>
                                                                                    <journal-title>Yükseköğretim ve Bilim Dergisi</journal-title>
            </journal-title-group>
                            <issn pub-type="ppub">2146-5959</issn>
                                        <issn pub-type="epub">2146-5967</issn>
                                                                                            <publisher>
                    <publisher-name>Zonguldak Bülent Ecevit Üniversitesi</publisher-name>
                </publisher>
                    </journal-meta>
                <article-meta>
                                        <article-id/>
                                                                <article-categories>
                                            <subj-group  xml:lang="en">
                                                            <subject>Studies on Education</subject>
                                                    </subj-group>
                                            <subj-group  xml:lang="tr">
                                                            <subject>Eğitim Üzerine Çalışmalar</subject>
                                                    </subj-group>
                                    </article-categories>
                                                                                                                                                        <title-group>
                                                                                                                        <trans-title-group xml:lang="en">
                                    <trans-title>How Blind is Double Blind Review?</trans-title>
                                </trans-title-group>
                                                                                                                                                                                                <article-title>Çift Kör Hakemlik Sistemi Ne Kadar Kör?</article-title>
                                                                                                    </title-group>
            
                                                    <contrib-group content-type="authors">
                                                                        <contrib contrib-type="author">
                                                                    <contrib-id contrib-id-type="orcid">
                                        https://orcid.org/0000-0002-9863-5957</contrib-id>
                                                                <name>
                                    <surname>Eyerci</surname>
                                    <given-names>Cem</given-names>
                                </name>
                                                                    <aff>Türkiye Cumhuriyet Merkez Bankası</aff>
                                                            </contrib>
                                                                                </contrib-group>
                        
                                        <pub-date pub-type="pub" iso-8601-date="20210831">
                    <day>08</day>
                    <month>31</month>
                    <year>2021</year>
                </pub-date>
                                        <volume>11</volume>
                                        <issue>2</issue>
                                        <fpage>328</fpage>
                                        <lpage>338</lpage>
                        
                        <history>
                                    <date date-type="received" iso-8601-date="20210315">
                        <day>03</day>
                        <month>15</month>
                        <year>2021</year>
                    </date>
                                                    <date date-type="accepted" iso-8601-date="20210526">
                        <day>05</day>
                        <month>26</month>
                        <year>2021</year>
                    </date>
                            </history>
                                        <permissions>
                    <copyright-statement>Copyright © 2011, Yükseköğretim ve Bilim Dergisi</copyright-statement>
                    <copyright-year>2011</copyright-year>
                    <copyright-holder>Yükseköğretim ve Bilim Dergisi</copyright-holder>
                </permissions>
            
                                                                                                <trans-abstract xml:lang="en">
                            <p>The peer-review system as a critical tool in academic processes is regarded to be essential. It is not used only to evaluate the manuscriptssubmitted to the journals but also in tenure decisions, academic promotions, and grant applications. However, during the last few decades,the system has also become a subject of academic research and criticized from various aspects. Many scholars studied the process andpresented biases emerging due to the characteristics of the authors and reviewers. In this paper, the journals published by the faculties ofeconomics and administrative sciences and the faculties of political sciences and indexed by TR Dizin are studied. It is observed that thelanguage of the article, number, title, gender, and institutional affiliation of the authors do not influence the acceptance period. However,there is a difference between the average acceptance periods of the journals, which are quite similar. Moreover, being a faculty member ofthe publisher provides a significantly shorter acceptance period on average. The reason for such differentiation may be either the existenceof a considerable extent of bias at the editorial stages of the process or the communication of the editors with the reviewers in a way thatinfluences the process.</p></trans-abstract>
                                                                                                                                    <abstract><p>Akademik süreçlerin önemli bir aracı olan hakemlik sistemi sadece akademik çalışmaların yayınlanmaya uygunluklarının belirlenmesindedeğil, araştırma bursu ve akademik pozisyon başvuruları ile terfi taleplerinin değerlendirmesindeki etkin rolüyle de vazgeçilmez olarakgörülmektedir. Bununla birlikte son yıllarda kendisi akademik çalışmaların konusu hâline gelen sistem çeşitli yönlerden eleştirilmekte,makale yazarı ve hakemlerin niteliklerine bağlı yanlılıklar içerdiğini ortaya koyan çalışmalar yapılmakta ve bu olumsuzlukları giderebileceğidüşünülen alternatifler aranmaktadır. Bu çalışmada iktisadi ve idari bilimler ve siyasal bilgiler fakültelerinin çıkardığı, TR Dizin kapsamındaolan ve son üç yıldaki sayılarında makalelerin başvuru ve kabul tarihlerini yayınlayan dergiler taranmış ve makalelerin ortalama kabulsürelerinin yazım dili, yazar sayısı, yazarların unvanı, cinsiyeti ve bir üniversite mensubu olup olmadıklarına göre farklılaşmadığı sonucunaulaşılmıştır. Öte yandan, aynı alanda yayın yapan benzer nitelikteki dergilerin ortalama kabul sürelerinde büyük farklar gözlenmiştir. Dahada önemlisi, makale yazarlarının dergiyi çıkaran üniversiteye mensup olmaları makale kabul sürelerini anlamlı düzeyde kısaltabilmektedir.Bu durum çift kör hakemlik sürecinin editörlerce işletilen aşamalarında önemli ölçüde yanlılık oluştuğu, bazı yazarların makaleleri içinyanlılığa sebep olacak şekilde hakem seçildiği veya editörlerin hakemlerle süreci etkileyecek şekilde iletişim kurduğu anlamına gelmektedir</p></abstract>
                                                            
            
                                                                                        <kwd-group>
                                                    <kwd>Akademik hakemlikte yanlılık</kwd>
                                                    <kwd>  Çift kör hakemlik</kwd>
                                                    <kwd>  TR Dizin</kwd>
                                            </kwd-group>
                            
                                                <kwd-group xml:lang="en">
                                                    <kwd>Bias in peer-review</kwd>
                                                    <kwd>  Double blind peer-review</kwd>
                                                    <kwd>  TR Dizin</kwd>
                                            </kwd-group>
                                                                                                                                        </article-meta>
    </front>
    <back>
                            <ref-list>
                                    <ref id="ref1">
                        <label>1</label>
                        <mixed-citation publication-type="journal">Akça, S., &amp; Akbulut, M. (2020). Bilimsel İletişimin Görünmeyen Eli: Hakemlik. Türk Kütüphaneciliği, 34(3), 559-563.</mixed-citation>
                    </ref>
                                    <ref id="ref2">
                        <label>2</label>
                        <mixed-citation publication-type="journal">Al, U., &amp; Soydal, I. (2017). Publication lag and early view effects in information science journals. Aslib Journal of Information Management, 69(2), 118-130.</mixed-citation>
                    </ref>
                                    <ref id="ref3">
                        <label>3</label>
                        <mixed-citation publication-type="journal">Aldırmaz, Y. (2020). Türkiye’de Akademide Cinsiyet Eşit(siz)liği Raporu. https://www.researchgate.net/publication/342511353_Turkiye%27de_Akademide_Cinsiyet_Esitsizligi_Raporu_2020_Gender_Inequality_Report_at_the_Academy_in_Turkey_2020.</mixed-citation>
                    </ref>
                                    <ref id="ref4">
                        <label>4</label>
                        <mixed-citation publication-type="journal">Bornmann, L. (2011). Scientific peer review. İçinde B. Cronin (Ed.), Annual review of information science and technology (C. 45, ss. 197-245). Medford, New Jersey: Information Today/American Society for InformationScience &amp; Technology.</mixed-citation>
                    </ref>
                                    <ref id="ref5">
                        <label>5</label>
                        <mixed-citation publication-type="journal">Burnham, J. C. (1990). The evolution of editorial peer review. Journal of the American Medical Association, 263(10), 1323-1329.</mixed-citation>
                    </ref>
                                    <ref id="ref6">
                        <label>6</label>
                        <mixed-citation publication-type="journal">Clarivate Web of Science. (2018). Publons Global State of Peer Review.</mixed-citation>
                    </ref>
                                    <ref id="ref7">
                        <label>7</label>
                        <mixed-citation publication-type="journal">da Silva, J. A. T., &amp; Bornemann-Cimenti, H. (2017). Why do some retracted papers continue to be cited? Scientometrics, 110(1), 365-370.</mixed-citation>
                    </ref>
                                    <ref id="ref8">
                        <label>8</label>
                        <mixed-citation publication-type="journal">Dilek-Kayaoğlu, H., &amp; Gülle, M. T. (2015). Türkiye’de Toplumsal Bilimler ve İnsan Bilimleri Dergilerinde Hakemlik Süreci: Yazar, Hakem ve Editör Bakış Açılarından Bir İnceleme. Türk Kütüphaneciliği, 29(3), 391-342.</mixed-citation>
                    </ref>
                                    <ref id="ref9">
                        <label>9</label>
                        <mixed-citation publication-type="journal">Fox, C. W., Thompson, K., Knapp, A., Ferry, L. A., Rezende, E. L., Aimé, E., &amp; Meyer, J. (2019). Double‐blind peer review—An experiment. Functional Ecology, 33, 4-6.</mixed-citation>
                    </ref>
                                    <ref id="ref10">
                        <label>10</label>
                        <mixed-citation publication-type="journal">Gans, J. S., &amp; Shepherd, G. B. (1994). How are the mighty fallen: Rejected classic articles by leading economists. Journal of Economic Perspectives, 8(1), 165-179.</mixed-citation>
                    </ref>
                                    <ref id="ref11">
                        <label>11</label>
                        <mixed-citation publication-type="journal">García, J. A., Rodriguez-Sánchez, R., &amp; Fdez-Valdivia, J. (2020). Confirmatory bias in peer review. Scientometrics, 123(1), 517-533.</mixed-citation>
                    </ref>
                                    <ref id="ref12">
                        <label>12</label>
                        <mixed-citation publication-type="journal">Heckman, J. J., &amp; Moktan, S. (2020). Publishing and promotion in economics: The tyranny of the top five. Journal of Economic Literature, 58(2), 419-470.</mixed-citation>
                    </ref>
                                    <ref id="ref13">
                        <label>13</label>
                        <mixed-citation publication-type="journal">Helmer, M., Schottdorf, M., Neef, A., &amp; Battaglia, D. (2017). Gender bias in scholarly peer review. Elife, 6.</mixed-citation>
                    </ref>
                                    <ref id="ref14">
                        <label>14</label>
                        <mixed-citation publication-type="journal">Hengel, E. (2017). Publishing while Female. Are women held to higher standards? Evidence from peer review. Cambridge Working Paper Economics: 1753 University of Cambridge.</mixed-citation>
                    </ref>
                                    <ref id="ref15">
                        <label>15</label>
                        <mixed-citation publication-type="journal">Hill, S., &amp; Provost, F. (2003). The myth of the double-blind review? Author identification using only citations. ACM SIGKDD Explorations Newsletter, 5(2), 179-184.</mixed-citation>
                    </ref>
                                    <ref id="ref16">
                        <label>16</label>
                        <mixed-citation publication-type="journal">Jan, R., &amp; Zainab, T. (2018). The Impact Story of Retracted Articles. Program adı: 5th International Symposium on Emerging Trends and Technologies in Libraries and Information Services.</mixed-citation>
                    </ref>
                                    <ref id="ref17">
                        <label>17</label>
                        <mixed-citation publication-type="journal">Kuhn, T. S. (1962). The structure of scientific revolutions. The University of Chicago Press.</mixed-citation>
                    </ref>
                                    <ref id="ref18">
                        <label>18</label>
                        <mixed-citation publication-type="journal">Lee, C. J., Sugimoto, C. R., Zhang, G., &amp; Cronin, B. (2013). Bias in peer review. Journal of the American Society for Information Science and Technology, 64(1), 2-17.</mixed-citation>
                    </ref>
                                    <ref id="ref19">
                        <label>19</label>
                        <mixed-citation publication-type="journal">MacDonald, F. (2016). Scientific papers that were rejected before going on to win a Nobel prize. Science Alert, https://www.sciencealert.com/these-8-papers-were-rejected-before-going-on-to-win-the-nobel-prize. Son erişim: 21.02.2021.</mixed-citation>
                    </ref>
                                    <ref id="ref20">
                        <label>20</label>
                        <mixed-citation publication-type="journal">Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive therapy and research, 1(2), 161-175.</mixed-citation>
                    </ref>
                                    <ref id="ref21">
                        <label>21</label>
                        <mixed-citation publication-type="journal">Mehmani, B. (2016). Is open peer review the way forward. https://www. elsevier. com/reviewers-update/story/innovation-in-publishing/is-open-peer-review-the-way-forward. Son erişim: 21.02.2021.</mixed-citation>
                    </ref>
                                    <ref id="ref22">
                        <label>22</label>
                        <mixed-citation publication-type="journal">Miller, C. C. (2006). Peer review in the organizational and management sciences: Prevalence and effects of reviewer hostility, bias, and dissensus. The Academy of Management Journal, 49(3), 425-431.</mixed-citation>
                    </ref>
                                    <ref id="ref23">
                        <label>23</label>
                        <mixed-citation publication-type="journal">Moylan, E. (2019). Progressing Towards Transparency – More Journals Join Our Transparent Peer Review Pilot. https://www.wiley.com/network/researchers/submission-and-navigating-peer-review/progressing-towards-transparency-more-journals-join-our-transparent-peer-review-pilot. Son erişim: 21.02.2021.</mixed-citation>
                    </ref>
                                    <ref id="ref24">
                        <label>24</label>
                        <mixed-citation publication-type="journal">Mulligan, A., Hall, L., &amp; Raphael, E. (2013). Peer review in a changing world: An international study measuring the attitudes of researchers. Journal of the American Society for Information Science and Technology, 64(1), 132-161.</mixed-citation>
                    </ref>
                                    <ref id="ref25">
                        <label>25</label>
                        <mixed-citation publication-type="journal">Murray, D., Siler, K., Larivière, V., Chan, W. M., Collings, A. M., Raymond, J., &amp; Sugimoto, C. R. (2019). Gender and international diversity improves equity in peer review. BioRxiv https://www.biorxiv.org/content/10.1101/400515v2.abstract.</mixed-citation>
                    </ref>
                                    <ref id="ref26">
                        <label>26</label>
                        <mixed-citation publication-type="journal">Oswald, A. J. (2008). Can we test for bias in scientific peer-review? IZA – Institute of Labor Economics Discussion Papers, No. 3665.</mixed-citation>
                    </ref>
                                    <ref id="ref27">
                        <label>27</label>
                        <mixed-citation publication-type="journal">Paltridge, B. (2017). The discourse of peer review. Palgrave Macmillan.</mixed-citation>
                    </ref>
                                    <ref id="ref28">
                        <label>28</label>
                        <mixed-citation publication-type="journal">Peters, D. P., &amp; Ceci, S. J. (1982). Peer-review practices of psychological journals: The fate of published articles, submitted again. Behavioral and Brain Sciences, 5(2), 187-195.</mixed-citation>
                    </ref>
                                    <ref id="ref29">
                        <label>29</label>
                        <mixed-citation publication-type="journal">Pfeifer, M. P., &amp; Snodgrass, G. L. (1990). The continued use of retracted, invalid scientific literature. Journal of the American Medical Association, 263(10), 1420-1423.</mixed-citation>
                    </ref>
                                    <ref id="ref30">
                        <label>30</label>
                        <mixed-citation publication-type="journal">Rennie, D. (2003). Editorial peer review: İts development and rationale. Peer review in health sciences, 2(1), 1-13.</mixed-citation>
                    </ref>
                                    <ref id="ref31">
                        <label>31</label>
                        <mixed-citation publication-type="journal">Sciencematters. (2018). What is triple blindness? https://www.sciencematters.io/help/triple-blindness. Son erişim: 21.02.2021.</mixed-citation>
                    </ref>
                                    <ref id="ref32">
                        <label>32</label>
                        <mixed-citation publication-type="journal">Smith, R. (1997). Peer review: Reform or revolution?: Time to open up the black box of peer review. British Medical Journal, 315, 759-760.</mixed-citation>
                    </ref>
                                    <ref id="ref33">
                        <label>33</label>
                        <mixed-citation publication-type="journal">Sokal, A. (2010). Beyond the hoax: Science, philosophy and culture. Oxford University Press.</mixed-citation>
                    </ref>
                                    <ref id="ref34">
                        <label>34</label>
                        <mixed-citation publication-type="journal">Squazzoni, F., Bravo, G., Farjam, M., Marusic, A., Mehmani, B., Willis, M., … Grimaldo, F. (2021). Peer review and gender bias: A study on 145 scholarly journals. Science advances, 7(2).</mixed-citation>
                    </ref>
                                    <ref id="ref35">
                        <label>35</label>
                        <mixed-citation publication-type="journal">Tomkins, A., Zhang, M., &amp; Heavlin, W. D. (2017). Reviewer bias in single-versus double-blind peer review. Proceedings of the National Academy of Sciences, 114(48), 12708-12713.</mixed-citation>
                    </ref>
                                    <ref id="ref36">
                        <label>36</label>
                        <mixed-citation publication-type="journal">Töreci, K. (2005). Yayın etiği. Akademik Gıda, 3(5), 24-44.</mixed-citation>
                    </ref>
                                    <ref id="ref37">
                        <label>37</label>
                        <mixed-citation publication-type="journal">Walker, R., Barros, B., Conejo, R., Neumann, K., &amp; Telefont, M. (2015). Personal attributes of authors and reviewers, social bias and the outcomes of peer review: A case study. F1000Research (https://doi.org/10.12688/f1000research.6012.2, 4.</mixed-citation>
                    </ref>
                                    <ref id="ref38">
                        <label>38</label>
                        <mixed-citation publication-type="journal">Waltman, L. (2020). Quantitative Science Studies launches transparent peer review pilot. http://issi-society. org/blog/posts/2020/september/quantitative-sciencestudies-launches-transparent-peer-review-pilot. Son erişim: 21.02.2021.</mixed-citation>
                    </ref>
                                    <ref id="ref39">
                        <label>39</label>
                        <mixed-citation publication-type="journal">Yankauer, A. (1991). How blind is blind review? American Journal of Public Health, 81(7), 843-845.</mixed-citation>
                    </ref>
                            </ref-list>
                    </back>
    </article>
