Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma
Abstract
DeepSeek v3, developed in China, was released in December 2024, followed by Alibaba’s Qwen 2.5 Max in January 2025 and Qwen3 235B in April 2025. These free and open-source models offer significant potential for academic writing and content creation. This study evaluates their academic writing performance by comparing them with ChatGPT, Gemini, Llama, Mistral, and Gemma. There is a critical gap in the literature concerning how extensively these tools can be utilized and their potential to generate original content in terms of quality, readability, and effectiveness. Using 40 papers on Digital Twin and Healthcare, texts were generated through AI tools based on posed questions and paraphrased abstracts. The generated content was analyzed using similarity detection, AI detection, word count comparisons, semantic similarity, and readability assessments. Results indicate that paraphrased abstracts showed higher similarity rates, while question-based responses also exceeded acceptable levels. AI detection tools consistently identified all outputs as AI-generated. Word count analysis revealed that all chatbots produced a sufficient volume of content. Semantic similarity tests showed a strong overlap between generated and original texts. However, readability assessments indicated that the texts were insufficient in terms of clarity and accessibility. This study comparatively highlights the potential and limitations of popular and latest large language models for academic writing. While these models generate substantial and semantically accurate content, concerns regarding plagiarism, AI detection, and readability must be addressed for their effective use in scholarly work.
Keywords
Supporting Institution
Assoc. Prof. Dr. Omer Aydin was funded by the Scientific and Technological Research Council of Türkiye (TUBITAK) under the 2219 International Postdoctoral Research Fellowship Program for Turkish Citizens.
Project Number
1059B192302744
Ethical Statement
The authors affirm our commitment to upholding ethical standards in academic research and publishing.
Thanks
Assoc. Prof. Dr. Omer Aydin was supported by the Scientific and Technological Research Council of Türkiye (TUBITAK) under the 2219 International Postdoctoral Research Fellowship Program for Turkish Citizens under the supervision of Assoc. Prof. Dr. Fatih Safa Erenay at the University of Waterloo Department of Management Science and Engineering. The authors thank to Scientific and Technological Research Council of Türkiye (TUBITAK) and the University of Waterloo.
References
- OpenAI. (2024). Hello GPT-4o. https://openai.com/index/hello-gpt-4o/
- OpenAI. (2024). GPT-4o mini: advancing cost-efficient intelligence. https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/
- Google AI. (2024). Introducing Gemini 1.5, Google's next-generation AI model. https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/
- Qwen Team. (2025). Qwen2.5-Max: Exploring the Intelligence of Large-scale MoE Model. https://qwenlm.github.io/blog/qwen2.5-max/
- DeepSeek AI. (2024). Introducing DeepSeek-V3. https://api-docs.deepseek.com/news/news1226
- DeepSeek AI. (2024). DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence. https://github.com/deepseek-ai/DeepSeek-Coder-V2
- Meta AI. (2024). Introducing Llama 3.1: Our most capable models to date. https://ai.meta.com/blog/meta-llama-3-1/
- Meta AI. (2024). Llama-2-7b. https://huggingface.co/meta-llama/Llama-2-7b
Details
Primary Language
English
Subjects
Management Information Systems, Computer Software
Journal Section
Research Article
Publication Date
May 1, 2026
Submission Date
December 9, 2025
Acceptance Date
February 1, 2026
Published in Issue
Year 2026 Volume: 10 Number: 2
APA
Aydın, Ö., Karaarslan, E., Erenay, F. S., & Bacanin, N. (2026). Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. Turkish Journal of Engineering, 10(2), 592-607. https://doi.org/10.31127/tuje.1838765
AMA
1.Aydın Ö, Karaarslan E, Erenay FS, Bacanin N. Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. TUJE. 2026;10(2):592-607. doi:10.31127/tuje.1838765
Chicago
Aydın, Ömer, Enis Karaarslan, Fatih Safa Erenay, and Nebojsa Bacanin. 2026. “Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma”. Turkish Journal of Engineering 10 (2): 592-607. https://doi.org/10.31127/tuje.1838765.
EndNote
Aydın Ö, Karaarslan E, Erenay FS, Bacanin N (May 1, 2026) Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. Turkish Journal of Engineering 10 2 592–607.
IEEE
[1]Ö. Aydın, E. Karaarslan, F. S. Erenay, and N. Bacanin, “Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma”, TUJE, vol. 10, no. 2, pp. 592–607, May 2026, doi: 10.31127/tuje.1838765.
ISNAD
Aydın, Ömer - Karaarslan, Enis - Erenay, Fatih Safa - Bacanin, Nebojsa. “Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma”. Turkish Journal of Engineering 10/2 (May 1, 2026): 592-607. https://doi.org/10.31127/tuje.1838765.
JAMA
1.Aydın Ö, Karaarslan E, Erenay FS, Bacanin N. Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. TUJE. 2026;10:592–607.
MLA
Aydın, Ömer, et al. “Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma”. Turkish Journal of Engineering, vol. 10, no. 2, May 2026, pp. 592-07, doi:10.31127/tuje.1838765.
Vancouver
1.Ömer Aydın, Enis Karaarslan, Fatih Safa Erenay, Nebojsa Bacanin. Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. TUJE. 2026 May 1;10(2):592-607. doi:10.31127/tuje.1838765