Evaluating Generative AI Tools’ Responses to Elimination and Nucleophilic Substitution Reactions Using Chemistry’s Triplet Model
Abstract
The rapid development of generative artificial intelligence (AI) tools is increasingly evident in chemistry education. Understanding how these tools can be integrated into instruction, along with recognizing their advantages and limitations, is essential for designing effective learning environments. Additionally, adequately incorporating the interconnected macroscopic, submicroscopic, and symbolic levels—fundamental to the nature of chemistry—is critical for fostering deep and scientifically grounded learning. In this context, this study aims to investigate how elimination and nucleophilic substitution reactions, central topics in Organic Chemistry, are interpreted by different generative AI tools within the framework of chemistry’s triplet. As part of this case study, 15 questions related to these reaction types were posed to the generative AI tools “Gemini,” “Copilot,” “MagicSchool,” and “ChatGPT,” and each was additionally asked to explain a written SN1 reaction. Descriptive analysis revealed that, although all AI tools provided relatively adequate responses at the macroscopic level, their performance at the submicroscopic and symbolic levels was notably limited. The absence of curved arrow notation in illustrating reaction mechanism steps and the lack of three-dimensional structural representations required for the stereochemistry of reactions were identified as significant shortcomings. Furthermore, only Gemini was able to generate energy–reaction coordinate diagrams and provide examples of cyclic structures for E2 reactions. Furthermore, it was determined that each generative AI tool could explain reactions, even within the same reaction type, to varying degrees. Overall, these findings suggest that generative AI tools require further refinement, particularly to strengthen explanations at the submicroscopic and symbolic levels, for practical use in chemistry education.
Keywords
Generative Artificial Intelligence, Elimination Reactions, Nucleophilic Substitution Reaction, Organic Chemistry Education, Macroscopic-submicroscopic-symbolic Levels.
Ethical Statement
References
- Alasadi, E. A., & Baiz, C. R. (2023). Generative AI in education and research: Opportunities, concerns, and solutions. Journal of Chemical Education, 100(8), 2965–2971. https://doi.org/10.1021/acs.jchemed.3c00323
- Alasadi, E. A., & Baiz, C. R. (2024). Multimodal generative artificial intelligence tackles visual problems in chemistry. Journal of Chemical Education, 101(7), 2716–2729. https://doi.org/10.1021/acs.jchemed.4c00138
- Bhattacharyya, G., & Bodner, G. (2005). It gets me to the product: How students propose organic mechanisms. Journal of Chemical Education, 82(9), 1402–1407. https://doi.org/10.1021/ed082p1402
- Clark, T. M. (2023). Investigating the use of an artificial intelligence chatbot with general chemistry exam questions. Journal of Chemical Education, 100(5), 1905–1916. https://doi.org/10.1021/acs.jchemed.3c00027
- Creswell, J. W. (2007). Qualitative inquiry and research design: Choosing among five approaches (2nd ed.). SAGE Publications.
- Erduran, S., & Levrini, O. (2024). The impact of artificial intelligence on scientific practices: An emergent area of research for science education. International Journal of Science Education, 46(18), 1982–1989. https://doi.org/10.1080/09500693.2024.2306604
- Ferguson, R., & Bodner, G. M. (2008). Making sense of the arrow pushing formalism among chemistry majors enrolled in organic chemistry. Chemistry Education Research and Practice, 9(2), 102–113. https://doi.org/10.1039/B806225K
- Gabel, D. (1999). Improving teaching and learning through chemistry education research: A look to the future. Journal of Chemical Education, 76(4), 548–554. https://doi.org/10.1021/ed076p548
- Gomollón-Bel, F. (2023). IUPAC’s 2023 top ten emerging technologies in chemistry. Chemistry International, 45(4), 14–22. https://doi.org/10.1515/ci-2023-0403
- Grove, N. P., Cooper, M. M., & Rush, K. M. (2012). Decorating with arrows: Toward the development of representational competence in organic chemistry. Journal of Chemical Education, 89(7), 844–849. https://doi.org/10.1021/ed2003934
