Smart Game Development Systems: Artificial Intelligence for Emerging Gaming Experiences

Abstract

The purpose of this study was to evaluate the application of modern AI techniques to game development from a comparative perspective and to examine how different AI approaches influence gameplay behavior and adaptability in game environments. In this study three general approaches were implemented. Using the UE5 engine, agents were created with elaborate control systems and numerous attack states in the form of behavior trees. Within Unity, training data was used to implement reinforcement learning agents using PPO in the ML-Agents environment, allowing the agents to develop behavior through a reward-based learning process that optimizes behavior according to the consequences of agent actions within the environment. The NEAT algorithm was implemented in a Python-based simulation environment, where agent intelligence evolved through multiple generations by iteratively improving neural network structures and behaviors. Behavior trees are used in this context to provide structure for the creation of intricate series of actions; RL allows the use of experience for optimized tactical approaches based upon player interaction; NEAT offers a way for agents' skills to iteratively improve. The comparative analysis demonstrates how these AI paradigms differ in terms of decision-making, adaptability, and behavioral diversity within game development environments. Overall, this study provides a comparative perspective on the implementation and practical characteristics of modern AI approaches for game development.

Keywords

• Artificial intelligence
• Game development
• Machine learning
• Evolutionary algorithms
• Reinforcement learning
• Behavior trees

Supporting Institution

Istanbul Beykent University

Project Number

2024-25-BAP-09

Ethical Statement

Ethics committee approval was not required for this study because of there was no study on animals or humans.

Thanks

This research was supported by the Scientific Research Projects Coordination Unit of Istanbul Beykent University under Project No. 2024-25-BAP-09. The authors would like to thank Istanbul Beykent University for its support throughout the project.

References

1. Almón-Manzano, L., Pastor Vargas, R., & Cuadra Troncoso, J. M. (2022). Deep reinforcement learning in agents’ training: Unity ML-Agents. In J. M. Ferrández Vicente, J. R. Álvarez-Sánchez, F. de la Paz López, & H. Adeli (Eds.), Bio-inspired systems and applications: From robotics to ambient intelligence (pp. 391–400). Springer. https://doi.org/10.1007/978-3-031-06527-9_39
2. Andrade, G., Ramalho, G., Santana, H., & Corruble, V. (2005). Extending reinforcement learning to provide dynamic game balancing. In Proceedings of the IJCAI Workshop on Reasoning, Representation, and Learning in Computer Games (pp. 7–12).
3. Ben-Or, D., Kolomenkin, M., & Shabat, G. (2021). DL-DDA: Deep learning based dynamic difficulty adjustment with UX and gameplay constraints. In 2021 IEEE Conference on Games (CoG) (pp. 1–7). IEEE. https://doi.org/10.1109/CoG52621.2021.9619162
4. Guckelsberger, C., Salge, C., Gow, J., & Cairns, P. (2017). Predicting player experience without the player: An exploratory study. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17) (pp. 305–315). https://doi.org/10.1145/3116595.3116631
5. Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2018). A survey of methods for explaining black box models. ACM Computing Surveys, 51(5), 1–42. https://doi.org/10.1145/3236009
6. Hunicke, R. (2005). The case for dynamic difficulty adjustment in games. In Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (pp. 429–433). https://doi.org/10.1145/1178477.1178573
7. Juliani, A., Berges, V.-P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., Mattar, M., & Lange, D. (2018). Unity: A general platform for intelligent agents (arXiv:1809.02627). arXiv preprint. https://doi.org/10.48550/arXiv.1809.02627
8. Justesen, N., Bontrager, P., Togelius, J., & Risi, S. (2020). Deep learning for video game playing. IEEE Transactions on Games, 12(1), 1–20. https://doi.org/10.1109/TG.2019.2896986

9. Khalifa, A., Bontrager, P., Earle, S., & Togelius, J. (2020). PCGRL: Procedural content generation via reinforcement learning. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 16(1), 95–101. https://doi.org/10.1609/aiide.v16i1.7416
10. Millington, I. (2020). Artificial intelligence for games (3rd ed.). CRC Press.
11. Miikkulainen, R. (2021). Creative AI through evolutionary computation: Principles and examples. SN Computer Science, 2(3), Article 163. https://doi.org/10.1007/s42979-021-00540-9
12. Rai, S., & Rani, S. (2025). AI in game developement. In Next-generation computing: Trends and challenges in research (pp. 38–48). QTanalytics Publication. https://doi.org/10.48001/978-81-980647-3-8-5
13. Risi, S., & Stanley, K. O. (2010). Indirectly encoding neural plasticity as a pattern of local rules. In Proceedings of the International Conference on Simulation of Adaptive Behavior: From Animals to Animats (pp. 533–543). https://doi.org/10.1007/978-3-642-15193-4_50
14. Salen, K., & Zimmerman, E. (2003). Rules of play: Game design fundamentals. MIT Press.
15. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms (arXiv:1707.06347). arXiv preprint. https://doi.org/10.48550/arXiv.1707.06347
16. Simon, D. (2013). Evolutionary optimization algorithms. John Wiley & Sons.
17. Stanley, K. O., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2), 99–127. https://doi.org/10.1162/106365602320169811
18. Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction (2nd ed.). MIT Press.
19. Sweetser, P., & Wyeth, P. (2005). GameFlow: A model for evaluating player enjoyment in games. Computers in Entertainment, 3(3), Article 3. https://doi.org/10.1145/1077246.1077253
20. Yannakakis, G. N., & Togelius, J. (2018). Artificial intelligence and games. Springer.
21. Yarar, M. E. (2025). Artificial intelligence-supported game development: Future gaming experiences (Master’s thesis, Beykent University Graduate School, Istanbul, Turkey).
22. Yarar, M. E., & Nalbant, K. G. (2025). An applied examination of artificial intelligence methods in game development. In B. Altunok (Ed.), Proceedings of the 4th International Colosseum Scientific Researches and Innovation Congress (pp. 14–15). Bilsel Publishing.