A REVIEW ON QUANTUM SOFTWARE TESTING TECHNIQUES AND TOOLS

Year 2025, Volume: 7 Issue: 1, 90 - 104, 30.06.2025

Fatma Betül Özdemir , Savaş Öztürk

https://doi.org/10.59940/jismar.1636890

Abstract

With the development of quantum computers, the need to produce and test quantum software has arisen. Traditional software testing methods are inadequate for testing quantum software due to the inherent complexity of quantum mechanics. Quantum testing techniques and tools provide specially developed solutions to ensure the accuracy and reliability of quantum software systems. In this study, current works that are fundamental for the future of quantum computing technology are described. The main tools such as QuanFuzz, QMutPy, Quito, etc. and metamorphic, combinatorial and search-based testing techniques are mentioned. The problem of standardisation in the field of quantum test engineering is evaluated. This study is a guide for researchers who want to work on quantum testing techniques and tools.

Keywords

Quantum Program , Quantum Software Testing , Quantum Software Engineering

KUANTUM YAZILIM TEST TEKNİKLERİ VE ARAÇLARI ÜZERİNE BİR İNCELEME

Abstract

Kuantum bilgisayarlarının gelişimiyle birlikte kuantum yazılımlarının üretilme ve test ihtiyacı doğmuştur. Geleneksel yazılım test yöntemleri, kuantum mekaniğinin doğasından kaynaklanan karmaşıklık nedeniyle kuantum yazılımlarını test etmede yetersiz kalmaktadır. Kuantum yazılım sistemlerinin doğruluk ve güvenilirliğini sağlamak için kuantum test teknikleri ve araçları, özel olarak geliştirilmiş çözümler sunmaktadır. Bu çalışmada kuantum bilgisayar teknolojisinin geleceği için temel niteliği taşıyan güncel çalışmalar anlatılmıştır. Başlıca QuanFuzz, QMutPy, Quito vb. araçlar ile metamorfik, kombinasyonel ve arama tabanlı test tekniklerinden bahsedilmiştir. Kuantum test mühendisliği alanında görülen standartlaşma problemi üzerinde değerlendirmeler yapılmıştır. Bu çalışma, kuantum test teknikleri ve araçları üzerinde çalışma yapmak isteyen araştırmacılara bir rehber niteliğindedir.

Keywords

Kuantum Programı , Kuantum Yazılım Testi , Kuantum Yazılım Mühendisliği

References

• ISTQB not-for-profit association [Internet]. 2024 [a.yer 17 Aralık 2024]. Managing the Test Team. Erişim adresi: https://www.istqb.orgmanaging-the-test-team
• Wang X, Arcaini P, Yue T, Ali S. Quito: a Coverage-Guided Test Generator for Quantum Programs. İçinde: 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) [Internet]. Melbourne, Australia: IEEE; 2021 [a.yer 26 Aralık 2024]. s. 1237-41. Erişim adresi: https://ieeexplore.ieee.org/document/9678798/
• What Is Quantum Computing? | IBM [Internet]. 2024 [a.yer 07 Şubat 2025]. Erişim adresi: https://www.ibm.com/think/topics/quantum-computing
• Ali S, Yue T. Quantum Software Testing: A Brief Introduction. İçinde: 2023 IEEE/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) [Internet]. 2023 [a.yer 30 Kasım 2024]. s. 332-3. Erişim adresi: https://ieeexplore.ieee.org/document/10172759
• McClean JR, Romero J, Babbush R, Aspuru-Guzik A. The theory of variational hybrid quantum-classical algorithms. New J Phys. Şubat 2016;18(2):023023.
• Li G, Zhou L, Yu N, Ding Y, Ying M, Xie Y. Projection-based runtime assertions for testing and debugging Quantum programs. Proc ACM Program Lang. 13 Kasım 2020;4(OOPSLA):1-29.
• Huang Y, Martonosi M. Statistical Assertions for Validating Patterns and Finding Bugs in Quantum Programs [Internet]. arXiv; 2019 [a.yer 30 Kasım 2024]. Erişim adresi: http://arxiv.org/abs/1905.09721
• Abreu R, Fernandes JP, Llana L, Tavares G. Metamorphic testing of oracle quantum programs: 3rd IEEE/ACM International Workshop on Quantum Software Engineering, Q-SE 2022. Proc - 3rd Int Workshop Quantum Softw Eng Q-SE 2022. 2022;16-23.
• Long P, Zhao J. Testing Quantum Programs with Multiple Subroutines [Internet]. arXiv; 2023 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2208.09206
• Pérez-Delgado CA. A Quantum Software Modeling Language. In: Serrano MA, Pérez-Castillo R, Piattini M, editors. Quantum Software Engineering [Internet]. Cham: Springer International Publishing; 2022 [cited 07 February 2025]. p. 103-19. Available from: https://link.springer.com/10.1007/978-3-031-05324-5_6
• Quantum Software Testing: A Brief Introduction [Internet]. [cited 19 April 2025]. Available from: https://www.simula.no/research/quantum-software-testing-brief-introduction
• Wang X, Arcaini P, Yue T, Ali S. Application of Combinatorial Testing to Quantum Programs. In: 2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS) [Internet]. Hainan, China: IEEE; 2021 [cited 30 November 2024]. p. 179-88. Available from: https://ieeexplore.ieee.org/document/9724888/
• Paltenghi M, Pradel M. MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform [Internet]. arXiv; 2023 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2206.01111
• Wang J, Gao M, Jiang Y, Lou J, Gao Y, Zhang D, et al. QuanFuzz: Fuzz Testing of Quantum Program [Internet]. arXiv; 2018 [cited 30 November 2024]. Available from: http://arxiv.org/abs/1810.10310
• Wang X, Arcaini P, Yue T, Ali S. QuSBT: Search-Based Testing of Quantum Programs [Internet]. arXiv; 2022 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2204.08561
• Wang X, Yu T, Arcaini P, Yue T, Ali S. Mutation-based test generation for quantum programs with multi-objective search. In: Proceedings of the Genetic and Evolutionary Computation Conference [Internet]. Boston Massachusetts: ACM; 2022 [cited 30 November 2024]. p. 1345-53. Available from: https://dl.acm.org/doi/10.1145/3512290.3528869
• Wang X, Arcaini P, Yue T, Ali S. QuCAT: A Combinatorial Testing Tool for Quantum Software [Internet]. arXiv; 2023 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2309.00119
• Mendiluze E, Ali S, Arcaini P, Yue T. Muskit: A Mutation Analysis Tool for Quantum Software Testing. In: 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) [Internet]. Melbourne, Australia: IEEE; 2021 [cited 30 November 2024]. p. 1266-70. Available from: https://ieeexplore.ieee.org/document/9678563/
• Fortunato D, CAMPOS J, ABREU R. Mutation Testing of Quantum Programs: A Case Study With Qiskit. IEEE Trans Quantum Eng. 2022;3:1-17.
• Fortunato D, Campos J, Abreu R. QMutPy: a mutation testing tool for Quantum algorithms and applications in Qiskit. In: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis [Internet]. Virtual South Korea: ACM; 2022 [cited 13 March 2025]. p. 797-800. Available from: https://dl.acm.org/doi/10.1145/3533767.3543296
• Wang J, Zhang Q, Xu GH, Kim M. QDiff: Differential Testing of Quantum Software Stacks. In: 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) [Internet]. Melbourne, Australia: IEEE; 2021 [cited 30 November 2024]. p. 692-704. Available from: https://ieeexplore.ieee.org/document/9678792/
• Zhao P, Zhao J, Miao Z, Lan S. Bugs4Q: A Benchmark of Real Bugs for Quantum Programs [Internet]. arXiv; 2021 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2108.09744
• Campos J, Souto A. QBugs: A Collection of Reproducible Bugs in Quantum Algorithms and a Supporting Infrastructure to Enable Controlled Quantum Software Testing and Debugging Experiments [Internet]. arXiv; 2021 [cited 30 November 2024]. Available from: http://arxiv.org/abs/2103.16968
• García De La Barrera A, García-Rodríguez De Guzmán I, Polo M, Piattini M. Quantum software testing: State of the art. J Softw Evol Process. Nisan 2023;35(4):e2419.
• ISO/IEC/IEEE 29119-3:2021(en), Software and systems engineering — Software testing— Part 3: Test documentation [İnternet]. 2024 Erişim adresi: https://www.iso.org/obp/ui/en/#iso:std:iso-iec-ieee:29119:-3:ed-2:v1:en
• IEEE Standard for Software Test Documentation. IEEE Std 829-1998. Aralık 1998;1-64.
• van Veenendaal E. Produced by the TMMi Foundation.