Artificial Intelligence in Mental Health Practices: Legal Liability Analysis under Turkish, European, and Common Law Frameworks

Abstract

Artificial intelligence technologies are rapidly developing today and are beginning to have a significant impact in many fields. It is important to address this effect in a multidisciplinary manner. The impact of artificial intelligence is mostly addressed in terms of the contributions it will provide. Indeed, in the field of mental health, artificial intelligence is seen to bring many advantages for both doctors and patients, just as it does in other medical specialties. These advantages can cover many areas, from the diagnosis to the treatment of mental illnesses. However, the advantages of artificial intelligence and its use in diagnostic and treatment services as an expert activity do not exempt it from the application of legal rules in any way. In this case, the question arises as to whether artificial intelligence can be held legally liable in itself or how the liability will be determined due to the use of artificial intelligence technologies. There are two important points in establishing legal liability. The first of these is that artificial intelligence does not have legal liability. The second is the legal liability arising from the use of artificial intelligence and its reasons. In this study, the role of artificial intelligence technologies in mental health applications, the innovations and contributions they bring to mental health professionals, and the legal liabilities arising from artificial intelligence and its applications in the field of mental health have been examined. However, the study on criminal liability has been excluded from the scope.

Keywords

• Artificial Intelligence
• Law
• Legal Liability
• Mental Health
• Mental Illness

Ruh Sağlığı Uygulamalarında Yapay Zekâ: Türk, Avrupa ve Ortak Hukuk Çerçevelerinde Hukukî Sorumluluk Analizi

Öz

Yapay zekâ teknolojileri günümüzde hızla gelişmekte ve birçok alanda önemli etkiye sahip olmaya başlamaktadır. Bu etkinin multidisipliner olarak ele alınması önemlidir. Yapay zekânın bu etkisi çoğunlukla sağlayacağı katkılar bakımından ele alınmaktadır. Ruh sağlığı alanında da yapay zekânın diğer tıp uzmanlık alanlarında olduğu gibi hem hekim hem de hasta açısından birçok avantajları beraberinde getirdiği görülmektedir. Bu avantajlar ruhsal hastalıkların teşhisinden tedavisine kadar birçok alanı da kapsayabilmektedir. Ancak, yapay zekânın sahip olduğu bu avantajlar ve uzmanlık faaliyeti olarak yürütülen teşhis ve tedavi hizmetlerinde yapay zekâya yer verilmesi hukuk kurallarının uygulanmasını hiçbir şekilde muaf kılmamaktadır. Hal böyle olunca da yapay zekânın hukukî açıdan bizzat sorumlu olup olamayacağı veyahut da yapay zekâ teknolojilerinin kullanılması sebebiyle sorumluluğun temellendirilmesinin neye göre tayin edileceği sorunu ortaya çıkmaktadır. Hukukî sorumluluğun temellendirilmesinde iki önemli nokta bulunmaktadır. Bunlardan birincisi, yapay zekânın hukuken sorumluluğunun bulunmadığıdır. İkincisini ise yapay zekânın kullanılmasından doğan hukukî sorumluluk ve sebeplerinin ne olduğudur. Bu çalışmada yapay zekâ teknolojilerinin ruh sağlığı uygulamalarındaki yeri, ruh sağlığı profesyonelleri bakımından getirdiği yenilik ile katkılar ve ruh sağlığı alanında yapay zekâ ve uygulamalarından doğan hukukî sorumluluk incelenmiştir. Bununla birlikte, cezaî sorumluluğa ilişkin çalışmanın kapsamı dışında tutulmuştur.

Anahtar Kelimeler

• Yapay Zekâ
• Hukuk
• Hukukî Sorumluluk
• Ruh Sağlığı
• Ruhsal Hastalık

Kaynakça

1. Akgöz N, Ülker SV, Keskin E, Arasan Doğan İ (2022) Günümüz ve gelecekteki teknolojinin psikoterapi uygulamalarına etkisi ve etik tartışmalar. International Journal of Social, Humanities and Administrative Sciences, 8:1840-1848.
2. Akkan G, Ülker SV (2023) Ruh sağlığı hizmetlerinde yapay zeka uygulamaları ve ilişkili teknolojiler. Fenerbahçe Üniversitesi Sosyal Bilimler Dergisi, 3:242-263.
3. Akkurt SS (2019) Yapay zekânın otonom davranışlarından kaynaklanan hukukî sorumluluk. Uyuşmazlık Hukuku Dergisi, 13:39-59.
4. Alami H, Lehoux P, Auclair Y, de Guise M, Gagnon MP, Shaw J et al. (2020) Artificial intelligence and health technology assessment: anticipating a new level of complexity. J Med Internet Res, 22:e17707.
5. Alan B, Kırban Zengin F (2023) İnsan Zekâsından Yapay Zekâya, Ankara, İksad Yayınevi.
6. Allen S (2020) Artificial intelligence and the future of psychiatry. IEEE Pulse, 11:2-6.
7. Alowais SA, Alghamdi SS, Alsuhebany N, Alqahtani T, Alshaya AI, Almohareb SN et al. (2023) Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC Med Educ, 23:689-703.
8. Altman RB (2017) Artificial intelligence (AI) systems for interpreting complex medical datasets. Clin Pharmacol Ther, 101:585-586.

9. Arcila BB (2024) AI liability in Europe: How does it complement risk regulation and deal with the problem of human oversight?. Computer Law & Security Review, 54:e106012.
10. Bickman L (2020) Improving mental health services: a 50-year journey from randomized experiments to artificial intelligence and precision mental health. Adm Policy Ment Health, 47:795-843.
11. Bisoyi A (2022) Ownership, liability, patentability, and creativity issues in artificial intelligence. Information Security Journal: A Global Perspective, 31:377-386.
12. Buolamwini J, Gebru T (2018) Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of Machine Learning Research, 81:1-15.
13. Cerasa A, Gaggioli A, Pioggia G, Riva G (2024) Metaverse in mental health: the beginning of a long history. Curr Psychiatry Rep, 26:294-303.
14. Cestonaro C, Delicati A, Marcante B, Caenazzo L, Tozzo P (2023) Defining medical liability when artificial intelligence is applied on diagnostic algorithms: a systematic review. Front Med (Lausanne), 10:1305756.
15. Colby KM (1975) Artificial Paranoia: A Computer Simulation of Paranoid Processes, New York, Pergamon Press.
16. Colby KM, Hilf FD, Weber S, Kraemer HC (1972) Turing-like indistinguishability tests for the validation of a computer simulation of paranoid processes. Artif Intell, 3:199-221.
17. Ćosić K, Popović S, Šarlija M, Kesedžić I, Jovanovic T (2020) Artificial intelligence in prediction of mental health disorders induced by the covid-19 pandemic among health care workers. Croat Med J, 61:279-288.
18. Çilingir Mermit B (2019) Pulmoner rehabilitasyonda yapay zeka; giyilebilir takip cihazları. In Sağlıkta Yapay Zeka Uygulamaları (Eds C Özlü, MA Gedık, N Köylüoğlu, HS Yangal, A):171-181. Ankara, Akademisyen Kitabevi.
19. D'alfonso S, Santesteban-Echarri O, Rice S, Wadley G, Lederman R, Miles C et al. (2017) Artificial intelligence-assisted online social therapy for youth mental health. Front Med (Lausanne), 8:796.
20. Council of the European Union (1985) Council Directive 85/374/EEC of 25 July 1985 on the approximation of the laws, regulations and administrative provisions of the Member States concerning liability for defective products. Luxembourg, Publications Office of the European Union.
21. Demir R (2023) Yapay Zekâ İmalatçısının Ürün Sorumluluğu, Ankara, Adalet Yayınevi.
22. Doğan E (2022) Yapay Zekanın Hukuki Statüsü ve Sorumluluğu, Ankara, Seçkin Yayıncılık.
23. Doraiswamy PM, Blease C, Bodner, K (2020) Artificial intelligence and the future of psychiatry: insights from a global physician survey. Artif Intell Med, 102:e101753.
24. Ediboğlu GO (2023) Yapay zekanın insan zekasına psikoterapötik yaklaşımı. Çukurova Tıp Öğrenci Dergisi, 3:12-18.
25. Erdem Kaya B, Karakoç E (2020) Yas ve melankolide sanal gerçekliğin duygulanımsal boyutu. Intermedia International E-Journal Spring, 7:252-269.
26. European Parliament & Council of the European Union (2024) EU Artificial Intelligence Act (2024). https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32024R1689 (Accessed 05.01.2025).
27. European Commission (2021) Guidance on AI in medical devices. https://ec.europa.eu (Accessed 25.02.2025).
28. European Parliament & Council of the European Union (2016) Regulation (EU) 2016/679 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data (General Data Protection Regulation, GDPR). Official Journal of the European Union, L 119:1-88.
29. European Parliament & Council of the European Union (2017) Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on Medical Devices. Official Journal of the European Union, L 117:1-175.
30. Expert Group on Liability and New Technologies –New Technologies Formation (2019) Liability for Artificial Intelligence and Other Emerging Digital Technologies. Luxembourg, Publications Office of the European Union.
31. Farhat F (2024) ChatGPT as a complementary mental health resource: a boon or a bane. Ann Biomed Eng, 52:1111-1114.
32. Fellmann W (2022) Haftpflichtrecht im Zeichen der Digitalisierung, Zürich, Dike Verlag AG.
33. Fiske A, Henningsen P, Buyx A (2019) Your robot therapist will see you now: ethical implications of embodied artificial intelligence in psychiatry, psychology, and psychotherapy. J Med Internet Res, 21:e13216.
34. Fitzpatrick KK, Darcy A, Vierhile M (2017) Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (woebot): a randomized controlled trial. JMIR Ment Health, 4:e19.
35. Fulmer R, Joerin A, Gentile B, Lakerink L, Rauws M (2018) Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: randomized controlled trial. JMIR Ment Health, 5:e64.
36. Garety P, Edwards CJ, Ward T, Emsly R, Huckvale M, McCrone P et al. (2021) Optimising AVATAR therapy for people who hear distressing voices: study protocol for the AVATAR2 multi-centre randomised controlled trial. Trials, 22:366.
37. Geistfeld M (2017) A roadmap for autonomous vehicles: state tort liability, automobile insurance, and federal safety regulation. Calif Law Rev, 105:1611-1694.
38. Geny M, Andrès E, Talha S, Gény B (2024) Liability of health professionals using sensors, telemedicine and artificial intelligence for remote healthcare. Sensors, 24:3491.
39. Graham S, Depp CA, Lee E, Nebeker C, Tu X, Kim H et al. (2019) Artificial intelligence for mental health and mental illnesses: an overview [review of artificial intelligence for mental health and mental illnesses: an overview]. Curr Psychiatry Rep, 21:116-141.
40. Gülel H (2023) Hukuki Açıdan Yapay Zekâ, Ankara, Adalet Yayınevi.
41. Gültekin M (2022) Yapay zekânın ruh sağlığı hizmetlerinde kullanımına ilişkin fırsatlar ve sorunlar. İnsan ve Toplum, 12:121-158.
42. Günday HM (2015) Psikiyatristin Hukukî Sorumluluğu, Ankara, Yetkin Hukuk Yayınları.
43. Hacker P (2022) The European Ai liability directives – critique of a half-hearted approach and lessons for the future. Computer Law & Security Review, 51:105871.
44. Health TLG (2020) Mental health matters. Lancet Glob Health, 8:e1352.
45. Jha IP, Awasthi R, Kumar A, Kumar V, Sethi T (2021) Learning the mental health impact of covid-19 in the united states with explainable artificial intelligence: observational study. JMIR Ment Health, 8:e25097.
46. Karner E, Koch B, Geistfeld M, Wendehorst C (2023) Liability for artificial ıntelligence and other emerging digital technologies. In Civil Liability for Artificial Intelligence and Software: 319-408. Berlin, De Gruyter.
47. Khan NS, Ghani MS, Anjum G (2021) ADAM-sense: anxiety-displaying activities recognition by motion sensors. Pervasive and Mobile Computing, 78:101485.
48. Lee EE, Torous J, De Choudhury M, Depp CA, Graham SA, Kim HC et al. (2021) Artificial intelligence for mental health care: clinical applications, barriers, facilitators, and artificial wisdom. Biol Psychiatry Cogn Neurosci Neuroimaging, 6:856-864.
49. Luh J (2021) Künstliche Intelligenz und Produkthaftung: Herausforderungen für das Deutsche und Europäische Recht, Tübingen, Mohr Siebeck.
50. Maraş G, Albayrak Günday E, Sürme Y (2024) Examining the anxiety and preparedness levels of nurses and nurse candidates for artificial intelligence health technologies. J Clin Nurs, doi:10.1111/jocn.17562.
51. Maurya RK, Montesinos S, Bogomaz M, DeDiego AC (2025) Assessing the use of ChatGPT as a psychoeducational tool for mental health practice. Couns Psychother Res, 25:e12759.
52. McCall B (2020) COVID-19 and artificial intelligence: protecting health-care workers and curbing the spread. Lancet Digit Health, 2:e166.
53. McDougall RJ (2019) Computer knows best? the need for value-flexibility in medical AI. J Med Ethics, 45:156-160.
54. Mehta A, Niles AN, Vargas JH, Marafon T, Couto DD, Gross JJ (2021) Acceptability and effectiveness of artificial intelligence therapy for anxiety and depression (Youper): longitudinal observational study. J Med Internet Res, 23:e26771.
55. Melo A, Silva I, Lopes J (2024) Chatgpt: A pilot study on a promising tool for mental health support in psychiatric inpatient care. International Journal of Psychiatric Trainees, 2:doi:10.55922/001c.92367.
56. Menon V, Rajan TM, Sarkar S (2017) Psychotherapeutic applications of mobile phone-based technologies: a systematic review of current research and trends. Indian J Psychol Med, 39:4-11.
57. Mezrich JL (2022) Demystifying medico-legal challenges of artificial intelligence applications in molecular imaging and therapy. PET Clin, 17:41-49.
58. Milne-Ives M, Selby E, Inkster B, Lam C, Meinert E (2022) Artificial intelligence and machine learning in mobile apps for mental health: A scoping review. PLOS Digit Health, 1:e0000079.
59. Mitchell M, Wu S, Zaldivar A, Barnes P, Vasserman L, Hutchinson B et al. (2019) Model cards for model reporting. Proceedings of the Conference on Fairness, Accountability, and Transparency, 29-31 January 2019, Atlanta, GA, USA, 220-229.
60. Morsünbül Ü (2018) Robotlarla bağlanma ve cinsellik: ruh sağlığı bakış açısından bir değerlendirme. Psikiyatride Güncel Yaklaşımlar, 10:427-439.
61. Murphy M, Templin J (2021) Replika. https://replika.ai/about/story (Accessed 15.12.2024).
62. O’Sullivan S, Nevejans N, Allen C, Blyth A, Léonard S, Pagallo U et al. (2019) Legal, regulatory, and ethical frameworks for development of standards in artificial intelligence (AI) and autonomous robotic surgery [Review of Legal, regulatory, and ethical frameworks for development of standards in artificial intelligence (AI) and autonomous robotic surgery]. Int J Med Robot, 15:e1968.
63. Obermeyer Z, Powers B, Vogeli C, Mullainathan S (2019) Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366:447-453.
64. Okur S (2021) Otonom Araçlarda Sözleşme Dışı Hukuki Sorumluluk. Ankara, Adalet Yayınevi.
65. Olawade DB, Wada OZ, Odetayo A, David-Olawade AC, Asaolu F, Eberhardt J (2024) Enhancing mental health with artificial intelligence: current trends and future prospects. J Med Surg Public Health, 3:100099.
66. Olivi G (2018) Robots and liability: who is to blame?. https://www.dentons.com/en/insights/articles/2018/december/20/robots-and-liability (Accessed 5.12.2024).
67. Padovan PH, Martins CM, Reed C (2022) Black is the new orange: how to determine AI liability. Artif Intell Law (Dordr), 31:133-167.
68. Pérez-Zuñiga G, Arce D, Gibaja S, Alvites M, Cano C, Bustamante M et al. (2024) Qhali: A humanoid robot for assisting in mental health treatment. Sensors, 24:1321.
69. Pham KT, Nabizadeh A, Selek S. (2022) Artificial intelligence and chatbots in psychiatry. Psychiatr Q, 93:249-253.
70. Produkthaftungsgesetz [ProdHaftG] (2023) Produkthaftungsgesetz (Product Liability Act). https://www.gesetze-im-internet.de/prodhaftg/ (Accessed 25.02.2025).
71. Rabbi M, Philyaw-Kotov, M, Lee J, Mansour A, Dent L, Wang X et al. (2017) SARA: A mobile app to engage users in health data collection. UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, 11 September 2017, Association for Computing Machinery New York, NY, USA, 781-789.
72. Raccio AJ, Newman (2019) To Siri with love: a mother, her autistic son, and the kindness of machines. J Autism Dev Disord, 49:3472-3473.
73. Rathnayaka P, Mills N, Burnett D, De Silva D, Alahakoon D, Gray R (2022) A mental health chatbot with cognitive skills for personalised behavioural activation and remote health monitoring. Sensors, 22:3653-3670.
74. Ravindran KK, della Monica C, Atzori G, Hassanin H, Nilforooshan R, Revell V et al. (2024) Evaluation of dreem headband for sleep staging and eeg spectral analysis in people living with alzheimer’s and older adults. medRxiv, doi:10.1101/2024.12.18.24319240.
75. Robinson T, Condell J, Ramsey E, Leavey G (2023) Self-management of subclinical common mental health disorders (anxiety, depression and sleep disorders) using wearable devices. Int J Environ Res Public Health, 20:2636.
76. Shokri R, Stronati M, Song C, Shmatikov V (2017) Membership inference attacks against machine learning models. 2017 IEEE Symposium on Security and Privacy (SP), 22-26 May 2017 San Jose, CA, USA, IEEE, 3-18.
77. Singh G, Sandhu, JK (2022) Virtual and augmented reality technology for the treatment of mental health disorders: an overview. 2022 13th International Conference on Computing Communication and Networking Technologies (ICCCNT), 03-05 October 2022 Kharagpur, India, IEEE - 54827, 1-5.
78. Singh OP (2019) Chatbots in psychiatry: Can treatment gap be lessened for psychiatric disorders in India. Indian J Psychiatry, 61:225-226.
79. Singh OP (2023) Artificial intelligence in the era of ChatGPT - Opportunities and challenges in mental health care. Indian J Psychiatry, 65:297-298.
80. Soysal P, Tükek T (2022) Tele Sağlık, İstanbul, İstanbul Tıp Kitabevleri.
81. Sönmez D, Hocaoglu C (2024) Metaverse and psychiatry: a review. Current Approaches in Psychiatry, 16:225-238.
82. Spickhoff A, Geis B (2019) Arzthaftungsrecht, Berlin, Springer.
83. The AI Effect (2019) MIT Technology Review. https://www.technologyreview.com/hub/ai-effect/ (Accessed 25.12.2024).
84. Timmons AC, Duong JB, Simo Fiallo N, Lee T, Vo HPQ, Ahle MW et al. (2023) A call to action on assessing and mitigating bias in artificial intelligence applications for mental health. Perspect Psychol Sci, 18:1062-1096.
85. Tutun S, Johnson ME, Ahmed A, Albizri A, Irgil S, Yesilkaya I et al. (2023) An AI-based decision support system for predicting mental health disorders. Inf Syst Front, 25:1261-1276.
86. Ucuz İ, Özcan Ö, Mete B, Ari A, Kayhan-Tetik B, Yıldırım K (2020) Evaluation of inflammatory markers in childhood-onset psychiatric disorders by using artificial intelligence architectures. Anadolu Psikiyatri Derg, 21:301-309.
87. Varnosfaderani SM, Forouzanfar M (2024) The role of AI in hospitals and clinics: transforming healthcare in the 21st century. Bioengineering, 11:337-374.
88. Voigt P, Bussche AVD (2017) The EU General Data Protection Regulation (GDPR): A Practical Guide, Berlin, Springer.
89. Walsh CG, Riberio JD, Franklin JC (2017) Predicting risk of suicide attempts over time through machine learning. Clin Psychol Sci, 5:457-469.
90. Wischmeyer T, Rademacher T (2020) Regulating Artificial Intelligence, Berlin, Springer.
91. Yang F, Han T, Deng K, Han Y (2020) The application of artificial intelligence in the mental diseases. CAIH2020: Proceedings of the 2020 Conference on Artificial Intelligence and Healthcare, 23-25 October 2020 Taiyuan, China, Association for Computing Machinery, 36-40.
92. Yılmaz F, Mete AH, Fidan Türkön B, İnce Ö (2022) Sağlık hizmetlerinin geleceğinde metaverse ekosistemi ve teknolojileri: uygulamalar, fırsatlar ve zorluklar. Eurasian Journal of Health Technology Assessment, 6:12-34.
93. Yüksekbaş EÇ (2024) Otonom Araçların Haksız Fiil Sorumluluğu, Ankara, Seçkin Yayıncılık.
94. Zhang Z, Wang J (2024) Can AI replace psychotherapists? Exploring the future of mental health care. Front Psychiatry, 15:1444382.