A MARKOV DECISION PROCESS APPROACH FOR MENTAL HEALTH

Year 2020, Volume: 8 Issue: 2, 258 - 268, 03.06.2020

Yasin Göçgün

https://doi.org/10.36306/konjes.745756

Abstract

Mind has various functions such as remembering a certain event, processing information, and providing responses to information it faces. During depression, mind does not work in an efficient way because of wasteful thoughts constantly occupying it. In this paper, we study the problem of how to react during depression, focusing on two decisions: ignoring the effects of wasteful thoughts on mind, and attempting to resolve depression. We model the problem of how to react during depression as a Markov Decision Process and solve it optimally. We also test the performance of two easy-to-use decision rules under diverse scenarios: always ignoring and always attempting to resolve.

Keywords

Markov Decision Processes, mental health, optimality equations

Zihinsel Sağlık için Markov Karar Süreci Yaklaşımı

Abstract

Zihin belirli bir olayı hatırlama, bilgiyi proses etme ve maruz kaldığı bilgiye tepki verme gibi çeşitli fonksiyonlara sahiptir. Depresyon boyunca zihin, kendisini sürekli olarak meşgul eden gereksiz düşüncelerden dolayı verimli bir şekilde çalışmaz. Bu makalede, şu iki karara odaklanarak depresyon boyunca nasıl tepki verilmesi gerektiği problemini çalışmaktayız: gereksiz düşüncelerin zihin üzerindeki etkisini ihmal etme ve depresyonu çözmeye çalışma. Depresyon boyunca nasıl tepki verilmesi gerektiği problemini Markov Karar Süreci ile modellemekteyiz ve problemi optimal olarak çözmekteyiz. Ayrıca çeşitli senaryolar altında şu iki kolay-kullanılabilir karar kurallarının performansını test etmekteyiz: her zaman ihmal etme ve her zaman çözmeye çalışma.

Keywords

Markov Karar Süreçleri, zihinsel sağlık, optimallik denklemleri

References

• Alagoz, O., Hsu, H., Schaefer, A.J., Roberts, M.S., Markov decision processes: a tool for sequential decision making under uncertainty. Medical Decision Making, 30 (4), pp. 474-483, 2010.
• Bala, M.V., Mauskopf, J.A.: Optimal assignment of treatments to health states using a Markov decision model: an introduction to basic concepts. Pharmacoeconomics 24, 345–354, 2006.
• Bettis, A. H., Coiro, M. J.,England, J., Murphy, L. K., Zelkowitz, R. L., Dejardins, L. and Compas, B. E. Comparison of two approaches to prevention of mental health problems in college students: enhancing coping and executive function skillsl. Journal of American College Health, 65:313–322, 2017.
• Bor, W., Dean, A.J., Najman, J. and Hayatbakhsh, R. Are child and adolescent mental health problems increasing in the 21st century? a systematic review. Austral. N.Z. J. Psychiatry, 48:606-616, 2014.
• Boardman, F., Griffiths, F., Kokanovic, R., Potiriadis, M., Dowrick, C., & Gunn, J. Resilience as a response to the stigma of depression: A mixed methods analysis. Journal of Affective Disorders, 135, 267–276, 2011.
• Bruffaerts, R., Mortier, P., Kiekens, G., Auerbach, R.P., Cuijpers, P., Demyttenaere, K., Green, J.G., Nock, M.K. and Kessler R.C., Mental health problems in college freshmen: prevalence and academic functioning. J Affect Disord, 225:97–103, 2018.
• Buckaloo, B. J., Krug, K. S., & Nelson, K. B. Exercise and low-security inmate: Changes in depression, stress, and anxiety. The Prison Journal, 89, 328–343, 2009.
• Corrigan, P, Druss, B, Perlick, D. The impact of mental illness stigma on seeking and participating in mental health care. Psychol Sci Public Interest. 5(2):37–70, 2014. Cuijpers, P.,Donker, T., Weissman, M.M., Ravitz, P. and Cristea, I.A., Interpersonal psychotherapy for mental health problems: a comprehensive meta-analysis. Am J Psychiatry, 173:680–687, 2016.
• Denton, B.T., Alagoz, O., Holder, A. and Lee, E.K. Medical decision making: open research challenges. IIE Transactions on Healthcare Systems Engineering, 1(3), 161–167, 2011.
• Einarsen, S. and Nielsen, MB. Workplace bullying as an antecedent of mental health problems: a five-year prospective and representative study. Int Arch Occ Environ Health, 88:131-142, 2015.
• Fergusson, D. M., McLeod, G. F., Horwood, L.J., Swain, N. R. , and Chapple, S., Life satisfaction and mental health problems (18 to 35 years. Psychol Med,+ 45:2427-2436, 2015.
• Gocgun, Y., Approximate dynamic programming for optimal search with an obstacle. Selcuk Univ. J. Eng. Sci. Tech, 2018.
• Jorm AF, Kelly CM, Wright A, Parslow RA, Harris MG, McGorry PD: Belief in dealing with depression alone: results from community surveys of adolescents and adults. J Affect Disord. 96: 59-65, 2006.
• Kessler, R. C., N. A. Sampson, and P. Berglund. Life satisfaction and mental health problems (18 to 35 years. Epidemiol Psychiatr Sci, 24:210–226, 2015.
• Lereya, S.T., Copeland, W.E. Costello, E.J. and Wolke, D., Adult mental health consequences of peer bullying and maltreatment in childhood: two cohorts in two countries. Lancet Psychiatry, 2:524–531, 2015.
• Levecque, K., Anseel, F., De Beuckelaer, A., Van der Heyden, J., & Gisle, L. Work organization and mental health problems in PhD students. Research Policy, 46(4), 868–879, 2017.
• Momotani, H. and Yamamoto, H., Mental health problems. Japanese Journal of Clinical Medicine, 72:288–292, 2014.
• Nunes, L.G. Nadal, de Carvalho, S., Rodrigues, R. Markov decision process applied to the control of hospital elective admissions. Artif. Intell. Med., 47, 159–171., 2009.
• Outcalt, S.D., Kroenke, K. and Krebs, E.E., Chronic pain and comorbid mental health conditions: independent associations of posttraumatic stress disorder and depression with pain, disability, and quality of life. J Behav Med, 38:535-543, 2015.
• Parker, A.G. Hetrick, S.E. Jorm, A.F. Yung, A.R. McGorry, P.D. Mackinnon, A. Moller, B. and Purcell, R., The effectiveness of simple psychological and physical activity interventions for high prevalence mental health problems in young people: a factorial randomised controlled trial. J. Affect. Disord., 196:200–209, 2016.
• Patten, SB: Markov models of major depression for linking psychiatric epidemiology to clinical practice. Clin Pract Epidemol Ment Health. 1 (1): 2-10, 2005.
• Puterman, M., Markov Decision Processes. John Wiley and Sons, New Jersey, 1994.
• Reiss, F., Socioeconomic inequalities and mental health problems in children and adolescents: A systematic review, Soc Sci Med, 90, pp. 24-31, 2013.
• Sigurdson, J.F., A.M. Undheim, J.L. Wallander, S. Lydersen, and A.M. Sund. The long-term effects of being bullied or a bully in adolescence on externalizing and internalizing mental health problems in adulthood. Child Adolesc Psychiatry Ment Health, 9:42, 2015.
• Stahl, J.E., Modelling methods for pharmacoeconomics and health technology assessment: an overview and guide, Pharmacoeconomics, 26 (2), 131-148, 2008.