An application of stochastic maximum principle for a constrained system with memory

Year 2025, Volume: 74 Issue: 1, 150 - 161

Emel Savku

Abstract

In this research article, we study a stochastic control problem in a theoretical frame to solve a constrained task under memory impact. The nature of memory is modeled by Stochastic Differential Delay Equations and our state process evolves according to a jump-diffusion process with time-delay. We work on two specific types of constraints, which are described in the stochastic control problem as running gain components. We develop two theorems for corresponding deterministic and stochastic Lagrange multipliers. Furthermore, these theorems are applicable to a wide range of continuous-time stochastic optimal control problems in a diversified scientific area such as Operations Research, Biology, Computer Science, Engineering and Finance. Here, in this work, we apply our results to a financial application to investigate the optimal consumption process of a company via its wealth process with historical performance. We utilize the stochastic maximum principle, which is one of the main methods of continuous-time Stochastic Optimal Control theory. Moreover, we compute a real-valued Lagrange multiplier and clarify the relation between this value and the specified constraint.

Keywords

Stochastic optimal control, stochastic maximum principle, stochastic differential delay equations, Lagrange multiplier, anticipated backward stochastic differential equations

Ethical Statement

The author declares no conflict of interest.

References

• Bichtele,r K., Stochastic Integration with Jumps, Cambridge University Press, 2002. https://doi.org/10.1017/CBO9780511549878
• Cartea, A., Donnelly, R., Jaimungal, S., Algorithmic trading with model uncertainty, SIAM Journal on Financial Mathematics, 8(1) (2017), 635-671. https://doi.org/10.1137/16M106282X
• Cont, R., Tankov, P., Financial Modelling with Jump Processes, Chapman and Hall/CRC, 2003. https://doi.org/10.1201/9780203485217
• Dahl Rognlien, K., Stokkereit, E., Stochastic maximum principle with Lagrange multipliers and optimal consumption with L´evy wage, Afrika Matematika, 27(3) (2016), 555-572. https://doi.org/10.1007/s13370-0150360-5
• Dordevic, J., Rognlien Dahl, K., Stochastic optimal control of pre-exposure prophylaxis for HIV infection, Mathematical Medicine and Biology: A Journal of the IMA, 39(3) (2022), 197-225. https://doi.org/10.1007/s00285-024-02151-3
• Elliott, R. J., Siu, T. K., Robust optimal portfolio choice under Markovian regime-switching model, Methodology and Computing in Applied Probability, 11 (2009), 145-157. https://doi.org/10.1007/s11009-008-9085-3
• Federico, S., A stochastic control problem with delay arising in a pension fund model, Finance and Stochastics, 15(3) (2011), 421-459. https://doi.org/10.1007/s00780-010-0146-4
• Gozzi, F., Masiero, F., Stochastic optimal control with delay in the control I: Solving the HJB equation through partial smoothing, SIAM Journal on Control and Optimization, 55(5) (2017), 2981-3012. https://doi.org/10.1137/16M1070128
• Gueant, O., Lehalle, C. A., Fernandez-Tapia, J., Dealing with the inventory risk: a solution to the market making problem, Mathematics and Financial Economics, 7(4) (2013), 477-507. https://doi.org/10.1007/s11579-012-0087-0
• Hansen L. P., Sargent T. J., Robustness, Princeton University Press, 2008. https://doi.org/10.1515/9781400829385
• Korn, R., Olaf, M., Mogens, S., Worst-case-optimal dynamic reinsurance for large claims, European Actuarial Journal, 2 (2012), 21-48. https://doi.org/10.1007/s13385-012-0050-8
• Korn, R., Melnyk, Y., Seifried, F. T., Stochastic impulse control with regime-switching dynamics, European Journal of Operational Research, 260(3) (2017), 1024-1042. https://doi.org/10.1016/j.ejor.2016.12.029
• Lamberton, D., Lapeyre, B., Introduction to Stochastic Calculus Applied to Finance, Chapman and Hall/CRC, 2011. https://doi.org/10.1201/9781420009941
• Larssen, B., Risebro, N. H., When are HJB-equations in stochastic control of delay systems finite dimensional?, Stochastic Analysis and Applications, 21(3) (2003), 643-71. https://doi.org/10.1081/SAP-120020430
• Mataramvura, S., Oksendal, B., Risk minimizing portfolios and hjbi equations for stochastic differential games, Stochastics An International Journal of Probability and Stochastic Processes, 80(4) (2008), 317-337. https://doi.org/10.1080/17442500701655408
• Miller, C. W., Yang, I., Optimal control of conditional value-at-risk in continuous time, SIAM Journal on Control and Optimization, 55(2) (2017), 856-884. https://doi.org/10.1137/16M1058492
• Mohammed, S.E.A., Stochastic Functional Differential Equations, Pitman, London, 1984.
• Mohammed, S. E. A., Stochastic differential systems with memory: theory, examples and applications. In Stochastic Analysis and Related Topics VI: Proceedings of the Sixth Oslo—Silivri Workshop Geilo 1996 (pp. 1-77), Boston, MA: Birkhauser Boston, 1998. https://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1064&context=math_articles
• Oksendal, B., Stochastic Differential Equations: an Introduction with Applications, Springer Science & Business Media, 2013. https://doi.org/10.1007/978-3-642-14394-6
• Oksendal, B., Sulem, A., Zhang, T., Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations, Advances in Applied Probability, 43(2) (2011), 572-596. https://doi:10.1239/aap/1308662493
• Oksendal, B., Sulem, A., Stochastic Control of Jump Diffusions. In: Applied Stochastic Control of Jump Diffusions, Springer, 2019. https://doi.org/10.1007/978-3-030-02781-0_5
• Pham, H., Continuous-Time Stochastic Control and Optimization with Financial Applications, Vol. 61, Springer Science & Business Media, 2009. https://doi.org/10.1007/978-3-540-89500-8
• Peng, S, Yang, Z., Anticipated backward stochastic differential equations, The Annals of Probability, 37(3) (2009), 877–902. https://doi.org/10.1214/08-AOP423
• Peters, J., Mulling, K., Altun, Y., Relative entropy policy search, In Proceedings of the AAAI Conference on Artificial Intelligence, 24 (2010), 1607-1612. https://doi.org/10.1609/aaai.v24i1.7727
• Savku, E., Weber, G. W., A stochastic maximum principle for a Markov regime-switching jump-diffusion model with delay and an application to finance, Journal of Optimization Theory and Applications, 179(2) (2018), 696-721. https://doi.org/10.1007/s10957-017-1159-3
• Savku, E., Fundamentals of Market Making Via Stochastic Optimal Control, Operations Research: New Paradigms and Emerging Applications, (pp.136-154), Purut¸cuo˘glu, V., Weber, G.W., & Farnoudkia, H. (Eds.), (1st ed.), CRC Press, 2022. https://doi.org/10.1201/9781003324508-10
• Savku, E., A stochastic control approach for constrained stochastic differential games with jumps and regimes, Mathematics, 11(14) (2023), 3043. https://doi.org/10.1007/s10957-017-1159-3
• Savku, E., Deep-Control of Memory via Stochastic Optimal Control and Deep Learning, In International Conference on Mathematics and its Applications in Science and Engineering (pp. 219-240), Cham: Springer Nature Switzerland, 2023. https://doi.org/10.1007/978-3-031-49218-1_16
• Savku, E., Memory and anticipation: two main theorems for Markov regime-switching stochastic processes, Stochastics, (2024), 1-18. https://doi.org/10.1080/17442508.2024.2427733
• Savku, E., An approach for regime-switching stochastic control problems with memory and terminal conditions, Optimization, (2024), 1–18. https://doi.org/10.1080/17442508.2024.2427733
• Tamar, A., Glassner, Y., Mannor, S. Optimizing the cvar via sampling, In Proceedings of the AAAI Conference on Artificial Intelligence, 29 (2015). https://doi.org/10.1609/aaai.v29i1.9561
• Touzi, N., Optimal Stochastic Control, Stochastic Target Problems, and Backward SDE, Vol. 29, Springer Science & Business Media, 2012.https://doi.org/10.1007/978-1-4614-4286-8
• Uğurlu, K., Tomasz, B., Distorted probability operator for dynamic portfolio optimization in times of socioeconomic crisis, Central European Journal of Operations Research, 31(4) (2023), 1043-1060. https://doi.org/10. 1007/s10100-022-00834-0
• Uğurlu, K., Robust utility maximization of terminal wealth with drift and volatility uncertainty, Optimization, 70(10) (2021), 2081-2102. https://doi.org/10.1080/02331934.2020.1774586
• Wendell, H., F., Soner, H. M., Controlled Markov Processes and Viscosity Solutions, Vol. 25, Springer Science & Business Media, 2006. https://doi.org/10.1007/0-387-31071-1