Dynamic programming principle for optimal control of uncertain random differential equations and its application to optimal portfolio selection

This study aimed to examine an uncertain stochastic optimal control problem premised on an uncertain stochastic process. The proposed approach is used to solve an optimal portfolio selection problem. This paper’s research is relevant because it outlines the procedure for solving optimal control problems in uncertain random environments. We implement Bellman’s principle of optimality method in dynamic programming to derive the principle of optimality. Then the resulting Hamilton-Jacobi-Bellman equation (the equation of optimality in uncertain stochastic optimal control) is used to solve a proposed portfolio selection problem. The results of this study show that the dynamic programming principle for optimal control of uncertain stochastic differential equations can be applied in optimal portfolio selection. Also, the study results indicate that the optimal fraction of investment is independent of wealth. The main conclusion of this study is that, in Itô-Liu financial markets, the dynamic programming principle for optimal control of uncertain stochastic differential equations can be applied in solving the optimal portfolio selection problem.

1. Jiwo S., Chikodza E. A hybrid optimal control model. Journal of Uncertain Systems. 2015;9(1):3–9.

2. Fei W. Optimal control of uncertain stochastic systems with Markovian switching and its applications to portfolio decisions. Cybernetics and Systems. 2014 Jan 2;45(1):69–88. URL: https://doi.org/10.1080/01969722.2014.862445

3. Zimmermann H.J. Fuzzy set theory — and its applications. Springer Science and Business Media; 2011 Jun 27.

4. Chen X., Zhu Y., Sheng L. Optimal control for uncertain stochastic dynamic systems with jump and application to an advertising model. Applied Mathematics and Computation. 2021 Oct 15;407:126337. URL: https://doi.org/10.1016/j.amc.2021.126337

5. Liu B. Uncertainty Theory (5th Ed.). China: Uncertainty Theory Laboratory; 2024.

6. Matenda F. R., Chikodza E. A stock model with jumps for Itô–Liu financial markets. Soft Computing. 2019 Jun 1;23:4065–4080. DOI: 10.1007/s00500–018–3054–8

7. Zadeh L. A. Fuzzy sets. Information and control. 1965;8(3):338–53. URL: https://doi.org/10.1016/S0019–9958(65)90241-X

8. Liu B. Uncertainty Theory (2nd Ed.) Berlin: Springer-Verlag; 2007.

9. Liu B. Some research problems in uncertainty theory. Journal of Uncertain systems. 2009;3(1):3–10.

10. Liu Y. Uncertain random variables: A mixture of uncertainty and randomness. Soft Computing. 2013;17:625–634. URL: https://doi.org/10.1007/s00500–012–0935–0

11. Gao J., Yao K. Some concepts and theorems of uncertain random process. International Journal of Intelligent Systems. 2015;30(1):52–65. URL: https://doi.org/10.1002/int.21681

12. Wang G., Wu Z., Xiong J. An introduction to optimal control of FBSDE with incomplete information: Springer; 2018.

13. Apollinaire NM, Amanda PN. Stochastic Optimal Control Theory Applied in Finance. Science. 2022;7(4):59–67. DOI: 10.11648/j.mcs.20220704.11

14. Bayraktar E., Yao S. Stochastic control/stopping problem with expectation constraints. Stochastic Processes and their Applications. 2024:104430. URL: https://doi.org/10.1016/j.spa.2024.104430

15. Song Y., Wu Z. The general maximum principle for discrete-time stochastic control problems. Automatica. 2024;159:111338. URL: https://doi.org/10.1016/j.automatica.2023.111338

16. Merton R.C. Theory of rational option pricing. The Bell Journal of economics and management science. 1973:141–83.

17. Merton R. C. Optimal consumption and portfolio rules in a continuous time model. Journal of Economic Theory. 1971;3:373–413.

18. Fleming W.H., Rishel R.W. Deterministic and stochastic optimal control: Springer Science and Business Media; 2012.

19. Karatzas I. Optimization problems in the theory of continuous trading. SIAM Journal on Control and Optimization. 1989;27(6):1221–59. URL: https://doi.org/10.1137/0327063

20. Agram N., Øksendal B. Stochastic control of memory mean-field processes. Applied Mathematics and Optimization. 2019;79:181–204. URL: https://doi.org/10.1007/s00245–017–9425–1

21. Oksendal B. Stochastic differential equations: an introduction with applications: Springer Science and Business Media; 2013.

22. Øksendal B., Sulem A. A maximum principle for optimal control of stochastic systems with delay, with applications to finance. Preprint series Pure mathematics. URL: https://www.duo.uio.no/bitstream/handle/10852/10711/1/pm29–00.pdf

23. Øksendal B., Sulem A. Stochastic control of Itô-Lévy processes with applications to finance. Communications on Stochastic Analysis. 2014;8(1). DOI: 10.31390/cosa.8.1.01

24. Zhu Y. Uncertain optimal control with application to a portfolio selection model. Cybernetics and Systems: An International Journal. 2010;41(7):535–547. URL: https://doi.org/10.1080/01969722.2010.511552

25. Chen Y., Zhu Y., Li B. Indefinite LQ optimal control with cross term for discrete-time uncertain systems. Mathematical Methods in the Applied Sciences. 2019;42(4):1194–209. URL: https://doi.org/10.1002/mma.5422

26. Yan H., Jin T., Sun Y. Uncertain bang–bang control problem for multi-stage switched systems. Physica A: Statistical Mechanics and its Applications. 2020;551:124115. URL: https://doi.org/10.1016/j.physa.2019.124115

27. Deng L., Zhu Y. An uncertain optimal control model with n jumps and application. Computer Science and Information Systems. 2012;9(4):1453–68. DOI: 10.2298/CSIS 120225049D 28. Chen R., Zhu Y. An optimal control model for uncertain systems with time-delay. Journal of the Operations Research Society of Japan. 2013;56(4):243–56. URL: https://doi.org/10.1016/S0045–7949(03)00146–9

28. Jin T., Zhu Y., Shu Y., Cao J., Yan H., Jiang D. Uncertain optimal control problem with the first hitting time objective and application to a portfolio selection model. Journal of Intelligent and Fuzzy Systems. 2023;44(2):1585–99. DOI: 10.3233/JIFS-222041

29. Chen X., Zhu Y. Optimal control for uncertain random singular systems with multiple time-delays. Chaos, Solitons and Fractals. 2021;152:111371. DOI: 10.1016/j.chaos.2021.111371

30. Xin Chen Y.Z. Uncertain random linear quadratic control with multiplicative and additive noises. Asian Journal of Control. 2020;23(6):2849–64. URL: https://doi.org/10.1002/asjc.2460

31. Chen X., Jin T. Optimal control for a multistage uncertain random system. IEEE Access. 2023;11:2105–17. DOI: 10.1109/ACCESS.2023.3234068

32. Chen X., Zhu Y. Multistage uncertain random linear quadratic optimal control. Journal of Systems Science and Complexity. 2020;33(6):1847–72. URL: https://doi.org/10.1007/s11424–020–8312-z

33. Chen X., Zhu Y. Optimal control for multistage uncertain random dynamic systems with multiple time delays. ISA transactions. 2022;129:171–91. URL: https://doi.org/10.1016/j.isatra.2022.02.016

34. Liu Y. Uncertain random programming with applications. Fuzzy Optimization and Decision Making. 2013;12:153–69. URL: https://doi.org/10.1007/s10700–012–9149–2