Faculty of Business Administration
Visiting Scholar Seminar


Risk-Sensitive Finite-Horizon Piecewise Deterministic Markov Decision Processes and Empirical Analysis

Yonghui HUANG
School of Mathematics
Zhongshan University


Date: 19/08/2021, Thursday
Time: 3:00pm – 4:30pm

Password: 619437


In this talk, we discuss zero-sum piecewise deterministic Markov games with Borel state and action spaces, where the expected infinite-horizon discounted payoff criterion is considered.  Both the transition rate and payoff function could be unbounded. The policies of both players are history-dependent, and the controls continuously act on the transition rate and the payoff rate. Under suitable conditions, the non-explosion of the process, we develop the finiteness of the criterion and the Dynkin’s formula in our setup, via which we show that the value function of the zero-sum game is the unique solution to the Shapley equation with the form of a differential equation. Meanwhile, the existence of Nash equilibrium is established.


Professor Yonghui Huang is an Associate Professor in the School of Mathematics, Zhongshan University, Guangzhou. He received his PhD degree in Probability and Statistics from the same school in Zhongshan University. Prof. Huang’s research interests are Markovian decision process and its applications. Prof. Huang has published 20 research papers in outstanding journals, including Mathematics of Operations Research, Journal of Applied Probability, Advanced Applied Probability.