Markov Models for disease progression are common in medical decision making (see references below). The parameters in a Markov model can be estimated by observing the time it takes patients in any ...

This paper deals with denumerable continuous-time Markov decision processes (MDP) with constraints. The optimality criterion to be minimized is expected discounted loss, while several constraints of ...

This paper outlines a way to estimate transition matrices for use in credit risk modeling with a decades-old methodology that uses aggregate proportions data. This methodology is ideal for credit-risk ...

We present new numerical algorithms and bounds for the infinite horizon, discrete stage, finite state and action Markov decision process with imprecise transition probabilities. We assume that the ...