Controllable Markov Processes and Stefan's Problem

The properties of the “cost” $s(x)$ are investigated for controllable Markov processes with continuous time. We obtain a new (integral) form of the recurrence equations satisfied by the “cost” $s(x)$, and find conditions for which $s(x)$ is the solution of a generalized Stefan problem.