|
|
Teoriya Veroyatnostei i ee Primeneniya, 1975, Volume 20, Issue 4, Pages 855–864
(Mi tvp3366)
|
|
|
|
This article is cited in 20 scientific papers (total in 20 papers)
Short Communications
A controlled finite Markov chain with arbitrary set of decisions
R. Ya. Chitashvili Instutite of economics and law, Academy of Sciences, Georgian SSR
Abstract:
We consider a controlled Markov chain with a finite set $S$ of states $s$ and an arbitrary set $A$ of decisions $a$ and with the optimality criterion of the form
$$
\mathbf E^\pi\biggl[\sum_{n=1}^\tau r(s_n,a_n)+c(s_\tau,a_\tau)\biggr],
$$
where the stopping moment $\tau$ does not depend on $(s_n,a_n);n\ge1)$ and has the geometric distribution.
Sufficient conditions for the existence of $(k,\varepsilon)$-optimal policies are found.
Received: 15.08.1974
Citation:
R. Ya. Chitashvili, “A controlled finite Markov chain with arbitrary set of decisions”, Teor. Veroyatnost. i Primenen., 20:4 (1975), 855–864; Theory Probab. Appl., 20:4 (1976), 839–847
Linking options:
https://www.mathnet.ru/eng/tvp3366 https://www.mathnet.ru/eng/tvp/v20/i4/p855
|
| Statistics & downloads: |
| Abstract page: | 239 | | Full-text PDF : | 99 | | References: | 2 |
|