Teoriya Veroyatnostei i ee Primeneniya
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive
Impact factor
Subscription
Guidelines for authors
Submit a manuscript

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Teor. Veroyatnost. i Primenen.:
Year:
Volume:
Issue:
Page:
Find







Teoriya Veroyatnostei i ee Primeneniya, 1975, Volume 20, Issue 4, Pages 855–864 (Mi tvp3366)  

This article is cited in 20 scientific papers (total in 20 papers)

Short Communications

A controlled finite Markov chain with arbitrary set of decisions

R. Ya. Chitashvili

Instutite of economics and law, Academy of Sciences, Georgian SSR
Abstract: We consider a controlled Markov chain with a finite set $S$ of states $s$ and an arbitrary set $A$ of decisions $a$ and with the optimality criterion of the form
$$ \mathbf E^\pi\biggl[\sum_{n=1}^\tau r(s_n,a_n)+c(s_\tau,a_\tau)\biggr], $$
where the stopping moment $\tau$ does not depend on $(s_n,a_n);n\ge1)$ and has the geometric distribution.
Sufficient conditions for the existence of $(k,\varepsilon)$-optimal policies are found.
Received: 15.08.1974
English version:
Theory of Probability and its Applications, 1976, Volume 20, Issue 4, Pages 839–847
DOI: https://doi.org/10.1137/1120091
Bibliographic databases:
Document Type: Article
Language: Russian
Citation: R. Ya. Chitashvili, “A controlled finite Markov chain with arbitrary set of decisions”, Teor. Veroyatnost. i Primenen., 20:4 (1975), 855–864; Theory Probab. Appl., 20:4 (1976), 839–847
Citation in format AMSBIB
\Bibitem{Chi75}
\by R.~Ya.~Chitashvili
\paper A~controlled finite Markov chain with arbitrary set of decisions
\jour Teor. Veroyatnost. i Primenen.
\yr 1975
\vol 20
\issue 4
\pages 855--864
\mathnet{http://mi.mathnet.ru/tvp3366}
\mathscinet{https://mathscinet.ams.org/mathscinet-getitem?mr=428455}
\zmath{https://zbmath.org/?q=an:0371.60084}
\transl
\jour Theory Probab. Appl.
\yr 1976
\vol 20
\issue 4
\pages 839--847
\crossref{https://doi.org/10.1137/1120091}
Linking options:
  • https://www.mathnet.ru/eng/tvp3366
  • https://www.mathnet.ru/eng/tvp/v20/i4/p855
  • This publication is cited in the following 20 articles:
    Citing articles in Google Scholar: Russian citations, English citations
    Related articles in Google Scholar: Russian articles, English articles
    Теория вероятностей и ее применения Theory of Probability and its Applications
    Statistics & downloads:
    Abstract page:239
    Full-text PDF :99
    References:2
     
      Contact us:
     Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2025