
Bul. Acad. Ştiinţe Repub. Mold. Mat., 2015, Number 3, Pages 72–78
(Mi basm396)




This article is cited in 1 scientific paper (total in 1 paper)
Research articles
Determining the distribution of the duration of stationary games for zeroorder markov processes with final sequence of states
Alexandru Lazari^{} ^{} Moldova State University, 60 Mateevici str., Chişinău, MD2009, Moldova
Abstract:
A zeroorder Markov process with final sequence of states represents a stochastic system with independent transitions that stops its evolution as soon as given final sequence of states is reached. The transition time of the system is unitary and the transition probability depends only on the destination state. We consider the following game. Initially, each player defines his distribution of the states. The initial distribution of the states is established according to the distribution given by the first player. After that, the stochastic system passes consecutively to the next state according to the distribution given by the next player. After the last player, the first player acts on the system evolution and the game continues in this way until the given final sequence of states is achieved. Our goal is to study the duration of this game, knowing the distribution established by each player and the final sequence of states of the stochastic system. It is proved that the distribution of the duration of the game is a homogeneous linear recurrent sequence and it is developed a polynomial algorithm to determine the initial state and the generating vector of this recurrence. Using the generating function, the main probabilistic characteristics are determined.
Keywords and phrases:
zeroorder Markov process, final sequence of states, duration, game, homogeneous linear recurrence, generating function.
Full text:
PDF file (115 kB)
References:
PDF file
HTML file
MSC: 65C40, 60J22, 90C39, 90C40 Received: 15.10.2015
Language:
Citation:
Alexandru Lazari, “Determining the distribution of the duration of stationary games for zeroorder markov processes with final sequence of states”, Bul. Acad. Ştiinţe Repub. Mold. Mat., 2015, no. 3, 72–78
Citation in format AMSBIB
\Bibitem{Laz15}
\by Alexandru~Lazari
\paper Determining the distribution of the duration of stationary games for zeroorder markov processes with final sequence of states
\jour Bul. Acad. \c Stiin\c te Repub. Mold. Mat.
\yr 2015
\issue 3
\pages 7278
\mathnet{http://mi.mathnet.ru/basm396}
Linking options:
http://mi.mathnet.ru/eng/basm396 http://mi.mathnet.ru/eng/basm/y2015/i3/p72
Citing articles on Google Scholar:
Russian citations,
English citations
Related articles on Google Scholar:
Russian articles,
English articles
This publication is cited in the following articles:

Alexandru Lazari, “Stochastic games on Markov processes with final sequence of states”, Bul. Acad. Ştiinţe Repub. Mold. Mat., 2017, no. 1, 77–94

Number of views: 
This page:  61  Full text:  9  References:  18 
