Stochastic models of just-intime systems and windows of vulnerability in terms of the processes of birth and death

The paper proposes a method for constructing models based on the analysis of birth and death processes with linear growth in semimartingale terms. Based on this method, stochastic models of simple just-in-time systems (analyzed in the theory of productive systems) and windows of vulnerability (widely discussed in risk theory) are considered. The main results obtained in the work are presented in terms of the average values of the time during which the processes reach zero values. At the same time, they are considered and used in the study of assessment models for local times of the processes. Here, simple Markov processes with a linear growth of intensities (perhaps, depending on time) are analyzed. At the same time, the obtained and used estimates are of theoretical interest. Thus, for example, the average value of the stopping time, at which the process reaches zero, depends on functions such as the harmonic number and the remainder term for the logarithmic function in the Taylor theorem. As the main result, the method of mathematical modeling of just-intime systems and windows of vulnerability is proposed. The semimartingale description method used here should be considered as the first step of such a modeling, since, being a trajectory method, it allows diffusion (including Research Article cb The content is published under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/) Please cite this article in press as: Bu t o v A. A., K o v a l e n k o A. A. Stochastic models of just-in-time systems and windows of vulnerability in terms of the processes of birth and death, Vestn. Samar. Gos. Tekhn. Univ., Ser. Fiz.-Mat. Nauki [J. Samara State Tech. Univ., Ser. Phys. Math. Sci.], 2019, vol. 23, no. 3, pp. 525–540. doi: 10.14498/vsgtu1725. Authors’ Details: Alexander A. Butov https://orcid.org/0000-0002-8322-9892 Dr. Phys. & Math. Sci., Professor; Head of Dept.; Dept. of Applied Mathematics; e-mail: butov.a.a@gmail.com Anatoly A. Kovalenko https://orcid.org/0000-0003-3820-9785 M. Sc.; Postgraduste Student; Dept. of Applied Mathematics; e-mail: anako09@mail.ru


Introduction
In the paper, we propose a method for constructing models based on an analysis of the processes of birth and death with linear growth in semimartingale terms. As the main examples of stochastic models, simple just-in-time systems and windows of vulnerability are considered. Just-in-time systems (abbreviated as JIT are analyzed in the theory of productive systems, and windows of vulnerability (abbreviated as WoV are widely discussed in risk theory. The main results obtained in the work are presented in terms of the average values of the time during which the processes reach zero values. The work also considers (and uses when studying models) estimates of the local times of the studied processes.
We note that here, simple Markov processes with a linear growth of intensities (perhaps, depending on time) are analyzed. Nevertheless, the obtained and used estimates are of a certain theoretical interest. Thus, for example, the average value of the stopping time, at which the process reaches zero, depends on functions such as the harmonic number and the remainder term for the logarithmic function in the Taylor theorem.
However, as one of the main results, it is proposed to consider the presented method of mathematical modeling of JIT and WoV systems. The semimartingale description approach used here should be considered as the first step of such a modeling, since, being a trajectory method, it allows diffusion (including non-Markov processes) generalizations when constructing stochastic models of WoV and JIT.
At present, when constructing probabilistic models of WoV, in the theory of risk, researches have appeared that analyzes the average values of the time during which the trajectories are in a certain area and therefore the system is vulnerable (see, for example [1][2][3] and references in them). Studies of average values of the local time for such models are interesting.
And if the WoV descriptions in the risk theory are predominantly stochastic, then the models based on JIT are mostly deterministic. Although it is obvious that a probabilistic approach to the study of such processes is in demand. We also note that the stochastic description of JIT systems proposed here is in a certain sense a logical (and analytic) continuation of [4], in which a semimartingale description is given for problems of optimal control of such systems.
In this article, statements for the average values of the local time and the stopping times when the birth and death processes reach a given value are obtained. This allows us to consistently present estimates for the models of the JIT system and for WoV, the result for which is given in the form of a limit theorem.
The principle of JIT is well known and used in many areas. However, its emergence and development is associated primarily with the analysis of productive systems (see, for example, [5][6][7][8][9], as well as [4] and references therein). Here, as in cite [4], we touch on the time reversal method. A number of papers are devoted to the study of this method for stochastic systems represented in the semimartingale description (see, for example, [10][11][12] and references therein). Also close to this method are studies of stochastic bridges (see, for example, [13][14][15] and references therein). Descriptions in terms of the processes of birth and death are devoted primarily to models in biology (see, for example, [16]). However, the semimartingale approach allows for significant generalizations. So, it allows one to describe and investigate models of random walk processes for a wide class of objects (see, e.g., [17][18][19][20] and [4]).
All the main results in the paper are formulated as theorems and lemmas. The proofs of the results use semimartingale methods.
Assumption 1. Suppose that is a process of birth and death with linear growth, that is, the compensators of the submartingales and on B arẽ︀ Then the quadratic characteristics of the locally square-integrable martingales = ( Assumption 2. We suppose that 0, > 0 and > . It is clear that under the representation (2) and (3) the process with the definition (1) is a square-integrable birth and death process with linear growth. For such a process, it easily follows from Assumption 2 that Therefore, from Chebyshev's inequality we obtain Thus, and is the stopping time on B.
Notation 4. For any process of birth and death on B we denote by ( ) the average value of the local time on R + for ∈ N : and ( ) is set in Definition 1.

From Definition 1 it follows that
Since for X under consideration, ( ) < ∞ P-a.s., then we have where From (5), Notation 4 and (6) it follows that We define the following auxiliary functions.
Definition 2. Let ( ) be the harmonic number (i.e. the partial sum of the harmonic series) for ∈ N: Definition 3. Let ( ) be the remainder term in Taylor theorem of the function log(1 − ) for -th order Taylor polynomial ( ) of ∈ (0, 1), ∈ N: . Definition 4. We define the following auxiliary constants:

Theoretical results necessary for the study of models
Theorem 1. For the average value of the stopping time , It should be noted that the expression (8) in the statement of the theorem is rather unusual. As for (9), it can also be regarded as the limiting case of (8) for → 0. Corollary 1. If = 1, then for the average value of the stopping time , and The proof of the theorem is based on the equality (7) and on the following lemma, which is also of independent interest.
Corollary 2. If = 0, then for the average value of the local time on R + for ∈ N,

The problem of JIT
The term just-in-time arose in connection with the need for a description of the so-called production systems (see, for example, [6,9] and references in [4]).
Suppose that a fixed strictly positive finite time moment > 0 is given. Suppose also that the process of birth and death = ( ) ∈[0, ] (or an integervalued random walk for the general case) has the initial value 0 = ∈ N.
Definition 5. The process of birth and death is just-in-time T (abbreviated as JIT T), if = 0 P-a.s. and P{ > 0} > 0 for any ∈ [0, ) (that is, P{ } = 1 and P{ > } > 0 for any ∈ [0, )). The process of birth and death is just-in-time (abbreviated as JIT ) if there exists a strictly positive finite number > 0 such that the process is JIT T.
As a simple example, consider the linear pure death JIT process = ( ) ∈[0, ] with death rates that are properly time-dependent. Suppose that in a certain production system it is necessary to perform a set of homogeneous operations with successively decreasing numbers K 0 = { , −1, . . . , 1, 0} exactly for a period of time , where ∈ N and ∈ (0, +∞). Usually, operation number 0 is considered terminal and unproductive (for example, warehousing or packaging). For systems of this type, it is of interest problem to estimate the time of the beginning of the last operation (with the number 0), since the control possibilities of the system after this moment vanish.
Let the nonincreasing process = ( ) ∈[0, ] with values in K 0 "indicates" the number of the operation that is executed at each moment ∈ [0, ]. We denote by ( ) the execution time of each operation with number ∈ K 0 . Then ( ) = ( ), where is the local time defined in Definition 1, for the process . In these notations, the problem mentioned above is formulated in the same way as in the first section: find , where the moment is defined in Notation 2 and is equal to ( ) + . . . + (1) = − (0).
Note also that the process with reversed time V = (V ) ∈[0, ] with values V = ( − ) is a point counting process provided V = . If the times { (0), (1), . . . , ( )} were independent and identically exponentially distributed random variables, then V would be a Poisson process. However, in this case the condition V = would not hold. The trajectories of the Poisson process for which this condition is fulfilled form a well-known Poisson bridge, see, for example, [12,13] and the literature cited therein. The compensator of the process V has the form̃︀ Then the process can be considered as a Poisson process with reversed time with an initial value 0 = and with the condition ( ) = 0. Its compensator is equal tõ︀ Note that the condition ( ) = 0 can also be achieved with other dependencies of the death rate on time. As an example, consider the process, which is a very simple generalization of the process with the specified compensator︀ = (̃︀ ) ∈[0, ] . Suppose that the linear pure death process can be represented as the difference = 0 − with = 0 − and ∈ [0, ], where = ( ) ∈[0, ] is the counting process of numbers of negative jumps of : Consequently, the supermartingale has the representation For the average value of the stopping time ( ) = of the linear pure death process , with the intensity depending on time in accordance with the representation (14), the following statement holds.
Remark 1. Note that (15) can be represented in the form, which is to some extent close to (9) of Theorem 1: where ( ) = ( ). We also formulate the lemma, which is somewhat more general than Theorem 2, and is of independent interest.

The problem of WoV
Consider the multiple analog of the process of birth and death with linear growth, discussed in the previous section. As is known, birth and death processes can serve as primary stochastic models for describing changes in the size of a simple population of individuals, cells, bacteria or viruses. They are also models of simple queueing systems with possible call replication in queues. In some biological and computer systems, multiple cycles are observed, each of which consists of the following consecutive events and stages: the event of infection, the stage of the disease, the event of recovery, the stage of health. This model assumes that additional infections do not occur during the stage of the disease (as, for example, in the case of infections with the same strain of influenza virus). The initial number of viruses in each case of infection is considered random. In the case of a queueing system, the cycle includes an event of receiving a call packet into the system, a service stage with possible call replication, an event of reaching the zeroth queue, an idle system. It is also assumed that the system is immune to new call packages until the current service package is fully serviced. This model also corresponds to production systems with stochastic execution of homogeneous operations. The initial number of production operations in the plan for each cycle is also considered random. Such a multistage process can be interpreted as follows.
Consider a cycle with number ∈ N. The system receives ( ) viruses (or calls, in the case of a queuing system) at the stopping time ( − 1). In this case, the first cycle starts with zero time: (0) = 0. After the expiration of the time ( ), the number of viruses reaches zero. That is, there are viruses in the system on the time interval This interval is called the vulnerability window (or the window of vulnerability, abbreviated to WoV ), because the system is infected and therefore vulnerable. For example, for a living system, susceptibility to other diseases or threats increases, and the computer system becomes vulnerable, since there is a threat to its information security. During the time ( ), that is, on the interval [ ( ), ( )), the system is free of viruses. At the stopping time ( ) = ( ) + ( ) another infection occurs, that is, the next cycle begins.
Thus, the difference between this scheme and the known process of birth and death with linear growth and immigration (see e.g., [20]) is that immigration is suspended for a time of non-zero process values. Apparently, it makes sense to call this process of immigration an episodic immigration. Below we present a formal mathematical description of this process.
Suppose also that (0) is ℱ 0 -measurable. Consider on B a Poisson process = ( ) 0 with a parameter > 0. Suppose that and are independent. Let = ( ) 0 be the counting process of the number of jumps of the process of episodic immigration, and = ( ) 0 is the process of episodic immigration: For in WoV, = ( ) 0 behaves similarly to the process discussed in the Section 1. Thus, we assume that the compensators of the processes and on the stochastic basis B are the same as in (2) We also define the function ℒ = { } for its Lebesgue measure {·}. Note that

Proof of the results
4.1. Proof of Lemma 1 From (1) it follows that for any 0 = ∈ N, for all ∈ N and ∈ R + it holds Since each integrable semimartingale (19) is the difference of submartingales, theñ︀ Therefore, for the compensators of the processes in (19), we obtain from (2) that︀ From (4), (5) and (20) we receive the following equalities: For = 0, the statement of Lemma 1 (and also Corollary 2) follows directly from (21). If > 0, then multiplying (21) by ( / ) ( − ) and summing over from 1 to , we obtain for ∈ N: The statement (12) of Lemma 1 follows from (22) with Notations 4.

Discussion
This article is devoted to the development of modeling methods for discrete stochastic systems based on semimartingale descriptions in terms of local time processes. For this it was necessary to formulate (and prove) a number of theoretical results for fairly simple systems. The proposed method is interesting not only because it allows obvious generalizations, but also by the possibilities of simple computer simulation. This is due primarily to the fact that all the descriptions and methods under consideration are trajectory. We also note that the definitions of JIT and WoV given in the paper are quite general and provide for generalizations of the results considered in the article.