Waiting Time Distributions Associated with Runs of Fixed Length in Two-State Markov Chains

In the present article a general technique is developed for the evaluation of the exact distribution in a wide class of waiting time problems. As an application the waiting time for the r-th appearance of success runs of specified length in a sequence of outcomes evolving from a first order two-state Markov chain is systematically investigated and asymptotic results are established. Several extensions and generalisations are also discussed.     

Sooner and Later Waiting Time Problems Based on a Dependent Sequence

This paper introduces a new concept: a binary sequence of order (k,r), which is an extension of a binary sequence of order k and a Markov dependent sequence. The probability functions of the sooner and later waiting time random variables are derived in the binary sequence of order (k,r). The probability generating functions of the sooner and later waiting time distributions are also obtained. Extensions of these results to binary sequence of order (g,h) are also presented.     

On Waiting Time Problems Associated with Runs in Markov Dependent Trials

A general technique is developed to study the waiting time distribution for the r-th occurrence of a success run of length k in a sequence of Markov dependent trials. Sooner and later waiting time problems are also discussed.     

Waiting time problems for a sequence of discrete random variables

Let X ₁, X ₂,... be a sequence of nonnegative integer valued random variables.For each nonnegative integer i, we are given a positive integer k _i . For every i = 0, 1, 2,..., E _i denotes the event that a run of i of length k _i occurs in the sequence X ₁, X ₂,.... For the sequence X ₁, X ₂,..., the generalized pgf's of the distributions of the waiting times until the r-th occurrence among the events % MathType!MTEF!2!1!+-% feaafeart1ev1aaatCvAUfeBSjuyZL2yd9gzLbvyNv2CaerbuLwBLn% hiov2DGi1BTfMBaeXafv3ySLgzGmvETj2BSbqefm0B1jxALjhiov2D% aebbfv3ySLgzGueE0jxyaibaiiYdd9qrFfea0dXdf9vqai-hEir8Ve% ea0de9qq-hbrpepeea0db9q8as0-LqLs-Jirpepeea0-as0Fb9pgea% 0lrP0xe9Fve9Fve9qapdbaqaaeGacaGaaiaabeqaamaabaabcaGcba% WaaiWabeaacaWGfbWaaSbaaSqaaiaadMgaaeqaaaGccaGL7bGaayzF% aaWaa0baaSqaaiaadMgacqGH9aqpcaaIWaaabaGaeyOhIukaaaaa!43D8!\[\left\{ {E_i } \right\}_{i = 0}^\infty\]are obtained. Though our situations are general, the results are very simple. For the special cases that X's are i.i.d. and {0, 1}-valued, the corresponding results are consistent with previously published results.This research was partially supported by the ISM Cooperative Research Program (90-ISM-CRP-11) of the Institute of Statistical Mathematics.     

On Number of Occurrences of Success Runs of Specified Length in a Higher-Order Two-State Markov Chain

Let X^-m+1, X^-m+2,..., X⁰, X¹, X²,..., Xⁿ be a time-homogeneous {0, 1}-valued m-th order Markov chain. The probability distributions of numbers of runs of "1" of length k (k m) and of "1" of length k (k < m) in the sequence of a {0, 1}-valued m-th order Markov chain are studied. There are some ways of counting numbers of runs with length k. This paper studies the distributions based on four ways of counting numbers of runs, i.e., the number of non-overlapping runs of length k, the number of runs with length greater than or equal to k, the number of overlapping runs of length k and the number of runs of length exactly k.     

Joint Distributions of Runs in a Sequence of Multi-State Trials

In this paper we introduce a Markov chain imbeddable vector of multinomial type and a Markov chain imbeddable variable of returnable type and discuss some of their properties. These concepts are extensions of the Markov chain imbeddable random variable of binomial type which was introduced and developed by Koutras and Alexandrou (1995, Ann. Inst. Statist. Math., 47, 743–766). By using the results, we obtain the distributions and the probability generating functions of numbers of occurrences of runs of a specified length based on four different ways of counting in a sequence of multi-state trials. Our results also yield the distribution of the waiting time problems.     

Sooner and Later Waiting Time Problems for Runs in Markov Dependent Bivariate Trials

In this paper we study exact distributions of sooner and later waiting times for runs in Markov dependent bivariate trials. We give systems of linear equations with respect to conditional probability generating functions of the waiting times. By considering bivariate trials, we can treat very general and practical waiting time problems for runs of two events which are not necessarily mutually exclusive. Numerical examples are also given in order to illustrate the feasibility of our results.     

Joint Distributions of Numbers of Success-runs Until the First Consecutive k Successes in a Higher-Order Two-State Markov Chain

Let X-m+1, X-m+2,.., X0, X1, X2,.., be a time-homogeneous {0, 1}-valued m-th order Markov chain. Joint distributions of the numbers of trials, failures and successes, of the numbers of trials and success-runs of length l (m l k) and of the numbers of trials and success-runs of length l (l m k) until the first consecutive k successes are obtained in the sequence X1, X2,.., There are some ways of counting numbers of runs of length l. This paper studies the joint distributions based on four ways of counting numbers of runs, i.e., the number of non-overlapping runs of length l, the number of runs of length greater than or equal to l, the number of overlapping runs of length l and the number of runs of length exactly l. Marginal distributions of them can be obtained immediately, and surprisingly their distributions are very simple.     

On the Waiting Time for the First Success Run

Let k and m are positive integers with k ≥ m. The probability generating function of the waiting time for the first occurrence of consecutive k successes in a sequence of m-th order Markov dependent trials is given as a function of the conditional probability generating functions of the waiting time for the first occurrence of consecutive m successes. This provides an efficient algorithm for obtaining the probability generating function when k is large. In particular, in the case of independent trials a simple relationship between the geometric distribution of order k and the geometric distribution of order k−1 is obtained. This research was partially supported by the ISM Cooperative Research Program(2004-ISM-CRP-2006) and by a Grant-in-Aid for Scientific Research (C) of the JSPI (Grant Number 16500183)     

On Generating Functions of Waiting Time Problems for Sequence Patterns of Discrete Random Variables

Let X , X , ... be a sequence of independent and identically distributed random variables, which take values in a countable set S = {0, 1, 2, ...}. By a pattern we mean a finite sequence of elements in S. For every i = 0, 1, 2, ..., we denote by P = "a a ... a " the pattern of some length k , and E denotes the event that the pattern P occurs in the sequence X , X , .... In this paper, we have derived the generalized probability generating functions of the distributions of the waiting times until the r-th occurrence among the events . We also have derived the probability generating functions of the distributions of the number of occurrences of sub-patterns of length l(l < k) until the fiurrence of the pattern of length k in the higher order Markov chain.     

Numbers of Success-Runs of Specified Length Until Certain Stopping Time Rules and Generalized Binomial Distributions of Order k

A new distribution called a generalized binomial distribution of order k is defined and some properties are investigated. A class of enumeration schemes for success-runs of a specified length including non-overlapping and overlapping enumeration schemes is rigorously studied. For each nonnegative integer less than the specified length of the runs, an enumeration scheme called -overlapping way of counting is defined. Let k and be positive integers satisfying < k. Based on independent Bernoulli trials, it is shown that the number of (– 1)-overlapping occurrences of success-run of length k until the n-th overlapping occurrence of success-run of length follows the generalized binomial distribution of order (k–). In particular, the number of non-overlapping occurrences of success-run of length k until the n-th success follows the generalized binomial distribution of order (k– 1). The distribution remains unchanged essentially even if the underlying sequence is changed from the sequence of independent Bernoulli trials to a dependent sequence such as higher order Markov dependent trials. A practical example of the generalized binomial distribution of order k is also given.     

Distributions of Numbers of Success Runs of Fixed Length in Markov Dependent Trials

Let {Z _n , n 1} be a time-homogeneous {0, 1}-valued Markov chain, and let N _n be a random variable denoting the number of runs of "1" of length k in the first n trials. In this article we conduct a systematic study of N _n by establishing formulae for the evaluation of its probability generating function, probability mass function and moments. This is done in three different enumeration schemes for counting runs of length k, the "non-overlapping", the "overlapping" and the "at least" scheme. In the special case of i.i.d. trials several new results are established.     

Default Times in a Continuous Time Markov Chain Economy

Abstract

A continuous time financial market is considered where randomness is modelled by a finite state Markov chain. Using the chain, a stochastic discount factor is defined. The probability distributions of default times are shown to be given by solutions of a system of coupled partial differential equations.     

Joint distributions associated with patterns,successes and failures in a sequence of multi-state trials

Let {Z _t ,t≥1} be a sequence of trials taking values in a given setA={0, 1, 2,...,m}, where we regard the value 0 as failure and the remainingm values as successes. Let ε be a (single or compound) pattern. In this paper, we provide a unified approach for the study of two joint distributions, i.e., the joint distribution of the numberX _n of occurrences of ε, the numbers of successes and failures inn trials and the joint distribution of the waiting timeT _r until ther-th occurrence of ε, the numbers of successes and failures appeared at that time. We also investigate some distributions as by-products of the two joint distributions. Our methodology is based on two types of the random variablesX _n (a Markov chain imbeddable variable of binomial type and a Markov chain imbeddable variable of returnable type). The present work develops several variations of the Markov chain imbedding method and enables us to deal with the variety of applications in different fields. Finally, we discuss several practical examples of our results. This research was partially supported by the ISM Cooperative Research Program (2002-ISM·CRP-2007).     

Waiting time distributions of runs in higher order Markov chains

We consider a {0,1}-valuedm-th order stationary Markov chain. We study the occurrences of runs where two 1’s are separated byat most/exactly/at least k 0’s under the overlapping enumeration scheme wherek≥0 and occurrences of scans (at leastk ₁ successes in a window of length at mostk, 1≤k ₁≤k) under both non-overlapping and overlapping enumeration schemes. We derive the generating function of first two types of runs. Under the conditions, (1) strong tendency towards success and (2) strong tendency towards reversing the state, we establish the convergence of waiting times of ther-th occurrence of runs and scans to Poisson type distributions. We establish the central limit theorem and law of the iterated logarithm for the number of runs and scans up to timen.     

Waiting time problems for a two-dimensional pattern

We consider waiting time problems for a two-dimensional pattern in a sequence of i.i.d. random vectors each of whose entries is 0 or 1. We deal with a two-dimensional pattern with a general shape in the two-dimensional lattice which is generated by the above sequence of random vectors. A general method for obtaining the exact distribution of the waiting time for the first occurrence of the pattern in the sequence is presented. The method is an extension of the method of conditional probability generating functions and it is very suitable for computations with computer algebra systems as well as usual numerical computations. Computational results applied to computation of exact system reliability are also given. Department of Statistical Science, School of Mathematical and Physical Science, The Graduate University for Advanced Studies This research was partially supported by the ISM Cooperative Research Program (2002-ISM-CRP-2007).     

Start-Up Demonstration Tests Under Markov Dependence Model with Corrective Actions

A general probability model for a start-up demonstration test is studied. The joint probability generating function of some random variables appearing in the Markov dependence model of the start-up demonstration test with corrective actions is derived by the method of probability generating function. By using the probability generating function, several characteristics relating to the distribution are obtained.     

Reliability Approximation for Markov Chain Imbeddable Systems

In the present article, a simple method is developed for approximating the reliability of Markov chain imbeddable systems. The approximating formula reduces the problem to the reliability assessment of smaller systems with structure similar to the original systems. Two specific reliability structures which have attracted considerable research interest recently (r-within-consecutive-k-out-of-n system and two dimensional r-within-k₁ × k₂-out-of-n₁ × n₂ system) are studied by the new approach and numerical calculations are carried out, which reveal the high quality of our approximations. Several possible extensions and generalizations are also presented in brief.     

On a waiting time distribution in a sequence of Bernoulli trials

In the present article we investigate the exact distribution of the waiting time for the r-th non-overlapping appearance of a pair of successes separated by at mosk k–2 failures (k2) in a sequence of independent and identically distributed (iid) Bernoulli trials. Formulae are provided for the probability distribution function, probability generating function and moments and some asymptotic results are discussed. Expressions in terms of certain generalised Fibonacci numbers and polynomials are also included.