Heavy-traffic limits for an infinite-server fork–join queueing system with dependent and disruptive services

We study an infinite-server fork–join queueing system with dependent services, which experiences alternating renewal service disruptions. Jobs are forked into a fixed number of parallel tasks upon arrival and processed at the corresponding parallel service stations with multiple servers. Synchronization of a job occurs when its parallel tasks are completed, i.e., non-exchangeable. Service times of the parallel tasks of each job can be correlated, having a general continuous joint distribution function, and moreover, the service vectors of consecutive jobs form a stationary dependent sequence satisfying the strong mixing (\(\alpha \)-mixing) condition. The system experiences renewal alternating service disruptions with up and down periods. In each up period, the system operates normally, but in each down period, jobs continue to enter the system, while all the servers will stop working, and services received will be conserved and resume at the beginning of the next up period. We study the impact of both the dependence among service times and these down times upon the service dynamics, the unsynchronized queueing dynamics, and the synchronized process, assuming that the down times are asymptotically negligible. We prove FWLLN and FCLT for these processes, where the limit processes in the FCLT possess a stochastic decomposition property and the convergence requires the Skorohod \(M_1\) topology.     

Heavy-traffic limits for many-server queues with service interruptions

We establish many-server heavy-traffic limits for G/M/n+M queueing models, allowing customer abandonment (the +M), subject to exogenous regenerative service interruptions. With unscaled service interruption times, we obtain a FWLLN for the queue-length process, where the limit is an ordinary differential equation in a two-state random environment. With asymptotically negligible service interruptions, we obtain a FCLT for the queue-length process, where the limit is characterized as the pathwise unique solution to a stochastic integral equation with jumps. When the arrivals are renewal and the interruption cycle time is exponential, the limit is a Markov process, being a jump-diffusion process in the QED regime and an O–U process driven by a Levy process in the ED regime (and for infinite-server queues). A stochastic-decomposition property of the steady-state distribution of the limit process in the ED regime (and for infinite-server queues) is obtained.     

Heavy traffic limit for a tandem queue with identical service times

We consider a two-node tandem queueing network in which the upstream queue is M/G/1 and each job reuses its upstream service requirement when moving to the downstream queue. Both servers employ the first-in-first-out policy. We investigate the amount of work in the second queue at certain embedded arrival time points, namely when the upstream queue has just emptied. We focus on the case of infinite-variance service times and obtain a heavy traffic process limit for the embedded Markov chain.     

Ergodicity and analysis of the process describing the system state in polling systems with two queues

Consider a polling system of two queues served by a single server that visits the queues in cyclic order. The polling discipline in each queue is of exhaustive-type, and zero-switchover times are considered. We assume that the arrival times in each queue form a Poisson process and that the service times form sequences of independent and identically distributed random variables, except for the service distribution of the first customer who is served at each polling instant (the time in which the server moves from one queue to the other one). The sufficient and necessary conditions for the ergodicity of such polling system are established as well as the stationary distribution for the continuous-time process describing the state of the system. The proofs rely on the combination of three embedded processes that were previously used in the literature. An important result is that ρ=1 can imply ergodicity in one specific case, where ρ is the typical traffic intensity for polling systems, and ρ<1 is the classical non-saturation condition.     

Multiscale diffusion approximations for stochastic networks in heavy traffic

Stochastic networks with time varying arrival and service rates and routing structure are studied. Time variations are governed by, in addition to the state of the system, two independent finite state Markov processes X and Y. The transition times of X are significantly smaller than typical inter-arrival and processing times whereas the reverse is true for the Markov process Y. By introducing a suitable scaling parameter one can model such a system using a hierarchy of time scales. Diffusion approximations for such multiscale systems are established under a suitable heavy traffic condition. In particular, it is shown that, under certain conditions, properly normalized buffer content processes converge weakly to a reflected diffusion. The drift and diffusion coefficients of this limit model are functions of the state process, the invariant distribution of X, and a finite state Markov process which is independent of the driving Brownian motion.     

Mean Waiting Time Approximations in the G/G/1 Queue

It is known that correlations in an arrival stream offered to a single-server queue profoundly affect mean waiting times as compared to a corresponding renewal stream offered to the same server. Nonetheless, this paper uses appropriately constructed GI/G/1 models to create viable approximations for queues with correlated arrivals. The constructed renewal arrival process, called PMRS (Peakedness Matched Renewal Stream), preserves the peakedness of the original stream and its arrival rate; furthermore, the squared coefficient of variation of the constructed PMRS equals the index of dispersion of the original stream. Accordingly, the GI/G/1 approximation is termed PMRQ (Peakedness Matched Renewal Queue). To test the efficacy of the PMRQ approximation, we employed a simple variant of the TES⁺ process as the autocorrelated arrival stream, and simulated the corresponding TES ⁺/G/1 queue for several service distributions and traffic intensities. Extensive experimentation showed that the proposed PMRQ approximations produced mean waiting times that compared favorably with simulation results of the original systems. Markov-modulated Poisson process (MMPP) is also discussed as a special case.     

On the fluid limit of the M/G/∞ queue

The paper deals with the fluid limits of some generalized M/G/∞ queues under heavy-traffic scaling. The target application is the modeling of Internet traffic at the flow level. Our paper first gives a simplified approach in the case of Poisson arrivals. Expressing the state process as a functional of some Poisson point process, an elementary proof for limit theorems based on martingales techniques and weak convergence results is given. The paper illustrates in the special Poisson arrivals case the classical heavy-traffic limit theorems for the G/G/∞ queue developed earlier by Borovkov and by Iglehart, and later by Krichagina and Puhalskii. In addition, asymptotics for the covariance of the limit Gaussian processes are obtained for some classes of service time distributions, which are useful to derive in practice the key parameters of these distributions.     

On the stability of retrial queues

We consider the following Type of problems. Calls arrive at a queue of capacity K (which is called the primary queue), and attempt to get served by a single server. If upon arrival, the queue is full and the server is busy, the new arriving call moves into an infinite capacity orbit, from which it makes new attempts to reach the primary queue, until it finds it non-full (or it finds the server idle). If the queue is not full upon arrival, then the call (customer) waits in line, and will be served according to the FIFO order. If λ is the arrival rate (average number per time unit) of calls and μ is one over the expected service time in the facility, it is well known that μ > λ is not always sufficient for stability. The aim of this paper is to provide general conditions under which it is a sufficient condition. In particular, (i) we derive conditions for Harris ergodicity and obtain bounds for the rate of convergence to the steady state and large deviations results, in the case that the inter-arrival times, retrial times and service times are independent i.i.d. sequences and the retrial times are exponentially distributed; (ii) we establish conditions for strong coupling convergence to a stationary regime when either service times are general stationary ergodic (no independence assumption), and inter-arrival and retrial times are i.i.d. exponentially distributed; or when inter-arrival times are general stationary ergodic, and service and retrial times are i.i.d. exponentially distributed; (iii) we obtain conditions for the existence of uniform exponential bounds of the queue length process under some rather broad conditions on the retrial process. We finally present conditions for boundedness in distribution for the case of nonpatient (or non persistent) customers. This revised version was published online in June 2006 with corrections to the Cover Date.     

Efficient computational analysis of non-exhaustive service vacation queues: BMAP/R/1/N(∞) under gated-limited discipline

This paper analyzes the finite-buffer single server queue with vacation(s). It is assumed that the arrivals follow a batch Markovian arrival process (BMAP) and the server serves customers according to a non-exhaustive type gated-limited service discipline. It has been also considered that the service and vacation distributions possess rational Laplace-Stieltjes transformation (LST) as these types of distributions may approximate many other distributions appeared in queueing literature. Among several batch acceptance/rejection strategies, the partial batch acceptance strategy is discussed in this paper. The service limit L (1 ≤ L ≤ N) is considered to be fixed, where N is the buffer-capacity excluding the one in service. It is assumed that in each busy period the server continues to serve until either L customers out of those that were waiting at the start of the busy period are served or the queue empties, whichever occurs first. The queue-length distribution at vacation termination/service completion epochs is determined by solving a set of linear simultaneous equations. The successive substitution method is used in the steady-state equations embedded at vacation termination/service completion epochs. The distribution of the queue-length at an arbitrary epoch has been obtained using the supplementary variable technique. The queue-length distributions at pre-arrival and post-departure epoch are also obtained. The results of the corresponding infinite-buffer queueing model have been analyzed briefly and matched with the previous model. Net profit function per unit of time is derived and an optimal service limit and buffer-capacity are obtained from a maximal expected profit. Some numerical results are presented in tabular and graphical forms.     

A markov-modulated M/M/1 queue with group arrivals

We study anM/M/1 group arrival queue in which the arrival rate, service time distributions and the size of each group arrival depend on the state of an underlying finite-state Markov chain. Using Laplace transforms and matrix analysis, we derive the results for the queue length process, its limit distribution and the departure process. In some special cases, explicit results are obtained which are analogous to known classic results.     

Controlling the GI/M/1 queue by conditional acceptance of customers

In this paper we consider the problem of controlling the arrival of customers into a GI/M/1 service station. It is known that when the decisions controlling the system are made only at arrival epochs, the optimal acceptance strategy is of a control-limit type, i.e., an arrival is accepted if and only if fewer than n customers are present in the system. The question is whether exercising conditional acceptance can further increase the expected long run average profit of a firm which operates the system. To reveal the relevance of conditional acceptance we consider an extension of the control-limit rule in which the nth customer is conditionally admitted to the queue. This customer may later be rejected if neither service completion nor arrival has occurred within a given time period since the last arrival epoch. We model the system as a semi-Markov decision process, and develop conditions under which such a policy is preferable to the simple control-limit rule.     

Queues with Workload-Dependent Arrival and Service Rates

We consider two types of queues with workload-dependent arrival rate and service speed. Our study is motivated by queueing scenarios where the arrival rate and/or speed of the server depends on the amount of work present, like production systems and the Internet. First, in the M/G/1 case, we compare the steady-state distribution of the workload (both at arbitrary epochs and at arrival instants) in two models, in which the ratio of arrival rate and service speed is equal. Applying level crossing arguments, we show that the steady-state distributions are proportional. Second, we consider a G/G/1-type queue with workload-dependent interarrival times and service speed. Using a stochastic mean-value approach, several well-known relations for the workload at various epochs in the ordinary G/G/1 queue are generalized.     

Age Process, Workload Process, Sojourn Times, and Waiting Times in a Discrete Time SM[K]/PH[K]/1/FCFS Queue

In this paper, we study a discrete time queueing system with multiple types of customers and a first-come-first-served (FCFS) service discipline. Customers arrive according to a semi-Markov arrival process and the service times of individual customers have PH-distributions. A GI/M/1 type Markov chain for a generalized age process of batches of customers is introduced. The steady state distribution of the GI/M/1 type Markov chain is found explicitly and, consequently, the steady state distributions of the age of the batch in service, the total workload in the system, waiting times, and sojourn times of different batches and different types of customers are obtained. We show that the generalized age process and a generalized total workload process have the same steady state distribution. We prove that the waiting times and sojourn times have PH-distributions and find matrix representations of those PH-distributions. When the arrival process is a Markov arrival process with marked transitions, we construct a QBD process for the age process and the total workload process. The steady state distributions of the waiting times and the sojourn times, both at the batch level and the customer level, are obtained from the steady state distribution of the QBD process. A number of numerical examples are presented to gain insight into the waiting processes of different types of customers.AMS subject classification: 60K25, 60J10This revised version was published online in June 2005 with corrected coverdate     

Two-parameter heavy-traffic limits for infinite-server queues

In order to obtain Markov heavy-traffic approximations for infinite-server queues with general non-exponential service-time distributions and general arrival processes, possibly with time-varying arrival rates, we establish heavy-traffic limits for two-parameter stochastic processes. We consider the random variables Q ^e (t,y) and Q ^r (t,y) representing the number of customers in the system at time t that have elapsed service times less than or equal to time y, or residual service times strictly greater than y. We also consider W ^r (t,y) representing the total amount of work in service time remaining to be done at time t+y for customers in the system at time t. The two-parameter stochastic-process limits in the space D([0,∞),D) of D-valued functions in D draw on, and extend, previous heavy-traffic limits by Glynn and Whitt (Adv. Appl. Probab. 23, 188–209, 1991), where the case of discrete service-time distributions was treated, and Krichagina and Puhalskii (Queueing Syst. 25, 235–280, 1997), where it was shown that the variability of service times is captured by the Kiefer process with second argument set equal to the service-time c.d.f.     

Location-allocation on congested networks

This paper deals with location-allocation decisions in networks under conditions of congestion, i.e. taking into consideration the possible arrival of calls for service while no server is available. The problem is to find simultaneously the optimal districting policy which determines how a region should be partitioned into separate service areas, and the optimal locations of facilities to house the service units. An alternate location and allocation solution improvement procedure is developed to combine an existing location algorithm of a single mobile service unit [3] with an existing districting heuristic for two servers [5]. The 2-server districting heuristic is further extended to treat the general case of m servers, and combined with the location algorithm for a single server it forms a general location-allocation heuristic for n nodes and m servers.     

Class clustering destroys delay differentiation in priority queues

This paper considers a discrete-time priority queueing model with one server and two types (classes) of customers. Class-1 customers have absolute (service) priority over class-2 customers. New customer batches enter the system at the rate of one batch per slot, according to a general independent arrival process, i.e., the batch sizes (total numbers of arrivals) during consecutive time slots are i.i.d. random variables with arbitrary distribution. All customers entering the system during the same time slot (i.e., belonging to the same arrival batch) are of the same type, but customer types may change from slot to slot, i.e., from batch to batch. Specifically, the types of consecutive customer batches are correlated in a Markovian way, i.e., the probability that any batch of customers has type 1 or 2, respectively, depends on the type of the previous customer batch that has entered the system. Such an arrival model allows to vary not only the relative loads of both customer types in the arrival stream, but also the amount of correlation between the types of consecutive arrival batches. The results reveal that the amount of delay differentiation between the two customer classes that can be achieved by the priority mechanism strongly depends on the amount of such interclass correlation (or, class clustering) in the arrival stream. We believe that this phenomenon has been largely overlooked in the priority-scheduling literature.     

Analyzing <Emphasis Type="Italic">M/M/</Emphasis>1 Queues with Perturbations in the Arrival Process

This paper investigates when the M/M/1 model can be used to predict accurately the operating characteristics of queues with arrival processes that are slightly different from the Poisson process assumed in the model. The arrival processes considered here are perturbed Poisson processes. The perturbations are deviations from the exponential distribution of the inter-arrival times or from the assumption of independence between successive inter-arrival times. An estimate is derived for the difference between the expected numbers in perturbed and M/M/1 queueing systems with the same traffic intensity. The results, for example, indicate that the M/M/1 model can predict the performance of the queue when the arrival process is perturbed by inserting a few short inter-arrival times, an occasional batch arrival or small dependencies between successive inter-arrival times. In contrast, the M/M/1 is not a good model when the arrival process is perturbed by inserting a few long inter-arrival times.     

Analysis of the adaptive MMAP[K]/PH[K]/1 queue: A multi-type queue with adaptive arrivals and general impatience

In this paper we introduce the adaptive MMAP[K] arrival process and analyze the adaptive MMAP[K]/PH[K]/1 queue. In such a queueing system, customers of K different types with Markovian inter-arrival times and possibly correlated customer types, are fed to a single server queue that makes use of r thresholds. Service times are phase-type and depend on the type of customer in service. Type k customers are accepted with some probability a_i,k if the current workload is between threshold i − 1 and i. The manner in which the arrival process changes its state after generating a type k customer also depends on whether the customer is accepted or rejected.     

Convergence of a queueing system in heavy traffic with general patience-time distributions

We analyze a sequence of single-server queueing systems with impatient customers in heavy traffic. Our state process is the offered waiting time, and the customer arrival process has a state dependent intensity. Service times and customer patient-times are independent; i.i.d. with general distributions subject to mild constraints. We establish the heavy traffic approximation for the scaled offered waiting time process and obtain a diffusion process as the heavy traffic limit. The drift coefficient of this limiting diffusion is influenced by the sequence of patience-time distributions in a non-linear fashion. We also establish an asymptotic relationship between the scaled version of offered waiting time and queue-length. As a consequence, we obtain the heavy traffic limit of the scaled queue-length. We introduce an infinite-horizon discounted cost functional whose running cost depends on the offered waiting time and server idle time processes. Under mild assumptions, we show that the expected value of this cost functional for the n-th system converges to that of the limiting diffusion process as n tends to infinity.