Optimal static pricing for a service facility with holding costs

We study a service facility modelled as a single-server queueing system with Poisson arrivals and limited or unlimited buffer size. In systems with unlimited buffer size, the service times have general distributions, whereas in finite buffered systems service times are exponentially distributed. Arriving customers enter if there is room in the facility and if they are willing to pay the posted price. The same price is charged to all customers at all times (static pricing). The service provider is charged a holding cost proportional to the time that the customers spend in the system. We demonstrate that there is a unique optimal price that maximizes the long-run average profit per unit time. We also investigate how optimal prices vary as system parameters change. Finally, we consider buffer size as an additional decision variable and show that there is an optimal buffer size level that maximizes profit.     

Expulsion and scheduling control for multiclass queues with heterogeneous servers

We consider an M/M/2 system with nonidentical servers and multiple classes of customers. Each customer class has its own reward rate and holding cost. We may assign priorities so that high priority customers may preempt lower priority customers on the servers. We give two models for which the optimal admission and scheduling policy for maximizing expected discounted profit is determined by a threshold structure on the number of customers of each type in the system. Surprisingly, the optimal thresholds do not depend on the specific numerical values of the reward rates and holding costs, making them relatively easy to determine in practice. Our results also hold when there is a finite buffer and when customers have independent random deadlines for service completion.     

Production planning and pricing policy in a make-to-stock system with uncertain demand subject to machine breakdowns

We consider a make-to-stock system served by an unreliable machine that produces one type of product, which is sold to customers at one of two possible prices depending on the inventory level at the time when a customer arrives (i.e., the decision point). The system manager must determine the production level and selling price at each decision point. We first show that the optimal production and pricing policy is a threshold control, which is characterized by three threshold parameters under both the long-run discounted profit and long-run average profit criteria. We then establish the structural relationships among the three threshold parameters that production is off when inventory is above the threshold, and that the optimal selling price should be low when inventory is above the threshold under the scenario where the machine is down or up. Finally we provide some numerical examples to illustrate the analytical results and gain additional insights.     

Optimal admission control in queues with abandonments

We consider a multi-sever Markovian queueing system with abandonments where admitted customers pay a reward either at the time of arrival or service completion. There is a cost associated with abandonments and a holding cost associated with customers in the system. We prove that the policy that maximizes the long-run average reward is of threshold type and completely characterize the optimal thresholds. We conclude with a comparison of various characteristics of the two variants of the model.     

Economies of scale,competitiveness, and trade patterns within the European community: Clarendon Press,Oxford, 1983, 193 pages, £20.00

We consider two queues in series with input to each queue, which can be controlled by accepting or rejecting arriving customers. The objective is to maximize the discounted or average expected net benefit over a finite or infinite horizon, where net benefit is composed of (random) rewards for entering customers minus holding costs assessed against the customers at each queue. Provided that it costs more to hold a customer at the first queue than at the second, we show that an optimal policy is monotonic in the following senses: Adding a customer to either queue makes it less likely that we will accept a new customer into either queue; moreover moving a customer from the first queue to the second makes it more (less) likely that we will accept a new customer into the first (second) queue. Our model has policy implications for flow control in communication systems, industrial job shops, and traffic-flow systems. We comment on the relation between the control policies implied by our model and those proposed in the communicationa literature.     

Profit maximization in flexible serial queueing networks

We analyze the tradeoff between efficiency and service quality in tandem systems with flexible servers and finite buffers. We reward efficiency by assuming that a revenue is earned each time a job is completed, and penalize poor service quality by incorporating positive holding costs. We study the dynamic assignment of servers to tasks with the objective of maximizing the long-run average profit. For systems of arbitrary size, structured service rates, and linear or nonlinear holding costs, we determine the server assignment policy that maximizes the profit. For systems with two stations, two servers with arbitrary service rates, and linear holding costs, we show that the optimal server assignment policy is of threshold type and determine the value of this threshold as a function of the revenue and holding cost. The threshold can be interpreted as the best possible buffer size, and hence our results prove the equivalence of addressing service quality via a holding cost and via limiting the buffer size. Furthermore, we identify the optimal buffer size when each buffer space comes at a cost. We provide numerical results that suggest that the optimal policy also has a threshold structure for nonlinear holding costs. Finally, for larger systems with arbitrary service rates, we propose effective server assignment heuristics.     

Controlling the GI/M/1 queue by conditional acceptance of customers

In this paper we consider the problem of controlling the arrival of customers into a GI/M/1 service station. It is known that when the decisions controlling the system are made only at arrival epochs, the optimal acceptance strategy is of a control-limit type, i.e., an arrival is accepted if and only if fewer than n customers are present in the system. The question is whether exercising conditional acceptance can further increase the expected long run average profit of a firm which operates the system. To reveal the relevance of conditional acceptance we consider an extension of the control-limit rule in which the nth customer is conditionally admitted to the queue. This customer may later be rejected if neither service completion nor arrival has occurred within a given time period since the last arrival epoch. We model the system as a semi-Markov decision process, and develop conditions under which such a policy is preferable to the simple control-limit rule.     

OPTIMAL CONTROL FOR A TANDEM NETWORK OF QUEUES WITH BLOCKING

1.IntroductionWeconsideratwo-stationtandemqueuewithnointermediatebuffer.Jobsatthefirststationmaybeblockedwhenthefollowingstationisoccupiedbyanotherjob.Thatis,ajobisblockedatstationoneuponservicecompletionifthefollowingstationisbeingoccupiedbyanotherjob.Afixedcostischargedforeveryenteringjob,forexample,thiscostcanbetheinputrawmaterialcostinamanufacturingsystem.Jobsinthesystemaresubjecttoaholdingcost.Arewardiscollectedwhenajobdepartsfromthesystem(i.e.,fromthesecondstation).Theproblemistocontro…     

Scheduling networks of queues: Heavy traffic analysis of a simple open network

We consider a queueing network with two single-server stations and two types of customers. Customers of type A require service only at station 1 and customers of type B require service first at station 1 and then at station 2. Each server has a different general service time distribution, and each customer type has a different general interarrival time distribution. The problem is to find a dynamic sequencing policy at station 1 that minimizes the long-run average expected number of customers in the system.The scheduling problem is approximated by a dynamic control problem involving Brownian motion. A reformulation of this control problem is solved, and the solution is interpreted in terms of the queueing system in order to obtain an effective sequencing policy. Also, a pathwise lower bound (for any sequencing policy) is obtained for the total number of customers in the network. We show via simulation that the relative difference between the performance of the proposed policy and the pathwise lower bound becomes small as the load on the network is increased toward the heavy traffic limit.     

Optimal arrival rate and service rate control of multi-server queues

We consider the problem of optimal control of a multi-server queue with controllable arrival and service rates. This study is motivated by its potential application to the design and control of data centers. The cost structure includes customer holding cost which is a non-decreasing convex function of the number of customers in the system, server operating cost which is a non-decreasing convex function of the chosen service rate, and system operating reward which is a non-decreasing concave function of the chosen arrival rate. We formulate the problem as a continuous-time Markov decision process and derive structural properties of the optimal control policies under both discounted cost and average cost criterions.     

Learning dynamic prices in electronic retail markets with customer segmentation

In this paper, we use reinforcement learning (RL) techniques to determine dynamic prices in an electronic monopolistic retail market. The market that we consider consists of two natural segments of customers, captives and shoppers. Captives are mature, loyal buyers whereas the shoppers are more price sensitive and are attracted by sales promotions and volume discounts. The seller is the learning agent in the system and uses RL to learn from the environment. Under (reasonable) assumptions about the arrival process of customers, inventory replenishment policy, and replenishment lead time distribution, the system becomes a Markov decision process thus enabling the use of a wide spectrum of learning algorithms. In this paper, we use the Q-learning algorithm for RL to arrive at optimal dynamic prices that optimize the seller’s performance metric (either long term discounted profit or long run average profit per unit time). Our model and methodology can also be used to compute optimal reorder quantity and optimal reorder point for the inventory policy followed by the seller and to compute the optimal volume discounts to be offered to the shoppers.     

Customer equilibrium and optimal pricing in an M/G/1 queue with heterogeneous rewards and waiting cost rates

We consider an unobservable M/G/1 queue in which customers are allowed to join or balk upon arrival. The service provider charges the same admission fee to all joining customers. All joining customers receive a reward from completion of service and incur a waiting cost. The reward and waiting cost rate are random, however the customers know their own values upon arrival. We characterize the customer’s equilibrium strategy and the optimal prices associated with profit and social welfare maximization.     

An optimal maintenance policy for a server with decreasing arrival rate

We study an optimal maintenance policy for the server in a queueing system. Customers arrive at the server in a Poisson stream and are served by an exponential server, which is subject to multiple states indicating levels of popularity. The server state transitions are governed by a Markov process. The arrival rate depends on the server state and it decreases as the server loses popularity. By maintenance the server state recovers completely, though the customers in the system are lost at the beginning of maintenance. The customers who arrive during maintenance are also lost. In this paper, two kinds of such systems are considered. The first system receives a unit reward when a customer arrives at the system and pays a unit cost for each lost customer at the start of maintenance. The second system receives a unit reward at departure, and pays nothing for lost customers at the beginning of maintenance. Our objective is to maximize the total expected discounted profit over an infinite time horizon. We use a semi-Markov decision process to formulate the problem and are able to establish some properties for the optimal maintenance policy under certain conditions.     

Dynamic pricing and warranty policies for products with fixed lifetime

We consider a repairable product with known market entry and departure times. A warranty policy is offered with product purchase, under which a customer can have a failed item repaired free of charge in the warranty period. It is assumed that customers are heterogeneous in their risk attitudes toward uncertain repair costs incurred after the warranty expires. The objective is to determine a joint dynamic pricing and warranty policy for the lifetime of the product, which maximizes the manufacturer’s expected profit. In the first part of the analysis, we consider a linearly decreasing price function and a constant warranty length. We first study customers’ purchase patterns under several different pricing strategies by the manufacturer and then discuss the optimal pricing and warranty strategy. In the second part, we assume that the warranty length can be altered once during the product lifetime in developing a joint pricing and warranty policy. Numerical studies show that a dynamic warranty policy can significantly outperform a fixed-length warranty policy.     

Analysis of GI<Superscript><Emphasis Type="Italic">X</Emphasis></Superscript>/<Emphasis Type="Italic">M</Emphasis>(<Emphasis Type="Italic">n</Emphasis>)//<Emphasis Type="Italic">N</Emphasis> systems with stochastic customer acceptance policy

We investigate GI ^X /M(n)//N systems with stochastic customer acceptance policy, function of the customer batch size and the number of customers in the system at its arrival. We address the time-dependent and long-run analysis of the number of customers in the system at prearrivals and postarrivals of batches and seen by customers at their arrival to the system, as well as customer blocking probabilities. These results are then used to derive the continuous-time long-run distribution of the number of customers in the system. Our analysis combines Markov chain embedding with uniformization and uses stochastic ordering as a way to bound the errors of the computed performance measures.      

Comparison of socially optimal and profit maximizing prices in an unobservable queue with heterogeneous waiting costs

We consider a general unobservable queueing model in which customers are allowed to join or balk upon arrival. The service provider charges the same admission fee to all joining customers. All joining customers receive the same reward and incur heterogeneous waiting cost rates. We show that the socially optimal arrival rate is greater than or equal to the profit maximizing arrival rate. Equivalently, the socially optimal admission fee is smaller than or equal to the profit maximizing admission fee.     

Flexible servers in tandem lines with setup costs

We study the dynamic assignment of flexible servers to stations in the presence of setup costs that are incurred when servers move between stations. The goal is to maximize the long-run average profit. We provide a general problem formulation and some structural results, and then concentrate on tandem lines with two stations, two servers, and a finite buffer between the stations. We investigate how the optimal server assignment policy for such systems depends on the magnitude of the setup costs, as well as on the homogeneity of servers and tasks. More specifically, for systems with either homogeneous servers or homogeneous tasks, small buffer sizes, and constant setup cost, we prove the optimality of “multiple threshold” policies (where servers’ movement between stations depends on both the number of jobs in the system and the locations of the servers) and determine the values of the thresholds. For systems with heterogeneous servers and tasks, small buffers, and constant setup cost, we provide results that partially characterize the optimal server assignment policy. Finally, for systems with larger buffer sizes and various service rate and setup cost configurations, we present structural results for the optimal policy and provide numerical results that strongly support the optimality of multiple threshold policies.     

Dynamic inventory system with pricing adjustment for price-comparison shoppers

With numerous price-comparison websites and applications, consumers today are frequently conducting price-comparison shopping. As a result, retailers face an increasing challenge in predicting consumer demand and determining the optimal product price and inventory level accordingly. To address this issue, this paper proposes an inventory model with joint decisions of price and inventory to optimize the retailer's long-run average profit under price-comparison consumer shopping. We first formulate the demand arrival process for a retailer under price-comparison shopping to be affected by not only its own price but also its competitors'. Based on this demand arrival process, we then formulate the retailer's long-run average profit and derive properties of its optimal solution. Our model focuses on capturing the impact of price-comparison consumers on a retailer's optimal price and inventory decisions. In particular, we allow competitors' prices to affect the retailer's demand via two key factors: the manufacturer's suggested price and the variability of the outside lowest price. According to our results, when the suggested price increases, the retailer should lower its price to obtain more price-comparison customers from competitors, whereas when the variability of outside lowest price increases, the retailer should raise its price to increase per unit profit from nonprice-comparison customers.     

Phase-type distribution of customer relationship with Markovian response and marketing expenditure decision on the customer lifetime value

In recent years, more and more companies have adopted relationship marketing (RM). At the core of RM is the development and maintenance of long-term relationships with valuable customers. In RM, the customer lifetime value (CLV) is the discounted profit streams of a customer across the entire customer life cycle. The CLV plays a key role in customer acquisition and retention decisions. In this paper, we present a general mathematical framework for RM, and introduce a Markov chain model which is appropriate in modeling RM because of its flexibility and probabilistic nature. We also develop the life distribution of the customer relationship, which is a phase-type distribution since it is the distribution of the first arrival stopping state. And we obtain the expectation of the CLV, which is an important statistic for good decision-making. Finally, we illustrate how to find the optimal remarketing policy numerically. The framework developed for RM systems in this paper should be seen as a practical approach to RM where one can directly apply the results of phase-type distribution and expectation of CLV to marketing decisions.