The Euler Scheme for Feller Processes

We consider the Euler scheme for stochastic differential equations with jumps, whose intensity might be infinite and the jump structure may depend on the position. This general type of SDE is explicitly given for Feller processes and a general convergence condition is presented.

In particular, the characteristic functions of the increments of the Euler scheme are calculated in terms of the symbol of the Feller process in a closed form. These increments are increments of Lévy processes and, thus, the Euler scheme can be used for simulation by applying standard techniques from Lévy processes.     

On a Unique Ergodicity of Some Markov Processes

It is proved that the sufficient condition for the uniqueness of an invariant measure for Markov processes with the strong asymptotic Feller property formulated by Hairer and Mattingly (Ann Math 164(3):993–1032, 2006) entails the existence of at most one invariant measure for e-processes as well. Some application to time-homogeneous Markov processes associated with a nonlinear heat equation driven by an impulsive noise is also given.     

Computation of the invariant measure for a Lévy driven SDE: Rate of convergence

We study the rate of convergence of some recursive procedures based on some “exact” or “approximate” Euler schemes which converge to the invariant measure of an ergodic SDE driven by a Lévy process. The main interest of this work is to compare the rates induced by “exact” and “approximate” Euler schemes. In our main result, we show that replacing the small jumps by a Brownian component in the approximate case preserves the rate induced by the exact Euler scheme for a large class of Lévy processes.     

Sufficient conditions for the eventual strong Feller property for degenerate stochastic evolutions

The strong Feller property is an important quality of Markov semigroups which helps for example in establishing uniqueness of invariant measure. Unfortunately degenerate stochastic evolutions, such as stochastic delay equations, do not possess this property. However the eventual strong Feller property is sufficient in establishing uniqueness of invariant probability measure. In this paper we provide operator theoretic conditions under which a stochastic evolution equation with additive noise possesses the eventual strong Feller property. The results are used to establish uniqueness of invariant probability measure for stochastic delay equations and stochastic partial differential equations with delay, with an application in neural networks.     

一维扩散过程的最优停止问题的研究

本文研究了一维扩散过程的最优停止问题,论证了W iener过程和几何布朗运动是F e ller过程,同时给出了一般扩散过程的处理方法.     

Chernoff approximations of Feller semigroups in Riemannian manifolds

Chernoff approximations of Feller semigroups and the associated diffusion processes in Riemannian manifolds are studied. The manifolds are assumed to be of bounded geometry, thus including all compact manifolds and also a wide range of non-compact manifolds. Sufficient conditions are established for a class of second order elliptic operators to generate a Feller semigroup on a (generally non-compact) manifold of bounded geometry. A construction of Chernoff approximations is presented for these Feller semigroups in terms of shift operators. This provides approximations of solutions to initial value problems for parabolic equations with variable coefficients on the manifold. It also yields weak convergence of a sequence of random walks on the manifolds to the diffusion processes associated with the elliptic generator. For parallelizable manifolds this result is applied in particular to the representation of Brownian motion on the manifolds as limits of the corresponding random walks.     

Invariant Measures for Monotone SPDEs with Multiplicative Noise Term

We study diffusion processes corresponding to infinite dimensional semilinear stochastic differential equations with local Lipschitz drift term and an arbitrary Lipschitz diffusion coefficient. We prove tightness and the Feller property of the solution to show existence of an invariant measure. As an application we discuss stochastic reaction diffusion equations.     

A Harnack-type inequality for non-symmetric Markov semigroups

For a strong Feller and irreducible Markov semigroup on a locally compact Polish space, the Harnack-type inequality (1.1) holds if and only if the semigroup has a unique invariant probability measure and is ultracontractive. Moreover, new sufficient conditions for this inequality to hold, as well as upper bound estimates of the underlying constant, are presented for diffusion semigroups on Riemannian manifolds.     

Markov branching processes with killing and resurrection

In this paper, we consider Markov branching processes with killing and resurrection. We first show that the Markov branching process with killing and stable resurrection is just the Feller minimum process which is honest and thus unique. We then further show that this honest Feller minimum process is not only positive recurrent but also strongly ergodic. The generating function of the important stationary distribution is explicitly expressed. For the interest of comparison and completeness, the results of the Markov branching processes with killing and instantaneous resurrection are also briefly stated. A new result regarding strong ergodicity of this difficult case is presented. The birth and death process with killing and resurrection together with another example is also analyzed.     

Markov modulation of a two-sided reflected Brownian motion with application to fluid queues

In this paper, we study a reflected Markov-modulated Brownian motion with a two sided reflection in which the drift, diffusion coefficient and the two boundaries are (jointly) modulated by a finite state space irreducible continuous time Markov chain. The goal is to compute the stationary distribution of this Markov process, which in addition to the complication of having a stochastic boundary can also include jumps at state change epochs of the underlying Markov chain because of the boundary changes. We give the general theory and then specialize to the case where the underlying Markov chain has two states.     

A network of priority queues in heavy traffic: One bottleneck station

In this paper we consider an open queueing network having multiple classes, priorities, and general service time distributions. In the case where there is a single bottleneck station we conjecture that normalized queue length and sojourn time processes converge, in the heavy traffic limit, to one-dimensional reflected Brownian motion, and present expressions for its drift and variance. The conjecture is motivated by known heavy traffic limit theorems for some special cases of the general model, and some conjectured “Heavy Traffic Principles” derived from them. Using the known stationary distribution of one-dimensional reflected Brownian motion, we present expressions for the heavy traffic limit of stationary queue length and sojourn time distributions and moments. For systems with Markov routing we are able to explicitly calculate the limits.     

A Decomposition of Markov Processes via Group Actions

We study a decomposition of a general Markov process in a manifold invariant under a Lie group action into a radial part (transversal to orbits) and an angular part (along an orbit). We show that given a radial path, the conditioned angular part is a nonhomogeneous Lévy process in a homogeneous space, we obtain a representation of such processes and, as a consequence, we extend the well-known skew-product of Euclidean Brownian motion to a general setting.      

On the Existence of Feller Semigroups with Discontinuous Coefficients

This paper is devoted to the functional analytic approach to the problem of the existence of Markov processes in probability theory. More precisely, we construct Feller semigroups with Dirichlet conditions for second-order, uniformly elliptic integro-differential operators with discontinuous coefficients. In other words, we prove that there exists a Feller semigroup corresponding to such a diffusion phenomenon that a Markovian particle moves both by jumps and continuously in the state space until it dies at the time when it reaches the boundary.     

Delay differential equations driven by Lévy processes: Stationarity and Feller properties

We consider a stochastic delay differential equation driven by a general Lévy process. Both the drift and the noise term may depend on the past, but only the drift term is assumed to be linear. We show that the segment process is eventually Feller, but in general not eventually strong Feller on the Skorokhod space. The existence of an invariant measure is shown by proving tightness of the segments using semimartingale characteristics and the Krylov–Bogoliubov method. A counterexample shows that the stationary solution in completely general situations may not be unique, but in more specific cases uniqueness is established.     

Shift ergodicity for stationary Markov processes

In this paper shift ergodicity and related topics are studied for certain stationary processes. We first present a simple proof of the conclusion that every stationary Markov process is a generalized convex combination of stationary ergodic Markov processes. A direct consequence is that a stationary distribution of a Markov process is extremal if and only if the corresponding stationary Markov process is time ergodic and every stationary distribution is a generalized convex combination of such extremal ones. We then consider space ergodicity for spin flip particle systems. We prove space shift ergodicity and mixing for certain extremal invariant measures for a class of spin systems, in which most of the typical models, such as the Voter Models and the Contact Models, are included. As a consequence of these results we see that for such systems, under each of those extremal invariant measures, the space and time means of an observable coincide, an important phenomenon in statistical physics. Our results provide partial answers to certain interesting problems in spin systems.     

On the compactness method in general ergodic impulsive control of markov processes

In this paper the impulsive control of Feller Markov processes on compact state space with long run average cost criterion is studied. Under the assumption of compactness of the resolvent operator the optimal strategies corresponding to general cost for impulses are constructed. Also the case of purely jump Markov processes is considered     

Feller property and exponential ergodicity of diffusion processes with state-dependent switching

In this paper we consider the Feller property and the exponential ergodicity for general diffusion processes with state-dependent switching. We prove their Feller continuity by means of intro- ducing some auxiliary processes and by making use of the Radon-Nikodym derivatives. Furthermore, we also prove their strong Feller continuity and their exponential ergodicity under some reasonable conditions.     

CRITERIA OF STRONG TRANSIENCE FOR OPERATOR-SELF-SIMILAR MARKOV PROCESSES

Yamamuro in [1] defines strong and weak transience of Markov processes; gives a criterion for strong transience of Feller processes; and further, discusses strong and weak transience of Ornstein-Uhlenbeck type processes. In this article, the authors weaken the Feller property of the result in [1] to weak Feller property and discuss the strong transience of operator-self-similar Markov processes.     

Coupling, convergence rates of Markov processes and weak Poincaré inequalities

Some analytic and probabilistic properties of the weak Poincaré inequality are obtained. In particular, for strong Feller Markov processes the existence of this inequality is equivalent to each of the following: (i)the Liouville property (or the irreducibility); (ii) the existence of successful couplings (or shift-couplings); (iii)the convergence of the Markov process in total variation norm; (iv) the triviality of the tail (or the invariant)σ-field; (v) the convergence of the density. Estimates of the convergence rate in total variation norm of Markov processes are obtained using the weak Poincaré inequality.     

On stochastic processes in a multilevel control bulk queueing system

This article analyzes some stochastic processes that arise in a bulk single server queue with continuously operating server, state dependent compound Poisson input flow and general state dependent service process. The authors treat the queueing process as a semi–regenerative process and obtain the invariant probability measure and the transient distribution for the embedded Markov chain. The stationary probability measure for the queueing process with continuous time parameter is found by using semi-regenerative techniques. The authors also study the input and output processes and establish ergodic theorems for some functionals of these processes. The results are obtained in terms of the invariant probability measure for the embedded process and the stationary measure for the queueing process with continuous time parameter