Filtering of a reflected Brownian motion with respect to its local time

We consider a filtering problem when the state process is a reflected Brownian motion _Xt$X_t$ and the observation process is its local time _Λs${\Lambda }_s$, for s≤t$s\le t$. For this model we derive an approximation scheme based on a suitable interpolation of the observation process _Λt${\Lambda }_t$. The convergence of the approximating filter to the original one combined with an explicit construction of the approximating filter allows us to derive the explicit form of the original filter. The last result can be obtained also by means of the Azéma martingale.     

Time discretization and quantization methods for optimal multiple switching problem

In this paper, we study probabilistic numerical methods based on optimal quantization algorithms for computing the solution to optimal multiple switching problems with regime-dependent state process. We first consider a discrete-time approximation of the optimal switching problem, and analyse its rate of convergence. Given a time step h$h$, the error is in general of order (hlog(1/h))^1/2${(hlog(1/h))}^{1/2}$, and of order h^1/2$h^{1/2}$ when the switching costs do not depend on the state process. We next propose quantization numerical schemes for the space discretization of the discrete-time Euler state process. A Markovian quantization approach relying on the optimal quantization of the normal distribution arising in the Euler scheme is analysed. In the particular case of uncontrolled state process, we describe an alternative marginal quantization method, which extends the recursive algorithm for optimal stopping problems as in Bally (2003) [1]. A priori L^p$L^p$-error estimates are stated in terms of quantization errors. Finally, some numerical tests are performed for an optimal switching problem with two regimes.     

Finite approximation schemes for Lévy processes,and their application to optimal stopping problems

This paper proposes two related approximation schemes, based on a discrete grid on a finite time interval [0,T]$[0,T]$, and having a finite number of states, for a pure jump Lévy process _Lt$L_t$. The sequences of discrete processes converge to the original process, as the time interval becomes finer and the number of states grows larger, in various modes of weak and strong convergence, according to the way they are constructed. An important feature is that the filtrations generated at each stage by the approximations are sub-filtrations of the filtration generated by the continuous time Lévy process. This property is useful for applications of these results, especially to optimal stopping problems, as we illustrate with an application to American option pricing. The rates of convergence of the discrete approximations to the underlying continuous time process are assessed in terms of a “complexity” measure for the option pricing algorithm.     

On optimal stopping of inhomogeneous standard Markov processes

The connection between the optimal stopping problems for inhomogeneous standard Markov process and the corresponding homogeneous Markov process constructed in the extended state space is established. An excessive characterization of the value-function and the limit procedure for its construction in the problem of optimal stopping of an inhomogeneous standard Markov process is given. The form of -optimal (optimal) stopping times is also found.     

Weak convergence of censored and reflected stable processes

It is shown that if a sequence of open n$n$-sets _Dk$D_k$ increases to an open n$n$-set D$D$ then reflected stable processes in _Dk$D_k$ converge weakly to the reflected stable process in D$D$ for every starting point x$x$ in D$D$. The same result holds for censored α$\alpha$-stable processes for every x$x$ in D$D$ if D$D$ and _Dk$D_k$ satisfy the uniform Hardy inequality. Using the method in the proof of the above results, we also prove the weak convergence of reflected Brownian motions in unbounded domains.     

Measurability of semimartingale characteristics with respect to the probability law

Given a càdlàg process X$X$ on a filtered measurable space, we construct a version of its semimartingale characteristics which is measurable with respect to the underlying probability law. More precisely, let _Psem${\mathfrak{P}}_{sem}$ be the set of all probability measures P$P$ under which X$X$ is a semimartingale. We construct processes (B^P,C,ν^P)$(B^P,C,{\nu }^P)$ which are jointly measurable in time, space, and the probability law P$P$, and are versions of the semimartingale characteristics of X$X$ under P$P$ for each P∈_Psem$P\in {\mathfrak{P}}_{sem}$. This result gives a general and unifying answer to measurability questions that arise in the context of quasi-sure analysis and stochastic control under the weak formulation.     

Large deviations of infinite intersections of events in Gaussian processes

Consider events of the form {_Zs≥ζ(s),s∈S}$\{Z_s\ge \zeta \left(s\right),s\in S\}$, where Z$Z$ is a continuous Gaussian process with stationary increments, ζ$\zeta$ is a function that belongs to the reproducing kernel Hilbert space R$R$ of process Z$Z$, and S⊂R$S\subset \mathbb{R}$ is compact. The main problem considered in this paper is identifying the function β^∗∈R${\beta }^{\ast }\in R$ satisfying β^∗(s)≥ζ(s)${\beta }^{\ast }\left(s\right)\ge \zeta \left(s\right)$ on S$S$ and having minimal R$R$-norm. The smoothness (mean square differentiability) of Z$Z$ turns out to have a crucial impact on the structure of the solution. As examples, we obtain the explicit solutions when ζ(s)=s$\zeta \left(s\right)=s$ for s∈[0,1]$s\in [0,1]$ and Z$Z$ is either a fractional Brownian motion or an integrated Ornstein–Uhlenbeck process.     

Regularity properties of viscosity solutions of integro-partial differential equations of Hamilton–Jacobi–Bellman type

We study the regularity properties of integro-partial differential equations of Hamilton–Jacobi–Bellman type with the terminal condition, which can be interpreted through a stochastic control system, composed of a forward and a backward stochastic differential equation, both driven by a Brownian motion and a compensated Poisson random measure. More precisely, we prove that, under appropriate assumptions, the viscosity solution of such equations is jointly Lipschitz and jointly semiconcave in (t,x)∈Δ×R^d$(t,x)\in \Delta \times {\mathbb{R}}^d$, for all compact time intervals Δ$\Delta$ excluding the terminal time. Our approach is based on the time change for the Brownian motion and on Kulik’s transformation for the Poisson random measure.     

Weak Dirichlet processes with a stochastic control perspective

The motivation of this paper is to prove verification theorems for stochastic optimal control of finite dimensional diffusion processes without control in the diffusion term, in the case where the value function is assumed to be continuous in time and once differentiable in the space variable (C^0,1$C^{0,1}$) instead of once differentiable in time and twice in space (C^1,2$C^{1,2}$), like in the classical results. For this purpose, the replacement tool of the Itô formula will be the Fukushima–Dirichlet decomposition for weak Dirichlet processes. Given a fixed filtration, a weak Dirichlet process is the sum of a local martingale M$M$ plus an adapted process A$A$ which is orthogonal, in the sense of covariation, to any continuous local martingale. The decomposition mentioned states that a C^0,1$C^{0,1}$ function of a weak Dirichlet process with finite quadratic variation is again a weak Dirichlet process. That result is established in this paper and it is applied to the strong solution of a Cauchy problem with final condition.     

Parameter estimation and asymptotic stability in stochastic filtering

In this paper, we study the problem of estimating a Markov chain X$X$ (signal) from its noisy partial information Y$Y$, when the transition probability kernel depends on some unknown parameters. Our goal is to compute the conditional distribution process P{_Xn∣_Yn,…,_Y1}$\mathbb{P}\{X_n\mid Y_n,\dots ,Y_1\}$, referred to hereafter as the optimal filter. Following a standard Bayesian technique, we treat the parameters as a non-dynamic component of the Markov chain. As a result, the new Markov chain is not going to be mixing, even if the original one is. We show that, under certain conditions, the optimal filters are still going to be asymptotically stable with respect to the initial conditions. Thus, by computing the optimal filter of the new system, we can estimate the signal adaptively.     

Computable infinite-dimensional filters with applications to discretized diffusion processes

Let us consider a pair signal–observation ((_xn,_yn),n≥0)$((x_n,y_n),n\ge 0)$ where the unobserved signal (_xn)$\left(x_n\right)$ is a Markov chain and the observed component is such that, given the whole sequence (_xn)$\left(x_n\right)$, the random variables (_yn)$\left(y_n\right)$ are independent and the conditional distribution of _yn$y_n$ only depends on the corresponding state variable _xn$x_n$. The main problems raised by these observations are the prediction and filtering of (_xn)$\left(x_n\right)$. We introduce sufficient conditions allowing us to obtain computable filters using mixtures of distributions. The filter system may be finite or infinite-dimensional. The method is applied to the case where the signal _xn=_XnΔ$x_n=X_{n\Delta }$ is a discrete sampling of a one-dimensional diffusion process: Concrete models are proved to fit in our conditions. Moreover, for these models, exact likelihood inference based on the observation (_y0,…,_yn)$(y_0,\dots ,y_n)$ is feasible.     

Backward stochastic differential equations associated to jump Markov processes and applications

In this paper we study backward stochastic differential equations (BSDEs) driven by the compensated random measure associated to a given pure jump Markov process X$X$ on a general state space K$K$. We apply these results to prove well-posedness of a class of nonlinear parabolic differential equations on K$K$, that generalize the Kolmogorov equation of X$X$. Finally we formulate and solve optimal control problems for Markov jump processes, relating the value function and the optimal control law to an appropriate BSDE that also allows to construct probabilistically the unique solution to the Hamilton–Jacobi–Bellman equation and to identify it with the value function.     

Nadler’s type principle with high order of convergence

Recently Proinov [P.D. Proinov, A generalization of the Banach contraction principle with high order of convergence of successive approximations, Nonlinear Analysis (2006), doi:10.1016/j.na.2006.09.008] generalized Banach contraction principle with high order of convergence. We extend some results of Proinov to the case of multi-valued maps from a complete metric space X$X$ into the space of all nonempty proximinal closed subsets of X$X$. Our results not only generalize Nadler’s fixed-point theorem (in the case when T$T$ is a mapping from a complete metric space X$X$ into the space of all nonempty proximinal closed subsets of X$X$) but also gives high order of convergence. As an application, we obtain an existence theorem for first-order initial value problem.     

Tempering stable processes

A tempered stable Lévy process combines both the α$\alpha$-stable and Gaussian trends. In a short time frame it is close to an α$\alpha$-stable process while in a long time frame it approximates a Brownian motion. In this paper we consider a general and robust class of multivariate tempered stable distributions and establish their identifiable parametrization. We prove short and long time behavior of tempered stable Lévy processes and investigate their absolute continuity with respect to the underlying α$\alpha$-stable processes. We find probabilistic representations of tempered stable processes which specifically show how such processes are obtained by cutting (tempering) jumps of stable processes. These representations exhibit α$\alpha$-stable and Gaussian tendencies in tempered stable processes and thus give probabilistic intuition for their study. Such representations can also be used for simulation. We also develop the corresponding representations for Ornstein–Uhlenbeck-type processes.     

Subgeometric rates of convergence of f-ergodic strong Markov processes

We provide a condition in terms of a supermartingale property for a functional of the Markov process, which implies (a) f$f$-ergodicity of strong Markov processes at a subgeometric rate, and (b) a moderate deviation principle for an integral (bounded) functional. An equivalent condition in terms of a drift inequality on the extended generator is also given. Results related to (f,r)$(f,r)$-regularity of the process, of some skeleton chains and of the resolvent chain are also derived. Applications to specific processes are considered, including elliptic stochastic differential equations, Langevin diffusions, hypoelliptic stochastic damping Hamiltonian systems and storage models.     

Fluctuations,effective learnability and metastability in analysis

This paper discusses what kind of quantitative information one can extract under which circumstances from proofs of convergence statements in analysis. We show that from proofs using only a limited amount of the law-of-excluded-middle, one can extract functionals (B,L)$(B,L)$, where L   is a learning procedure for a rate of convergence which succeeds after at most B(a)$B(a)$-many mind changes. This (B,L)$(B,L)$-learnability provides quantitative information strictly in between a full rate of convergence (obtainable in general only from semi-constructive proofs) and a rate of metastability in the sense of Tao (extractable also from classical proofs). In fact, it corresponds to rates of metastability of a particular simple form. Moreover, if a certain gap condition is satisfied, then B and L yield a bound on the number of possible fluctuations. We explain recent applications of proof mining to ergodic theory in terms of these results.