Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

Properties of bounded stochastic processes employed in biophysics

Abstract

Realistic stochastic modeling is increasingly requiring the use of bounded noises. In this work, properties and relationships of commonly employed bounded stochastic processes are investigated within a solid mathematical ground. Four families are object of investigation: the Sine-Wiener (SW), the Doering–Cai–Lin (DCL), the Tsallis–Stariolo–Borland (TSB), and the Kessler–Sørensen (KS) families. We address mathematical questions on existence and uniqueness of the processes defined through Stochastic Differential Equations, which often conceal non-obvious behavior, and we explore the behavior of the solutions near the boundaries of the state space. The expression of the time-dependent probability density of the Sine-Wiener noise is provided in closed form, and a close connection with the Doering–Cai–Lin noise is shown. Further relationships among the different families are explored, pathwise and in distribution. Finally, we illustrate an analogy between the Kessler–Sørensen family and Bessel processes, which allows to relate the respective local times at the boundaries.     

Gravitational wave imprint of new symmetry breaking

It is believed that there are more fundamental gauge symmetries beyond those described by the Standard Model of particle physics. The scales of these new gauge symmetries are usually too high to be reachable by particle colliders. Considering that the phase transition (PT) relating to the spontaneous breaking of new gauge symmetries to the electroweak symmetry might be strongly first order, we propose considering the stochastic gravitational waves (GW) arising from this phase transition as an indirect way of detecting these new fundamental gauge symmetries. As an illustration, we explore the possibility of detecting the stochastic GW generated from the PT of \begin{document}$ {\bf{B}}-{\bf{L}}$\end{document} in the space-based interferometer detectors. Our study demonstrates that the GW energy spectrum is reachable by the LISA, Tianqin, Taiji, BBO, and DECIGO experiments only for the case where the spontaneous breaking of \begin{document}$ {\bf{B}}-{\bf{L}}$\end{document} is triggered by at least two electroweak singlet scalars.     

Integral Kernel Operators on Fock Space – Generalizations and Applications to Quantum Dynamics

A general theory of operators on Boson Fock space is discussed in terms of the white noise distribution theory on Gaussian space (white noise calculus). An integral kernel operator is generalized from two aspects: (i) The use of an operator-valued distribution as an integral kernel leads us to the Fubini type theorem which allows an iterated integration in an integral kernel operator. As an application a white noise approach to quantum stochastic integrals is discussed and a quantum Hitsuda–Skorokhod integral is introduced. (ii) The use of pointwise derivatives of annihilation and creation operators assures the partial integration in an integral kernel operator. In particular, the particle flux density becomes a distribution with values in continuous operators on white noise functions and yields a representation of a Lie algebra of vector fields by means of such operators.     

An M/G/1 Retrial Queueing System with Two-Phase Service and Preemptive Resume

An M/G/1 retrial queueing system with additional phase of service and possible preemptive resume service discipline is considered. For an arbitrarily distributed retrial time distribution, the necessary and sufficient condition for the system stability is obtained, assuming that only the customer at the head of the orbit has priority access to the server. The steady-state distributions of the server state and the number of customers in the orbit are obtained along with other performance measures. The effects of various parameters on the system performance are analysed numerically. A general decomposition law for this retrial queueing system is established.     

随机发展方程适度解的存在唯一性(Ⅱ)

讨论如下Hilbert空间中的半线性随机发展方程的Cauchy问题 dy(t)=[Ay(t) f(t,y(t))]dt G(t,y(t))dw(t) y(O)=V_u的适度解的存在唯一性,在更一般的条件下,得到了该问题的适度解的存在唯一性。     

A stochastic algorithm using one sample point per iteration and diminishing stepsizes

A stochastic algorithm for finding stationary points of real-valued functions defined on a Euclidean space is analyzed. It is based on the Robbins-Monro stochastic approximation procedure. Gradient evaluations are done by means of Monte Carlo simulations. At each iteratex _i , one sample point is drawn from an underlying probability space, based on which the gradient is approximated. The descent direction is against the approximation of the gradient, and the stepsize is 1/i. It is shown that, under broad conditions, w.p.1 if the sequence of iteratesx ₁,x ₂,...generated by the algorithm is bounded, then all of its accumulation points are stationary.     

标的资产价格服从跳-扩散过程的具有随机寿命的未定权益定价

本文在假设被终止或取消的风险与重大信息导致的标的资产价格跳跃的风险为非系统风险的情况下,应用无套利资本资产定价,推导出了标的的资产的价格服从跳-扩散过程具有随机寿命的未定权益满足的偏微分方程,然后应用Feynman-kac公式获得了未定权益的定价公式.     

Finding the response matrix to the external action from a subspace for a discrete linear stochastic dynamical system

For a discrete linear stochastic dynamical system, computation of the response matrix to the external action from a subspace using given observational data is examined. An algorithm is proposed and substantiated that makes it possible to improve the numerical accuracy and to reduce the amount of observational data compared to the general case where an arbitrary external action is allowed. As an illustration, a discrete system arising in the analysis of a linear stochastic dynamical continuous-time system is considered more thoroughly. Some numerical results are presented.