Partially Observable Markov Decision Processes incorporating epistemic uncertainties

The use of Markov Decision Processes for Inspection Maintenance and Rehabilitation of civil engineering structures relies on the use of several transition matrices related to the stochastic degradation process, maintenance actions and imperfect inspections. Point estimators for these matrices are usually used and they are evaluated using statistical inference methods and/or expert evaluation methods. Thus, considerable epistemic uncertainty often veils the true values of these matrices. Our contribution through this paper is threefold. First, we present a methodology for incorporating epistemic uncertainties in dynamic programming algorithms used to solve finite horizon Markov Decision Processes (which may be partially observable). Second, we propose a methodology based on the use of Dirichlet distributions which answers, in our sense, much of the controversy found in the literature about estimating Markov transition matrices. Third, we show how the complexity resulting from the use of Monte-Carlo simulations for the transition matrices can be greatly overcome in the framework of dynamic programming. The proposed model is applied to concrete bridge under degradation, in order to provide the optimal strategy for inspection and maintenance. The influence of epistemic uncertainties on the optimal solution is underlined through sensitivity analysis regarding the input data.     

2‐Hydroxyazobenzenes to Tailor pH Pulses and Oscillations with Light

This paper evaluates the 2‐hydroxyazobenzene platform for tailoring proton concentration pulses and oscillations with monochromatic light. The easily prepared 2‐hydroxyazobenzenes exhibit large absorptions in the near‐UV range. Photoisomerization was investigated by UV/Vis absorption, ¹H NMR spectroscopy, and steady‐state fluorescence emission. In the whole investigated series, the trans stereoisomer of the 2‐hydroxyazobenzene motif provides the corresponding cis derivative with an action cross section in the 10³ M ^?1 cm^?1 range. At the same time, photoisomerization is accompanied by a significant pK drop of the phenol group. According to the phenyl‐substituent pattern, cis‐to‐trans thermal back‐isomerization can be tuned in the 10 ms–100 s range. Up to 2 units of reversible pH drops or pH oscillations on the 10 s timescale have been obtained by appropriately tailoring single‐wavelength illumination of 2‐hydroxyazobenzene solutions.     

Marine chemical ecology

This review covers the recent marine chemical ecology literature for phytoplankton, macroalgae, sponges and other benthic invertebrates; 249 references are cited.     

Molecule-based photonically switched half and full adder

A single molecule logic gate using electronically excited states and ionization/fragmentation can take advantage of the differences in cross-sections for one and two photon absorption. Fault tolerant optically pumped half adder and full adder are discussed as applications. A full adder requires two separate additions, and the logic concatenation that is required to implement this is physically achieved by an intramolecular transfer along the side chain of 2-phenylethyl-N,N-dimethylamine (PENNA). Solutions of the kinetic equations for the temporal evolution of the concentration of different states in the presence of time-varying laser fields are used to illustrate the high contrast ratios that are potentially possible for such devices.     

Electromotile hearing: acoustic tones mask psychophysical response to high-frequency electrical stimulation of intact guinea pig cochleae

When sinusoidal electric stimulation is applied to the intact cochlea, a frequency-specific acoustic emission can be recorded in the ear canal. Acoustic emissions are produced by basilar membrane motion, and have been used to suggest a corresponding acoustic sensation termed "electromotile hearing." Electromotile hearing has been specifically attributed to electric stimulation of outer hair cells in the intact organ of Corti. To determine the nature of the auditory perception produced by electric stimulation of a cochlea with intact outer hair cells, guinea pigs were tested in a psychophysical task. First, subjects were trained to report detection of sinusoidal acoustic stimuli and dynamic range was assessed using response latency. Subjects were then implanted with a ball electrode placed into scala tympani. Following the surgical implant procedure, subjects were transferred to a task in which acoustic signals were replaced by sinusoidal electric stimulation, and dynamic range was assessed again. Finally, the ability of acoustic pure-tone stimuli to mask the detection of the electric signals was assessed. Based on the masking effects, it is concluded that sinusoidal electric stimulation of the intact cochlea results in perception of a tonal (rather than a broadband or noisy) sound at a frequency of 8 kHz or above.     

Decomposing oriented graphs into transitive tournaments

For an oriented graph G with n vertices, let f(G) denote the minimum number of transitive subtournaments that decompose G. We prove several results on f(G). In particular, if G is a tournament then and there are tournaments for which f(G)>n²/3000. For general G we prove that f(G)?⌊n²/3⌋ and this is tight. Some related parameters are also considered.     

The rainbow connection of a graph is (at most) reciprocal to its minimum degree

An edge‐colored graph Gis rainbow edge‐connected if any two vertices are connected by a path whose edges have distinct colors. The rainbow connection of a connected graph G, denoted by rc(G), is the smallest number of colors that are needed in order to make Grainbow edge‐connected. We prove that if Ghas nvertices and minimum degree δ then rc(G)<20n/δ. This solves open problems from Y. Caro, A. Lev, Y. Roditty, Z. Tuza, and R. Yuster (Electron J Combin 15 (2008), #R57) and S. Chakrborty, E. Fischer, A. Matsliah, and R. Yuster (Hardness and algorithms for rainbow connectivity, Freiburg (2009), pp. 243–254). A vertex‐colored graph Gis rainbow vertex‐connected if any two vertices are connected by a path whose internal vertices have distinct colors. The rainbow vertex‐connection of a connected graph G, denoted by rvc(G), is the smallest number of colors that are needed in order to make Grainbow vertex‐connected. One cannot upper‐bound one of these parameters in terms of the other. Nevertheless, we prove that if Ghas nvertices and minimum degree δ then rvc(G)<11n/δ. We note that the proof in this case is different from the proof for the edge‐colored case, and we cannot deduce one from the other. © 2009 Wiley Periodicals, Inc. J Graph Theory 63: 185–191, 2010     

ChemInform Abstract: The Smallest “Aurophilic Species”.

ChemInform is a weekly Abstracting Service, delivering concise information at a glance that was extracted from about 200 leading journals. To access a ChemInform Abstract of an article which was published elsewhere, please select a “Full Text” option. The original article is trackable via the “References” option.     

Microcavities: tailoring the optical properties of single quantum emitters

We present a general review of different microresonator structures and how they can be used in future device applications in modern analytical methods by tailoring the optical properties of single quantum emitters. The main emphasis is on the tunable λ/2-Fabry–Perot-type microresonator which we used to obtain the results presented in this article. By varying the mirror distance the local mode structure of the electromagnetic field is altered and thus the radiative coupling of fluorescent single quantum emitters embedded inside the resonator to that field is changed, too. As a result a modification of the optical properties of these quantum emitters can be observed. We present experimental as well as theoretical results illustrating this effect. Furthermore, the developed resonator can be used to determine the longitudinal position of embedded emitters with an accuracy of λ/60 by analyzing the excitation patterns of nano-sized fluorescent polymer spheres after excitation with a radially polarized doughnut mode laser beam. Finally, we will apply this resonator to a biological system and demonstrate the modification of Förster resonant energy transfer (FRET) efficiency by inhibiting the excited state energy transfer from the donor to the acceptor chromophore of a single DsRed protein.