Continuous time Markovian decision processes average return criterion

Continuous time Markovian decision models with countable state space are investigated. The existence of an optimal stationary policy is established for the expected average return criterion function. It is shown that the expected average return can be expressed as an expected discounted return of a related Markovian decision process. A policy iteration method is given which converges to an optimal deterministic policy, the policy so obtained is shown optimal over all Markov policies.     

TRIPLET STATE OF METALLOPORPHYCENES: ZnPCl, PdPC2, PtPC2, and NiPC2

We report on a study of the photoexcited triplet state, at low temperatures in ordered liquid crystals, and at room temperatures in the liquid phase, of some new metalloporphycenes: normal zincporphycene, ZnPCl; Pd(II), and Ni(II) complexes of 2,7,12,17-tetra- n -propylporphycene, PdPC2, PtPC2, and NiPC2, respectively. The triplet state at low temperature is obtained by selective laser excitation and its magnetization response is detected by EPR in the 250 ns time scale. From triplet EPR line shapes and triplet spin polarization directions it is concluded that the zinc cation lies above the molecular plane and the palladium cation fits into the porphycene's cavity. Such a proposed structure implies a strong spin-orbit interaction in PdPC2, thus resulting in an out-of-plane active spin state (z-axis), whereas that in ZnPCl, having a smaller spin-orbit interaction, in-plane ( x,y -axes) are the active spin states. Laser photolysis of the metalloporphycenes gives rise to detectable triplets of ZnPCl, PdPC2 and PtPC2 with triplet lifetimes of 26, 5 and 0.2 µs, respectively. The sensitization experiment, using β-acetonaphthone as a sensitizer to produce the triplet, results in detectable transients of only ZnPCl and PdPC2 with much longer triplet lifetimes of 85 and 20 µs, respectively. The short triplet lifetime of PtPC2 (and probably that of NiPC2) do not allow for triplet detection with the present sensitizer. However, the latter two metalloporphycenes quench the triplet lifetime of β-acetonaphthone from 29 to 10µs.