Integral color rainbow hologram based on computer image processing

A new method for obtaining color rainbow holograms of 3D scenes using single wavelength laser is proposed and implemented by combining integral photography, computer graphics and rainbow holography. In the method, three integral photography (IP) images whose colors correspond to three primary colors are calculated by simulating integral photography, and exported on the film. By illuminating the IP images with diffused coherent beam from the opposite side, three images of the 3D scene are reproduced and overlapped on a particular image plane by the three linear micro-lens arrays. The linear micro-lens arrays can be regarded as the slits. A color rainbow hologram can be created after a single exposure by interfering the reproduced 3D images and the reference beam. Furthermore, we demonstrate experimentally the new method for a simple case and the results can be generalized in integral photography.     

二维限制MMI耦合器自镜像特性

采用扩展的导模传输分析法,对二维限制多模干涉(MMI)耦合器的自镜像效应进行分析,详细讨论了二维限制多模干涉耦合器的自镜像特性和在两个方向上各自都成完整像的要求,并用三维全矢量非旁轴近似光束传输法进一步验证了分析结果.结果表明,一维限制多模干涉耦合器的自镜像效应在一定条件下,可以拓展到二维限制多模干涉耦合器上.并且在强限制的波导结构中,二维自镜像效应可以看成二个相互垂直、独立的一维自镜像效应的叠加.     

Three-dimensional polarimetric integral imaging

A three-dimensional (3D) polarimetric image sensing and display technique based on integral imaging is proposed. Three-dimensional polarization distribution of reflected light from a 3D object can be measured as elemental image arrays by a rotating linear polarizer. After the measurement of the polarization of the 3D object, the 3D polarimetric object can be reconstructed optically by displaying the polarization-selected elemental images in spatial light modulators with two quarter-wave plates. Experimental demonstration of 3D polarimetric imaging of a 3D object attached to two orthogonal linear polarizers is presented. To the best of our knowledge, this is the first report on 3D polarimetric sensing imaging and 3D optical reconstruction by integral imaging.     

基于视场拼接的全视差三维显示系统

提出了一种新的基于视场拼接的全视差三维显示方法及图像生成方案.系统核心部分由一个微投影机阵列、一个反射光路和一个散射屏组构成,图像生成方案采用基于OpenGL的算法实现.为了验证所提出的基于视场拼接理论的正确性,利用液晶显示器、菲涅耳镜组、定向散射屏和背投式反射光路搭建了实验样机.该装置可以在更紧凑的系统结构下显示包括横向视差和纵向视差在内的三维图像,并且通过图像生成算法的配合实现了动态三维显示效果.     

Optical display of true 3D objects in depth-priority integral imaging using an active sensor

In this paper, we propose a system combining the pickup process using an active sensor and the display process using depth-priority integral imaging (DPII) system to display true three-dimensional (3D) objects within large depth through real and virtual image fields. The active sensor provides depth map and color images of 3D objects. Using captured depth map and original color images, elemental images are computationally synthesized and displayed optically in DPII system. Proposed system provides scaling of 3D scenes for true 3D object. To show the usefulness of proposed system, we carry out the experiment for true 3D objects of three character patterns and present the experimental results.     

基于视场拼接的全视差三维显示系统

提出了一种新的基于视场拼接的全视差三维显示方法及图像生成方案.系统核心部分由一个微投影机阵列、一个反射光路和一个散射屏组构成,图像生成方案采用基于OpenGL的算法实现.为了验证所提出的基于视场拼接理论的正确性,利用液晶显示器、菲涅耳镜组、定向散射屏和背投式反射光路搭建了实验样机.该装置可以在更紧凑的系统结构下显示包括横向视差和纵向视差在内的三维图像,并且通过图像生成算法的配合实现了动态三维显示效果.     

Curvilinear reconstruction of 3D magnetic resonance imaging in patients with partial epilepsy: A pilot study

In an attempt to better delineate the abnormalities associated with focal cortical dysgenesis, we performed curvilinear reformatting of the cortex from 3D magnetic resonance (MR) images. Illustrative patients with partial seizures and conventional orthogonal MRI evaluation show that small regions of cortical thickening suggestive of focal dysplastic lesions may not be recognized. In three such patients the curvilinear reformatting demonstrated two additional focal abnormalities of the cortical gyri and better defined the two focal lesions found on conventional orthogonal MR images. This method promises to a be useful tool in the evaluation of epileptic patients with proven or suspected subtle structural cortical abnormalities, particularly focal neuronal migration disorders where cortical thickening, abnormal gyral pattern, and poor delineation of the gray-white matter transition are the main findings.     

No-Reference Quality Assessment for 3D Synthesized Images Based on Visual-Entropy-Guided Multi-Layer Features Analysis

Multiview video plus depth is one of the mainstream representations of 3D scenes in emerging free viewpoint video, which generates virtual 3D synthesized images through a depth-image-based-rendering (DIBR) technique. However, the inaccuracy of depth maps and imperfect DIBR techniques result in different geometric distortions that seriously deteriorate the users’ visual perception. An effective 3D synthesized image quality assessment (IQA) metric can simulate human visual perception and determine the application feasibility of the synthesized content. In this paper, a no-reference IQA metric based on visual-entropy-guided multi-layer features analysis for 3D synthesized images is proposed. According to the energy entropy, the geometric distortions are divided into two visual attention layers, namely, bottom-up layer and top-down layer. The feature of salient distortion is measured by regional proportion plus transition threshold on a bottom-up layer. In parallel, the key distribution regions of insignificant geometric distortion are extracted by a relative total variation model, and the features of these distortions are measured by the interaction of decentralized attention and concentrated attention on top-down layers. By integrating the features of both bottom-up and top-down layers, a more visually perceptive quality evaluation model is built. Experimental results show that the proposed method is superior to the state-of-the-art in assessing the quality of 3D synthesized images.     

Precomputed compressive sensing for light transport acquisition

In this article, we propose an efficient and accurate compressive-sensing-based method for estimating the light transport characteristics of real-world scenes. Although compressive sensing allows the efficient estimation of a high-dimensional signal with a sparse or near-to-sparse representation from a small number of samples, the computational cost of the compressive sensing in estimating the light transport characteristics is relatively high. Moreover, these methods require a relatively smaller number of images than other techniques although they still need 500–1000 images to estimate an accurate light transport matrix. Precomputed compressive sensing improves the performance of the compressive sensing by providing an appropriate initial state. This improvement is achieved in two steps: 1) pseudo-single-pixel projection by multiline projection and 2) regularized orthogonal matching pursuit (ROMP) with initial signal. With these two steps, we can estimate the light transport characteristics more accurately, much faster, and with a lesser number of images.     

Piecewise spectrally band-pass for compressive coded aperture spectral imaging

Coded aperture snapshot spectral imaging(CASSI) has been discussed in recent years. It has the remarkable advantages of high optical throughput, snapshot imaging, etc. The entire spatial-spectral data-cube can be reconstructed with just a single two-dimensional(2D) compressive sensing measurement. On the other hand, for less spectrally sparse scenes,the insufficiency of sparse sampling and aliasing in spatial-spectral images reduce the accuracy of reconstructed threedimensional(3D) spectral cube. To solve this problem, this paper extends the improved CASSI. A band-pass filter array is mounted on the coded mask, and then the first image plane is divided into some continuous spectral sub-band areas. The entire 3D spectral cube could be captured by the relative movement between the object and the instrument. The principle analysis and imaging simulation are presented. Compared with peak signal-to-noise ratio(PSNR) and the information entropy of the reconstructed images at different numbers of spectral sub-band areas, the reconstructed 3D spectral cube reveals an observable improvement in the reconstruction fidelity, with an increase in the number of the sub-bands and a simultaneous decrease in the number of spectral channels of each sub-band.     

A 3D image encryption technique using computer-generated integral imaging and cellular automata transform

A novel three-dimensional (3D) image encryption approach by using the computer-generated integral imaging and cellular automata transform (CAT) is proposed, in which, the two-dimensional (2D) elemental image array (EIA) digitally recorded by light rays coming from the 3D image is mapped inversely through the virtual pinhole array according to the ray-tracing theory. Next, the encrypted image is generated by using the 2D CAT scrambling transform for the 2D EIA. The reconstructed process is carried out by using the modified computational integral-imaging reconstruction (CIIR) technique; the depth-dependent plane images are reconstructed on the output plane. The reconstructed 3D image quality of the proposed scheme can be greatly improved, because the proposed encryption scheme carries out in a computer which can avoid the light diffraction caused by optical device CIIR, and solves blur problem caused by CIIR by using the pixel-averaging algorithm. Furthermore, the CAT-based encryption algorithm is an error-free encryption method; CAT as an orthogonal transformation offers considerable simplicity in the calculation of the transform coefficient, that is, it can improve the quality of the reconstructed image by reducing energy loss compared with the traditional complicated transform process. To show the effectiveness of the proposed scheme, we perform computational experiments. Experimental results show that the proposed scheme outperforms conventional encryption methods.     

基于岩石重构图像的核磁共振响应模拟

能够反映孔隙介质内部真实复杂结构的CT图像经常被用于模拟研究中并能取得较好的结果. 但是,在很多情况下缺少三维CT图像或者其分辨率受限,此时,更易于获取的二维薄片图像被用于构建三维的孔隙结构图像. 假定孔隙介质各向同性,基于二维图像,使用多点统计方法可以构建岩石的三维孔隙结构. 基于数字图像,采用随机游走方法模拟得到核磁共振响应,然后由模拟得到的回波串反演得到T₂分布. 研究表明,岩石重构图像中的模拟结果与CT图像中的模拟结果有较好的一致性. 基于数字图像的核磁共振响应模拟为分析不同孔隙结构的核磁共振响应提供了便利,同时,模拟结果也为验证孔隙结构的重构效果提供了依据.     

High-speed three-dimensional shape measurements of objects with laser speckles and acousto-optical deflection

Many three-dimensional (3D) shape measurement techniques in stereophotogrammetry with temporal coded structured illumination are limited to static scenes because the time for measurement is too long in comparison to the object speed. The measurement of moving objects result in erroneous reconstructions. This is apparent to reduce measurement time to overcome this limitation, which is often done by increasing the projection rate for illumination while shrinking the amount of images taken for reconstruction. The projection rate limits most applications in its speed because digital light processing (DLP) projectors, which are widely used, bring a limited projection rate along. Our approach, in contrast, does not take a DLP. Instead we use laser speckles as projected patterns which are switched using an acousto-optical deflector. The projection rate is 10× higher than what the fastest stripe projection systems to our knowledge achieve. Hence, we present this uncommon but potential approach for highspeed (≈250 3Dfps= [3D measurements per second]), dense, and accurate 3D measurements of spatially separated objects and show the media that emphasizes the ability of accurate measurements while the objects under testing move.     

Automatic registration of serial sections of mouse lymph node by using Image-Reg

The first step towards the three-dimensional (3D) reconstruction of histological structures from serial sectioned tissue blocks is the proper alignment of microscope image sequences. We have accomplished an automatic rigid registration program, named Image-Reg, to align serial sections from mouse lymph node and Peyer's patch. Our approach is based on the calculation of the pixel-correlation of objects in adjacent images. The registration process is mainly divided into two steps. Once the foreground images have been segmented from the original images, the first step (primary alignment) is performed on the binary images of segmented objects; this process includes rotation by using the moments and translation through the X, Y axes by using the centroid. In the second step, the matching error of two binary images is calculated and the registration results are refined through multi-scale iterations. In order to test the registration performance, Image-Reg has been applied to an image and its transformed (rotated) version and subsequently to an image sequence of three serial sections of mouse lymph node. In addition, to compare our algorithm with other registration methods, three other approaches, viz. manual registration with Reconstruct, semi-automatic landmark registration with Image-Pro Plus and the automatic phase-correlation method with Image-Pro Plus, have also been applied to these three sections. The performance of our program has been also tested on other two-image data sets. These include: (a) two light microscopic images acquired by the automatic microscope (stitched with other software); (b) two images fluorescent images acquired by confocal microscopy (tiled with other software). Our proposed approach provides a fast and accurate linear alignment of serial image sequences for the 3D reconstruction of tissues and organs.     

Simultaneous 3D localization of multiple MR-visible markers in fully reconstructed MR images: proof-of-concept for subsecond position tracking

Purpose

To determine whether a greatly reduced spatial resolution of fully reconstructed projection MR images can be used for the simultaneous 3D localization of multiple MR-visible markers and to assess the feasibility of a subsecond position tracking for clinical purposes.

Materials and Methods

Miniature, inductively coupled RF coils were imaged in three orthogonal planes with a balanced steady-state free precession (SSFP) sequence and automatically localized using a two-dimensional template fitting and a subsequent three-dimensional (3D) matching of the coordinates. Precision, accuracy, speed and robustness of 3D localization were assessed for decreasing in-plane resolutions (0.6–4.7 mm). The feasibility of marker tracking was evaluated at the lowest resolution by following a robotically driven needle on a complex 3D trajectory.

Results

Average 3D precision and accuracy, sensitivity and specificity of localization ranged between 0.1 and 0.4 mm, 0.5 and 1.0 mm, 100% and 95%, and 100% and 96%, respectively. At the lowest resolution, imaging and localization took ≈350 ms and provided an accuracy of ≈1.0 mm. In the tracking experiment, the needle was clearly depicted on the oblique scan planes defined by the markers.

Conclusion

Image-based marker localization at a greatly reduced spatial resolution is considered a feasible approach to monitor reference points or rigid instruments at subsecond update rates.     

惯性约束聚变靶三维成像研究

利用计算机层析技术，采用乘代数重建法，编制出三维图像重建程序ＣＴ３Ｄ，通过五个方位对“星光Ⅱ”装置的惯性约束聚变靶进行Ｘ光成像，重建出靶等离子体的三维图像，获得了较好的结果，表明该技术在惯性约束聚变实验中应用的可能性。     

基于遥感图像及工程参数的全局像移探测算法

相邻两片成像传感器的拼接区能够形成具有相同目标景物的图像, 是提炼像移信息的关键, 具有相同目标景物的图像并非贯穿于每次成像任务全程, 无相同目标景物期间的像移估计问题仍然存在。提出基于遥感图像及工程参数的全局像移探测算法, 试图对包含无相同目标景物期间在内的像移进行全覆盖探测。根据拼接区成像特点, 将成像过程分为无相同目标景物和有相同目标景物两个阶段:在无相同目标景物阶段, 利用工程参数计算像移的低频分量, 建立基于拼接区图像和像移低频分量的目标函数, 衡量像移曲线与低频分量之间的偏离程度; 采用最速下降法搜索偏离度最小值点, 作为无相同目标景物期间像移的最优估计; 推导有相同目标景物期间的像移计算公式, 利用无相同目标景物期间的估计值求解像移。以XX-1号空间光学遥感器为实验对象, 检测到0.133 Hz、7 pixels左右的像移, 可探测的时间范围包含最初226 ms的无相同目标景物阶段, 且显著削弱了盲点处的像移测量偏差。实验结果证明, 提出的算法能够对包含无相同目标景物期间的全局像移进行有效测量。     

Spin-orbit coupling, spin relaxation, and spin diffusion in organic solids

We develop a systematic approach of quantifying spin-orbit coupling (SOC) and a rigorous theory of carrier spin relaxation caused by the SOC in disordered organic solids. The SOC mixes up and down spin in the polaron states and can be characterized by an admixture parameter γ2. This mixing effects spin flips as polarons hop from one molecule to another. The spin relaxation time is τ(sf) = R2/(16γ2 D), and the spin diffusion length is L(s) = R/4|γ|, where R is the mean polaron hopping distance and D the carrier diffusion constant. The SOC in tris-(8-hydroxyquinoline) aluminum (Alq3) is particularly strong due to the orthogonal arrangement of the three ligands. The theory quantitatively explains the temperature-dependent spin diffusion in Alq3 from recent muon measurements.     

3D MRI of non-Gaussian (3)He gas diffusion in the rat lung

In (3)He magnetic resonance images of pulmonary air spaces, the confining architecture of the parenchymal tissue results in a non-Gaussian distribution of signal phase that non-exponentially attenuates image intensity as diffusion weighting is increased. Here, two approaches previously used for the analysis of non-Gaussian effects in the lung are compared and related using diffusion-weighted (3)He MR images of mechanically ventilated rats. One approach is model-based and was presented by Yablonskiy et al., while the other approach utilizes the second order decay contribution that is predicted from the cumulant expansion theorem. Total lung coverage is achieved using a hybrid 3D pulse sequence that combines conventional phase encoding with sparse radial sampling for efficient gas usage. This enables the acquisition of nine 3D images using a total of only approximately 1 L of hyperpolarized (3)He gas. Diffusion weighting ranges from 0 s/cm(2) to 40 s/cm(2). Results show that the non-Gaussian effects of (3)He gas diffusion in healthy rat lungs are directly attributed to the anisotropic geometry of lung microstructure as predicted by the Yablonskiy model, and that quantitative analysis over the entire lung can be reliably repeated in time-course studies of the same animal.     

Complex adaptation-based LDR image rendering for 3D image reconstruction

A low-dynamic tone-compression technique is developed for realistic image rendering that can make three-dimensional (3D) images similar to realistic scenes by overcoming brightness dimming in the 3D display mode. The 3D surround provides varying conditions for image quality, illuminant adaptation, contrast, gamma, color, sharpness, and so on. In general, gain/offset adjustment, gamma compensation, and histogram equalization have performed well in contrast compression; however, as a result of signal saturation and clipping effects, image details are removed and information is lost on bright and dark areas. Thus, an enhanced image mapping technique is proposed based on space-varying image compression. The performance of contrast compression is enhanced with complex adaptation in a 3D viewing surround combining global and local adaptation. Evaluating local image rendering in view of tone and color expression, noise reduction, and edge compensation confirms that the proposed 3D image-mapping model can compensate for the loss of image quality in the 3D mode.