Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction

In this paper, we propose an enhanced computational integral imaging system by both eliminating the occlusion in the elemental images recorded from the partially occluded 3D object and recovering the entire elemental images of the 3D object. In the proposed system, we first obtain the elemental images for partially occluded object using computational integral imaging system and it is transformed to sub-images. Then we eliminate the occlusion within the sub-images by use of an occlusion removal technique. To compensate the removed part from occlusion-removed sub-images, we use a recursive application of PCA reconstruction and error compensation. Finally, we generate the entire elemental images without a loss from the newly reconstructed sub-images and perform the process of object recognition. To show the usefulness of the proposed system, we carry out the computational experiments for face recognition and its results are presented. Our experimental results show that the proposed system might improve the recognition performance dramatically.     

Occlusion removal technique for improved recognition of partially occluded 3D objects in computational integral imaging

In this paper, we propose an occlusion removal technique for improved recognition of 3D objects that are partially occluded in computational integral imaging (CII). In the reconstruction process of a 3D object which is partially occluded by other objects, occlusion degrades the resolution of reconstructed 3D images and thus this affects negatively the recognition of a 3D object in CII. To overcome this problem, we introduce a method to eliminate occluding objects in elemental image array (EIA) and the proposed method is applied to 3D object recognition by use of CII. To our best knowledge, this is the first time to remove occlusion in CII. In our method, we apply the elemental image to sub-image (ES) transform to EIA obtained by a pickup process and those sub-images are employed for occlusion removal. After the transformation, we correlate those sub-images with a reference sub-image to locate occluding objects and then we eliminate the objects. The inverse ES transform provides a modified EIA. Actually, the modified EIA is considered to be an EIA without the object that occludes the object to be reconstructed. This can provide a substantial gain in terms of the image quality of 3D objects and in terms of recognition performance. To verify the usefulness of the proposed technique, some experimental results are carried out and the results are presented.     

Geometric analysis of spatial distortion in projection-type integral imaging

In projection-type integral imaging, positional errors in elemental images and elemental lenses affect three-dimensional (3D) image quality. We analyzed the relationships between the geometric distortion in elemental images caused by a projection lens and the spatial distortion in the reconstructed 3D image. As a result, we clarified that 3D images that were reconstructed far from the lens array were largely affected, and that the reconstructed images were significantly distorted in the depth direction at the corners of the displayed images.     

Depth-control method for integral imaging

We present a method for controlling the depth of three-dimensional (3D) images reconstructed by integral photography. Incoherent light is reflected from 3D objects, propagates through a lens array, and is captured as the first elemental images by a capturing device. The second elemental images of the 3D images are generated by numerical processing from the first elemental images in accordance with the desired depth. The optical reconstruction of 3D images at the desired depth by the second elemental images is confirmed experimentally.     

Improvement of reconstruction in 3D computer-generated holograms using 1D Fourier transform operations

Improvement of images reconstructed from 3D computer-generated holograms using 1D Fourier transform operations is presented. Required computing time for making 3D holograms is decreased when 1D Fourier transform method is used instead of 2D Fourier transform method, but reconstructed images from the holograms created by the 1D Fourier transform method are somewhat inferior in quality to the images by 2D Fourier transform method. In this paper, we propose a method that the disadvantageous properties of the holograms made by 1D Fourier transform are improved. We have performed two step improvements in this experiment. From the numerical experiments, the images that are reconstructed from the holograms created from 1D Fourier transform method show marked improvement.     

Analysis of the features and reconstruction of a high resolution infrared image based on a multi-aperture imaging system

Infrared images of good quality are strictly important for such applications as targets detection, tracking and identifying. Traditional single aperture infrared imaging system brings in some defects for its imaging scheme. Multi-aperture imaging system shows promising characteristic of improving image quality and reducing size of optical instruments. We reconstruct a high resolution infrared image from the low resolution sub-images collected by the compact multi-aperture imaging system. A novel reconstruction method called pixels closely arrange (PCA) is proposed based on analyzing the compound eye imaging process, and this method is verified in a simulated 3D infrared scene to capture sub-images. An evaluation of the reconstructed image quality is presented to discuss the significant factors that affect the final result. Experimental results show that the PCA method can be efficiently applied to the multi-aperture infrared imaging system as long as the structure of the micro-lens array is specifically designed to be adaptive to the infrared focal plane array (IFPA).     

High-accuracy three-dimensional position measurement of tens of micrometers size transparent microspheres using digital in-line holographic microscopy

Digital in-line holographic microscopy has a strong potential in measuring various three-dimensional (3D) microscale flow phenomena. However, the axial elongation problem in reconstructing particles severely degrades the measurement accuracy along the light propagation direction. In this Letter, we utilize the lenslike characteristic of tens of micrometers size transparent spherical particles to extract their 3D position. A sharp intensity peak is observed in the reconstructed wave field, resulting from the light-focusing effect of the particle. As a result, the depth-of-focus constraint caused by the particle size is eliminated and the measurement accuracy is drastically improved up to submicrometer resolution.     

Enhanced compression of integral images by combined use of residual images and MPEG-4 algorithm in three-dimensional integral imaging

In this paper, we proposed a novel approach to enhance the compression rate of integral images by combined use of the residual images generated from the sub-images and the MPEG-4 algorithm. In the proposed method, elemental images picked up from a three-dimensional object are transformed into sub-images, and these sub-images are sequentially rearranged with a spiral scanning topology and the first sub-image is assigned as the reference image. Then, by sequentially computing the differences between the reference image and other consecutive sub-images, a sequence of residual images is generated. Here, the residual images together with the reference image are modeled as the consecutive video frames just like a conventional moving picture. Finally, these residual images are compressed with the MPEG-4 algorithm. Experimental results show that compression efficiency of the proposed method has been improved up to 61.56% as compared to those of the JPEG-based compression scheme and up to 151.54% as compared to those of the conventional method averagely.     

Three-dimensional free view reconstruction in axially distributed image sensing

In this Letter, we propose a three-dimensional(3D) free view reconstruction technique in axially distributed image sensing(ADS). In typical integral imaging, free view reconstructed images can be obtained by tilting all elemental images or tilting the reconstruction plane due to large lateral perspectives for 3D objects. In conventional ADS, the reconstructed images at only a front view can be generated since the sensor is moved along with its optical axis so that it has small lateral perspectives for 3D objects. However, the reconstructed 3D images at any viewing point may be obtained because the virtual viewing camera may capture these slightly different perspectives for 3D objects. Therefore, in this Letter, we employ the virtual viewing camera to visualize the 3D images at the arbitrary viewing point. To support our proposed method, we show the experimental results.     

Efficient compression of motion-compensated sub-images with Karhunen-Loeve transform in three-dimensional integral imaging

An approach to highly enhance the compression efficiency of the integral images by applying the Karhunen-Loeve transform (KLT) algorithm to the motion-compensated sub-images is proposed. The sub-images transformed from the elemental images picked-up from the three-dimensional (3D) object might represent the different perspectives of the object. Thus, the similarity among the sub-images gets better than that among the elemental images, so that an improvement of compression efficiency of the sub-images could be obtained. However, motion vectors occurred among the sub-images might result in an additional increase of image data to be compressed. Accordingly, in this paper, motion vectors have been estimated and compensated in all sub-image in advance. Then the KLT algorithm was applied to these motion-compensated sub-images for compression. It is shown from some experimental results that compression efficiency of the proposed method has been improved up to 24.44%, 40.62%, respectively, on the average compared to that of the conventional KLT compression method and that of the JPEG.     

Off-axis phase-only holograms of 3D objects using accelerated point-based Fresnel diffraction algorithm

A method for calculating off-axis phase-only holograms of three-dimensional (3D) object using accelerated point-based Fresnel diffraction algorithm (PB-FDA) is proposed. The complex amplitude of the object points on the z-axis in hologram plane is calculated using Fresnel diffraction formula, called principal complex amplitudes (PCAs). The complex amplitudes of those off-axis object points of the same depth can be obtained by 2D shifting of PCAs. In order to improve the calculating speed of the PB-FDA, the convolution operation based on fast Fourier transform (FFT) is used to calculate the holograms rather than using the point-by-point spatial 2D shifting of the PCAs. The shortest recording distance of the PB-FDA is analyzed in order to remove the influence of multiple-order images in reconstructed images. The optimal recording distance of the PB-FDA is also analyzed to improve the quality of reconstructed images. Numerical reconstructions and optical reconstructions with a phase-only spatial light modulator (SLM) show that holographic 3D display is feasible with the proposed algorithm. The proposed PB-FDA can also avoid the influence of the zero-order image introduced by SLM in optical reconstructed images.     

Investigation of resolution of the stereoscopic 3D images

Evaluation of 3D images is an important part of 3D display developments. In this paper, we propose an evaluation method which can reflect the characteristics of the stereoscopic 3D images in the depth direction. Perception of the depth planes is verified using a subjective evaluation method. Resolution of the stereoscopic 3D images which represents the distribution of the 3D images in the depth direction quantitatively is calculated and analyzed.     

Fresnel hologram reconstruction of complex three-dimensional object based on compressive sensing

Reconstruction the computer generated Fresnel hologram of complex 3D object based on compressive sensing （CS） is presented. The hologram is synthesized from a color image and the depth map of the 3D object. With the depth map, the intensity of the color image can be divided into multiple slices, which satisfy the condition of the sparsity of CS. Thus, the hologram can be reconstructed at different distances with corresponding scene focused using the CS method. The quality of the recovered images can be greatly improved compared with that from the back-propagation method. What＇s more, with the sub-sampled hologram, the image can be ideally reconstructed by the CS method, which can reduce the data-rate for transmission or storage.     

Orthoscopic integral imaging display by use of the computational method based on lenslet model

In this paper, we propose a computational depth conversion method based on the lenslet model to display the orthoscopic 3D images in 3D integral imaging display. The proposed method permits the synthesis of elemental images for the orthoscopic 3D images at any arbitrary position without any restrictions and requires no additional procedure during the depth conversion process. Due to the lenslet model involved in the depth conversion procedure, the proposed method can broaden the flexibility of 3D image reconstruction in the integral imaging display system. We carry out the preliminary experiments to prove the feasibility of the proposed method. The experimental results reveal that the proposed method is an effective depth conversion method that allows the reconstruction of the orthoscopic 3D images at any arbitrary position.     

宽场光学相干断层成像系统的三维显微成像

宽场相干断层成像技术（WFOCT）具有提高OCT系统的扫描速率和实现高分辨率的三维显微技术等优点,成为当前研究的热点。本文阐述了WFOCT的基本原理,利用八步移相法重建出玻璃物体微细结构的断层图像,研究了宽场OCT系统对玻璃材料的纵向分辨率和探测深度,其中探测深度可达3.3 mm。在获得多幅断层图像的基础上,利用VC6.0和OpenGL混合编程,采用移动立方体（MC）算法重建出玻璃物体微细结构的三维图像。实验结果表明,WFOCT系统不但能够在生物组织检测等医学方面得到应用,而且对反射率较高的物体能够完成三维形貌显微成像探测和深度探测。     

Improvement of 1D off-axis computer-generated holograms

Creation of Fresnel off-axis computer-generated holograms and improvement of images reconstructed from the holograms are described. To improve the reconstructed images, we have created the holograms with high construct diffraction patterns by using a histogram method. From reconstruction experiments of the holograms, clear images have been obtained and 3D images have been seen directly with eyes.     

基于岩石重构图像的核磁共振响应模拟

能够反映孔隙介质内部真实复杂结构的CT图像经常被用于模拟研究中并能取得较好的结果. 但是,在很多情况下缺少三维CT图像或者其分辨率受限,此时,更易于获取的二维薄片图像被用于构建三维的孔隙结构图像. 假定孔隙介质各向同性,基于二维图像,使用多点统计方法可以构建岩石的三维孔隙结构. 基于数字图像,采用随机游走方法模拟得到核磁共振响应,然后由模拟得到的回波串反演得到T₂分布. 研究表明,岩石重构图像中的模拟结果与CT图像中的模拟结果有较好的一致性. 基于数字图像的核磁共振响应模拟为分析不同孔隙结构的核磁共振响应提供了便利,同时,模拟结果也为验证孔隙结构的重构效果提供了依据.     

Resolution-enhanced 3D image correlator using computationally reconstructed integral images

In this paper, a novel resolution-enhanced three-dimensional (3D) image correlator using the computationally reconstructed integral images is proposed in order to extract target object’s 3D location data in a scene. Elemental images of the reference and target objects are picked up by lenslet arrays and using these elemental images, reference and target plane images are reconstructed on the output plane by means of a modified computational integral imaging reconstruction technique. Then, through cross-correlations between the reconstructed reference and the target plane images, 3D location data of the target object can be extracted from the correlation outputs. With the purpose of showing the feasibility of the proposed method, some computational and optical experiments on the target objects in space are carried out and the results are presented.     

基于主分量分析法的小波域三维目标序列图像隐藏技术

针对在一幅载体图像中隐藏三维目标序列图像的问题,本文利用主分量分析法获取三维目标的本征图像,将本征图像的小波域系数嵌入到载体图像的小波域系数中,利用分解系数和提取得到的本征图像重构出三维目标的系列图像.本文所提出的方法不是直接存储目标图像,而是存储能够反映三维目标特征的一组本征图像.研究结果表明,该方法有效地将三维目标的特征隐藏在了载体图像中,隐藏信息量大. 关键词： 信息隐藏 三维目标 主分量分析 小波变换     

波前编码显微物镜景深扩展的研究

为了解决传统显微物镜景深与分辨率的矛盾,采用波前编码的方法,设计研究了波前编码的10倍显微物镜,结合传统光学设计软件,采用基于MTF一致性的相位板参数的优化方法,实现了在像面附近一定范围内系统的点扩散函数一致性;此外,还设计了扩展三次相位编码板的10倍显微物镜,比较了采用两种不同相位板系统的焦深扩展的效果,结果显示三次相位板的焦深扩展效果较好,可以将传统10倍显微物镜的焦深扩展15倍。成像模拟仿真结果显示滤波后的编码像在±15倍焦深范围内成像清晰,从而扩大了系统的景深。