Depth-control method for integral imaging

We present a method for controlling the depth of three-dimensional (3D) images reconstructed by integral photography. Incoherent light is reflected from 3D objects, propagates through a lens array, and is captured as the first elemental images by a capturing device. The second elemental images of the 3D images are generated by numerical processing from the first elemental images in accordance with the desired depth. The optical reconstruction of 3D images at the desired depth by the second elemental images is confirmed experimentally.     

Optical 3D watermark based digital image watermarking for telemedicine

Region of interest (ROI) of a medical image is an area including important diagnostic information and must be stored without any distortion. This algorithm for application of watermarking technique for non-ROI of the medical image preserving ROI. The paper presents a 3D watermark based medical image watermarking scheme. In this paper, a 3D watermark object is first decomposed into 2D elemental image array (EIA) by a lenslet array, and then the 2D elemental image array data is embedded into the host image. The watermark extraction process is an inverse process of embedding. The extracted EIA through the computational integral imaging reconstruction (CIIR) technique, the 3D watermark can be reconstructed. Because the EIA is composed of a number of elemental images possesses their own perspectives of a 3D watermark object. Even though the embedded watermark data badly damaged, the 3D virtual watermark can be successfully reconstructed. Furthermore, using CAT with various rule number parameters, it is possible to get many channels for embedding. So our method can recover the weak point having only one transform plane in traditional watermarking methods. The effectiveness of the proposed watermarking scheme is demonstrated with the aid of experimental results.     

Computational integral imaging reconstruction scheme of far 3D objects by additional use of an imaging lens

In this paper, we propose a novel performance-enhanced computational integral imaging reconstruction (CIIR) scheme by additional use of an imaging lens. In the proposed scheme, elemental images can be obtained by using a simultaneous pickup scheme of far three-dimensional (3D) objects from the lenslet array in both real and virtual image fields. And additional imaging lens produces an image shift effect of 3D objects located far away from the lenslet array and improve the visual quality of reconstructed images in CIIR by overcoming limitation of pickup range in integral imaging. To show the usefulness of the proposed system, some experiments are carried out for real 3D objects and its results are presented.     

Wave optical analysis of integral method for three-dimensional images

We analyze by wave optics an integral method that produces three-dimensional (3D) images. The point light source is given at the pickup stage, and the light wave passing through each elemental lens is obtained at the display stage. The amplitude distributions of the waves from each elemental image are the same around a specific point where a 3D image is formed. Since the light waves approaching the image plane from different elemental lenses are incoherent, the synthesized value is the sum of the squared amplitudes of the waves. Therefore the modulation transfer function of this integral method is given by that of a single elemental lens.     

基于视差信息的三维图像的计算机重构*

为了解决全景成像技术中观察者位于观察区域之外看到的图像会存在失真的问题,提出了一种基于视差信息的计算机重构3D视图技术.利用3D场景中的物体点经过不同微透镜在元素图像中记录的视差信息,根据光学路径分析,对重构视图中的失真部分用其它元素图像中存在的同一物体点的匹配像素进行替代,从而得到无失真的3D视图.该技术能够在更宽的观察区域内产生3D图像.     

利用匹配区域的纹理特征改善重构三维图像的视觉质量

研究了计算机重构三维图像时分辨率低的问题,提出一种改善3D计算机全景重构图像的视觉质量的方法,该方法利用3D空间的物体部分在每个元素图像中形成的匹配区域的纹理特征,从两个相邻的元素图像中的匹配区域提取出多个像素,经过加权计算重构出相应的图像区域.该方法与传统的计算机重构方法相比,提高了图像分辨率,同时也消除了从每个元素图像中提取多个像素直接重构图像时存在的"像素块"效应,改善了重构图像的视觉质量.     

基于视差信息的三维图像的计算机重构

为了解决全景成像技术中观察者位于观察区域之外看到的图像会存在失真的问题,提出了一种基于视差信息的计算机重构3D视图技术.利用3D场景中的物体点经过不同微透镜在元素图像中记录的视差信息,根据光学路径分析,对重构视图中的失真部分用其它元素图像中存在的同一物体点的匹配像素进行替代,从而得到无失真的3D视图.该技术能够在更宽的观察区域内产生3D图像.     

Regeneration of elemental images in integral imaging for occluded objects using a plenoptic camera

In this Letter, we propose an elemental image regeneration method of three-dimensional(3D) integral imaging for occluded objects using a plenoptic camera. In conventional occlusion removal techniques, the information of the occlusion layers may be lost. Thus, elemental images have cracked parts, so the visual quality of the reconstructed 3D image is degraded. However, these cracked parts can be interpolated from adjacent elemental images. Therefore, in this Letter, we try to improve the visual quality of reconstructed 3D images by interpolating and regenerating virtual elemental images with adjacent elemental images after removing the occlusion layers. To prove our proposed method, we carry out optical experiments and calculate performance metrics such as the mean square error(MSE) and the peak signal-to-noise ratio(PSNR).     

Three-dimensional free view reconstruction in axially distributed image sensing

In this Letter, we propose a three-dimensional(3D) free view reconstruction technique in axially distributed image sensing(ADS). In typical integral imaging, free view reconstructed images can be obtained by tilting all elemental images or tilting the reconstruction plane due to large lateral perspectives for 3D objects. In conventional ADS, the reconstructed images at only a front view can be generated since the sensor is moved along with its optical axis so that it has small lateral perspectives for 3D objects. However, the reconstructed 3D images at any viewing point may be obtained because the virtual viewing camera may capture these slightly different perspectives for 3D objects. Therefore, in this Letter, we employ the virtual viewing camera to visualize the 3D images at the arbitrary viewing point. To support our proposed method, we show the experimental results.     

Three-dimensional imaging and visualization of partially occluded objects using axially distributed stereo image sensing

In this Letter, we propose a multiperspective three-dimensional (3D) imaging system using axially distributed stereo image sensing. In this proposed method, the stereo camera is translated along its optical axis and multiple axial elemental image pairs for a 3D scene are collected. The captured elemental images are reconstructed in 3D using a computational reconstruction algorithm based on ray back-projection. The proposed method is applied to partially occluded object visualization. Optical experiments are performed to verify the approach.     

Depth-controlled reconstruction of 3D integral image using synthesized intermediate sub-images

In this paper, we propose a method that controls the depth of the three-dimensional (3D) object existing over the depth-of-focus in integral imaging. The depth control method is performed only in a computer by synthesizing the intermediate sub-images between original sub-images obtained by transforming the captured elemental images. In the reconstruction process, we can obtain reconstructed 3D images with the better image quality within depth-of-focus than that reconstructed over the depth-of-focus. To demonstrate the feasibility of our method, optical and computational experiments are carried out and its results are presented.     

Three-dimensional integral imaging with improved visualization using subpixel optical ray sensing

In this Letter, we propose an improved three-dimensional (3D) image reconstruction method for integral imaging. We use subpixel sensing of the optical rays of the 3D scene projected onto the image sensor. When reconstructing the 3D image, we use a calculated minimum subpixel distance for each sensor pixel instead of the average pixel value of integrated pixels from elemental images. The minimum subpixel distance is defined by measuring the distance between the center of the sensor pixel and the physical position of the imaging lens point spread function onto the sensor, which is projected from each reconstruction point for all elemental images. To show the usefulness of the proposed method, preliminary 3D imaging experiments are presented. Experimental results reveal that the proposed method may improve 3D imaging visualization because of the superior sensing and reconstruction of optical ray direction and intensity information for 3D objects.     

Resolution-enhanced 3D image correlator using computationally reconstructed integral images

In this paper, a novel resolution-enhanced three-dimensional (3D) image correlator using the computationally reconstructed integral images is proposed in order to extract target object’s 3D location data in a scene. Elemental images of the reference and target objects are picked up by lenslet arrays and using these elemental images, reference and target plane images are reconstructed on the output plane by means of a modified computational integral imaging reconstruction technique. Then, through cross-correlations between the reconstructed reference and the target plane images, 3D location data of the target object can be extracted from the correlation outputs. With the purpose of showing the feasibility of the proposed method, some computational and optical experiments on the target objects in space are carried out and the results are presented.     

基于立体像素匹配的图像重构技术研究

为了解决目前全景成像技术中分辨率低的问题,提出了一种新的基于3D场景立体像素光线映射的全景图像计算机重构技术.在全景成像技术中,3D场景的每个立体像素点经全景成像系统的编码系统分别映射在一定区域的多个体元素图像的不同像素点上.在计算机重构全景图像时,根据逆光学路径原理,提出了从立体像素映射到的体元素图像区域中提取对应立体像素的多个2D像素点来重构全景图像,使重构的全景图像最大分辨率可达到传统成像方法图像分辨率的N倍（N为映射区域面积）.提出的立体像素的匹配技术大大提高了重构的计算机全景图像分辨率.     

Three-dimensional polarimetric integral imaging

A three-dimensional (3D) polarimetric image sensing and display technique based on integral imaging is proposed. Three-dimensional polarization distribution of reflected light from a 3D object can be measured as elemental image arrays by a rotating linear polarizer. After the measurement of the polarization of the 3D object, the 3D polarimetric object can be reconstructed optically by displaying the polarization-selected elemental images in spatial light modulators with two quarter-wave plates. Experimental demonstration of 3D polarimetric imaging of a 3D object attached to two orthogonal linear polarizers is presented. To the best of our knowledge, this is the first report on 3D polarimetric sensing imaging and 3D optical reconstruction by integral imaging.     

3D image reconstruction with a controllable overlapping number of elemental images in computational integral imaging

In this Letter, we propose a three-dimensional(3D) image reconstruction method with a controllable overlapping number of elemental images in computational integral imaging. The proposed method can control the overlapping number of pixels coming from the elemental images by using the subpixel distance based on ray optics between a 3D object and an image sensor. The use of a controllable overlapping number enables us to provide an improved 3D image visualization by controlling the inter-pixel interference within the reconstructed pixels.To find the optimal overlapping number, we simulate the pickup and reconstruction processes and utilize the numerical reconstruction results using a peak signal-to-noise ratio(PSNR) metric. To demonstrate the feasibility of our work in optical experiments, we carry out the preliminary experiments and present the results.     

A novel three-dimensional digital watermarking scheme basing on integral imaging

A novel integral imaging-based three-dimensional (3D) digital watermarking scheme is presented. In the proposed method, an elemental image array (EIA) obtained by recording the rays coming from a 3D object through a pinhole array in the integral imaging system is employed as a new 3D watermark. The EIA is composed of a number of small elemental images having their own perspectives of a 3D object, and from this recorded EIA various depth-dependent 3D object images can be reconstructed by using the computational integral imaging reconstruction (CIIR) technique. This 3D property of the EIA watermark can make a robust reconstruction of the watermark image available even though there are some data losses in the embedded watermark by attacks. To show the robustness of the proposed scheme against attacks, some experiments are carried out and the results are discussed.     

A 3D image encryption technique using computer-generated integral imaging and cellular automata transform

A novel three-dimensional (3D) image encryption approach by using the computer-generated integral imaging and cellular automata transform (CAT) is proposed, in which, the two-dimensional (2D) elemental image array (EIA) digitally recorded by light rays coming from the 3D image is mapped inversely through the virtual pinhole array according to the ray-tracing theory. Next, the encrypted image is generated by using the 2D CAT scrambling transform for the 2D EIA. The reconstructed process is carried out by using the modified computational integral-imaging reconstruction (CIIR) technique; the depth-dependent plane images are reconstructed on the output plane. The reconstructed 3D image quality of the proposed scheme can be greatly improved, because the proposed encryption scheme carries out in a computer which can avoid the light diffraction caused by optical device CIIR, and solves blur problem caused by CIIR by using the pixel-averaging algorithm. Furthermore, the CAT-based encryption algorithm is an error-free encryption method; CAT as an orthogonal transformation offers considerable simplicity in the calculation of the transform coefficient, that is, it can improve the quality of the reconstructed image by reducing energy loss compared with the traditional complicated transform process. To show the effectiveness of the proposed scheme, we perform computational experiments. Experimental results show that the proposed scheme outperforms conventional encryption methods.     

双光子激光扫描显微镜中折射率失配引起的图象变形研究

双光子激光扫描显微镜(TPLSM)在观察生理溶液中的生物样品的结构时,水浸物镜是最好的选择.但是TPLSM在进行生物样品的三维结构观察时,需要样品和物镜在Z轴方向上做相对移动,这种移动很容易引起样品在水溶液中飘动.为了防止这种样品的漂移,往往要在水物镜和样品之间加入盖波片.由于盖波片和水及样品间的折射率失配将会导致TPLSM荧光图象的变形,给观察结果带来误差.本文主要利用TPLSM的外源探测器(ex-ternal detection)观察荧光小球的TPLSM的荧光图象,比较插入盖波片前后小球荧光图象的变化情况,研究水浸物镜在插入盖波片后折射率失配引起TPLSM图象的变形程度及共焦小孔对改进图象变形的作用.结果显示盖波片的折射率失配不仅导致TPLSM荧光图象的畸变,同时还导致TPLSM图象的荧光强度和信噪比的下降.进一步的研究表明共焦小孔可以部分改进由于折射率失配引起畸变的TPLSM荧光图象的质量.     

基于传像束的小视场双目结构光三维形貌恢复

提出基于传像束传像和双目结构光相结合的三维测量系统,实现对无法直接成像场景,如爆轰、冲击等环境下的小视场物体三维面形测量.测量时,结构光直接投影到待测物体表面,变形条纹图像首先被成像到传像束前端面,再被传递到传像束后端面,并最终被成像到相机像平面,再由三频相位展开技术计算出对应相位分布后,即可根据双目匹配计算出待测物体...