Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction

In this paper, we propose an enhanced computational integral imaging system by both eliminating the occlusion in the elemental images recorded from the partially occluded 3D object and recovering the entire elemental images of the 3D object. In the proposed system, we first obtain the elemental images for partially occluded object using computational integral imaging system and it is transformed to sub-images. Then we eliminate the occlusion within the sub-images by use of an occlusion removal technique. To compensate the removed part from occlusion-removed sub-images, we use a recursive application of PCA reconstruction and error compensation. Finally, we generate the entire elemental images without a loss from the newly reconstructed sub-images and perform the process of object recognition. To show the usefulness of the proposed system, we carry out the computational experiments for face recognition and its results are presented. Our experimental results show that the proposed system might improve the recognition performance dramatically.     

Computational integral imaging reconstruction scheme of far 3D objects by additional use of an imaging lens

In this paper, we propose a novel performance-enhanced computational integral imaging reconstruction (CIIR) scheme by additional use of an imaging lens. In the proposed scheme, elemental images can be obtained by using a simultaneous pickup scheme of far three-dimensional (3D) objects from the lenslet array in both real and virtual image fields. And additional imaging lens produces an image shift effect of 3D objects located far away from the lenslet array and improve the visual quality of reconstructed images in CIIR by overcoming limitation of pickup range in integral imaging. To show the usefulness of the proposed system, some experiments are carried out for real 3D objects and its results are presented.     

Improved depth extraction method of 3D objects using computational integral imaging reconstruction based on multiple windowing techniques

This paper presents an improved depth extraction method of 3D objects using computational integral imaging reconstruction (CIIR) based on the multiple windowing models. The proposed method records 3D objects using the lenslet array; and it reconstructs multiple sets of slice images from multiple CIIR methods based on the different windowing models. A depth map is then extracted by a block matching algorithm among multiple set of slice images. A preliminary experiment is carried out to show the feasibility of the proposed method. Experimental results indicate the proposed method outperforms the previous method with two windowing models.     

Three-dimensional image correlator using fast computational integral imaging reconstruction method based on pixel-to-pixel mapping

In this paper, a three-dimensional (3D) image correlator using a fast computational integral imaging reconstruction (CIIR) method based on a pixel-to-pixel mapping is proposed. In order to implement the fast CIIR method, we replace the magnification process in the conventional CIIR by a pixel-to-pixel mapping. The proposed fast CIIR method reconstructs two sorts of plane images; a plane image whose quality is sufficient, and a dot pattern plane image insufficient to view. This property is very useful to enhance the performance of a CIIR-based image correlator. Thus, we apply the fast CIIR method to a CIIR-based image correlator. To show the feasibility of the proposed method, some preliminary experiments on both pattern correlation and computational cost are carried out, and the results are presented. Our experimental results indicate that the proposed image correlator is superior to the previous method in terms of both correlation performance and complexity.     

Optical display of true 3D objects in depth-priority integral imaging using an active sensor

In this paper, we propose a system combining the pickup process using an active sensor and the display process using depth-priority integral imaging (DPII) system to display true three-dimensional (3D) objects within large depth through real and virtual image fields. The active sensor provides depth map and color images of 3D objects. Using captured depth map and original color images, elemental images are computationally synthesized and displayed optically in DPII system. Proposed system provides scaling of 3D scenes for true 3D object. To show the usefulness of proposed system, we carry out the experiment for true 3D objects of three character patterns and present the experimental results.     

A 3D image encryption technique using computer-generated integral imaging and cellular automata transform

A novel three-dimensional (3D) image encryption approach by using the computer-generated integral imaging and cellular automata transform (CAT) is proposed, in which, the two-dimensional (2D) elemental image array (EIA) digitally recorded by light rays coming from the 3D image is mapped inversely through the virtual pinhole array according to the ray-tracing theory. Next, the encrypted image is generated by using the 2D CAT scrambling transform for the 2D EIA. The reconstructed process is carried out by using the modified computational integral-imaging reconstruction (CIIR) technique; the depth-dependent plane images are reconstructed on the output plane. The reconstructed 3D image quality of the proposed scheme can be greatly improved, because the proposed encryption scheme carries out in a computer which can avoid the light diffraction caused by optical device CIIR, and solves blur problem caused by CIIR by using the pixel-averaging algorithm. Furthermore, the CAT-based encryption algorithm is an error-free encryption method; CAT as an orthogonal transformation offers considerable simplicity in the calculation of the transform coefficient, that is, it can improve the quality of the reconstructed image by reducing energy loss compared with the traditional complicated transform process. To show the effectiveness of the proposed scheme, we perform computational experiments. Experimental results show that the proposed scheme outperforms conventional encryption methods.     

Computational integral imaging reconstruction method of 3D images using pixel-to-pixel mapping and image interpolation

In this paper, we propose a novel computational integral imaging reconstruction (CIIR) method to improve the visual quality of the reconstructed images using a pixel-to-pixel mapping and an interpolation technique. Since an elemental image is magnified inversely through the corresponding pinhole and mapped on the reconstruction output plane based on pinhole-array model in the conventional CIIR method, the visual quality of reconstructed output image (ROI) degrades due to the interference problem between adjacent pixels during the superposition of the magnified elemental images. To avoid this problem, the proposed CIIR method generates dot-pattern ROIs using a pixel-to-pixel mapping and substitutes interpolated values for the empty pixels within the dot-pattern ROIs using an interpolation technique. The interpolated ROIs provides a much improved visual quality compared with the conventional method because of the exact regeneration of pixel positions sampled in the pickup process without interference between pixels. Moreover, it can enable us to reduce a computational cost by eliminating the magnification process used in the conventional CIIR. To confirm the feasibility of the proposed system, some experiments are carried out and the results are presented.     

Three-dimensional recognition of occluded objects by using computational integral imaging

We have proposed a method to recognize partially occluded three-dimensional (3D) objects by using 3D volumetric reconstruction integral imaging (II). An II system captures multiple perspectives of occluded objects by using a microlens array. The reconstruction of the occluded 3D scene and target recognition are done digitally to reduce the effects of the occlusion. To verify system performance, we have implemented an optimum filter for object recognition. Both two-dimensional (2D) images and 3D II volumetric reconstructed images are considered. The correlation results of occluded 3D images for volumetric reconstruction show substantial improvements compared with those for conventional 2D imaging of occluded images.     

Three-dimensional visualization of objects in scattering medium using integral imaging and spectral analysis

This paper presents a three-dimensional visualization method of 3D objects in a scattering medium. The proposed method employs integral imaging and spectral analysis to improve the visual quality of 3D images. The images observed from 3D objects in the scattering medium such as turbid water suffer from image degradation due to scattering. The main reason is that the observed image signal is very weak compared with the scattering signal. Common image enhancement techniques including histogram equalization and contrast enhancement works improperly to overcome the problem. Thus, integral imaging that enables to integrate the weak signals from multiple images was discussed to improve image quality. In this paper, we apply spectral analysis to an integral imaging system such as the computational integral imaging reconstruction. Also, we introduce a signal model with a visibility parameter to analyze the scattering signal. The proposed method based on spectral analysis efficiently estimates the original signal and it is applied to elemental images. The visibility-enhanced elemental images are then used to reconstruct 3D images using a computational integral imaging reconstruction algorithm. To evaluate the proposed method, we perform the optical experiments for 3D objects in turbid water. The experimental results indicate that the proposed method outperforms the existing methods.     

Performance-enhanced recognition of a far and partially occluded 3-D object by use of direct pixel-mapping in computational curving-effective integral imaging

In this paper, we propose a novel approach to enhance the recognition performance of a far and partially occluded three-dimensional (3-D) target in computational curving-effective integral imaging by using the direct pixel-mapping (DPM) method. With this scheme, the elemental image array (EIA) originally picked up from a far and partially occluded 3-D target can be converted into a new EIA just like the one virtually picked up from a target located close to the lenslet array. Due to this characteristic of DPM, resolution and quality of the reconstructed target image can be highly enhanced, which results in a significant improvement of recognition performance of a far 3-D object. In addition, the computational time required for reconstruction of a far 3-D target could be also reduced because the distance between the lenslet array and image plane is virtually shortened in the new EIA transformed by DPM. Experimental results reveal that image quality of the reconstructed target image and object recognition performance of the proposed system have been improved by 1.75 dB and 4.56% on the average in PSNR (peak-to-peak signal-to-noise ratio) and NCC (normalized correlation coefficient), respectively, compared to the conventional system.     

Modified smart pixel mapping method for displaying orthoscopic 3D images in integral imaging

In this paper, we propose a modified smart pixel mapping (MSPM) method for displaying orthoscopic three-dimensional (3D) images with a function of depth control in integral imaging system. In the proposed MSPM, the depth-converted elemental image array (EIA) is obtained through the pixel mapping process and the image interpolation technique. The proposed method gives us the depth conversion at distances different from the position of 3D object and provides various types of EIAs using only an original EIA for orthoscopic images. To show the usefulness of the proposed method, we carry out the preliminary experiments and present the experimental results.     

Orthoscopic integral imaging display by use of the computational method based on lenslet model

In this paper, we propose a computational depth conversion method based on the lenslet model to display the orthoscopic 3D images in 3D integral imaging display. The proposed method permits the synthesis of elemental images for the orthoscopic 3D images at any arbitrary position without any restrictions and requires no additional procedure during the depth conversion process. Due to the lenslet model involved in the depth conversion procedure, the proposed method can broaden the flexibility of 3D image reconstruction in the integral imaging display system. We carry out the preliminary experiments to prove the feasibility of the proposed method. The experimental results reveal that the proposed method is an effective depth conversion method that allows the reconstruction of the orthoscopic 3D images at any arbitrary position.     

Depth-controlled reconstruction of 3D integral image using synthesized intermediate sub-images

In this paper, we propose a method that controls the depth of the three-dimensional (3D) object existing over the depth-of-focus in integral imaging. The depth control method is performed only in a computer by synthesizing the intermediate sub-images between original sub-images obtained by transforming the captured elemental images. In the reconstruction process, we can obtain reconstructed 3D images with the better image quality within depth-of-focus than that reconstructed over the depth-of-focus. To demonstrate the feasibility of our method, optical and computational experiments are carried out and its results are presented.     

Optical 3D watermark based digital image watermarking for telemedicine

Region of interest (ROI) of a medical image is an area including important diagnostic information and must be stored without any distortion. This algorithm for application of watermarking technique for non-ROI of the medical image preserving ROI. The paper presents a 3D watermark based medical image watermarking scheme. In this paper, a 3D watermark object is first decomposed into 2D elemental image array (EIA) by a lenslet array, and then the 2D elemental image array data is embedded into the host image. The watermark extraction process is an inverse process of embedding. The extracted EIA through the computational integral imaging reconstruction (CIIR) technique, the 3D watermark can be reconstructed. Because the EIA is composed of a number of elemental images possesses their own perspectives of a 3D watermark object. Even though the embedded watermark data badly damaged, the 3D virtual watermark can be successfully reconstructed. Furthermore, using CAT with various rule number parameters, it is possible to get many channels for embedding. So our method can recover the weak point having only one transform plane in traditional watermarking methods. The effectiveness of the proposed watermarking scheme is demonstrated with the aid of experimental results.     

High-resolution cardiac imaging using an interleaved 3D double slab technique

A three-dimensional (3D) gradient-echo sequence with interleaved double-slab excitation was developed and optimized for the requirements in pediatric cardiac imaging. For this purpose high contrast between blood and myocardium signal should be obtained without the use of contrast agents. An acceptable measuring time for a large region examined with high spatial resolution should be achieved as well, especially with regard to the small structures of the heart and vessels of infants. The presented approach works with gradient moment nulling and a short echo time of 5.5 ms resulting in generally high signal intensity and only minor signal losses due to turbulent flow. The sequence allows simultaneous ECG-gated recording of two separately excited slabs with small thickness (10 mm) and with a distance of several centimeters between them. Thus, common effects of presaturation in 3D imaging can be avoided, although a relatively short measuring time is achievable. In order to get a 3D data set with good signal homogeneity of blood and of the other structures across a large volume of interest several double-slab measurements with suitable positions must be performed. The latter aspect is especially important for postprocessing techniques as multiple planar reconstruction and maximum intensity projection. Examples of applications of the new technique and appropriately postprocessed images are presented allowing demonstration even of subtle cardiac malformations.     

Development of a portable 3D ultrasound imaging system for musculoskeletal tissues

3D ultrasound is a promising imaging modality for clinical diagnosis and treatment monitoring. Its cost is relatively low in comparison with CT and MRI, no intensive training and radiation protection is required for its operation, and its hardware is movable and can potentially be portable. In this study, we developed a portable freehand 3D ultrasound imaging system for the assessment of musculoskeletal body parts. A portable ultrasound scanner was used to obtain real-time B-mode ultrasound images of musculoskeletal tissues and an electromagnetic spatial sensor was fixed on the ultrasound probe to acquire the position and orientation of the images. The images were digitized with a video digitization device and displayed with its orientation and position synchronized in real-time with the data obtained by the spatial sensor. A program was developed for volume reconstruction, visualization, segmentation and measurement using Visual C++ and Visualization toolkits (VTK) software. A 2D Gaussian filter and a Median filter were implemented to improve the quality of the B-scan images collected by the portable ultrasound scanner. An improved distance-weighted grid-mapping algorithm was proposed for volume reconstruction. Temporal calibrations were conducted to correct the delay between the collections of images and spatial data. Spatial calibrations were performed using a cross-wire phantom. The system accuracy was validated by one cylinder and two cuboid phantoms made of silicone. The average errors for distance measurement in three orthogonal directions in comparison with micrometer measurement were 0.06 ± 0.39, −0.27 ± 0.27, and 0.33 ± 0.39 mm, respectively. The average error for volume measurement was −0.18% ± 5.44% for the three phantoms. The system has been successfully used to obtain the volume images of a fetus phantom, the fingers and forearms of human subjects. For a typical volume with 126 × 103 × 109 voxels, the 3D image could be reconstructed from 258 B-scans (640 × 480 pixels) within one minute using a portable PC with Pentium IV 2.4 GHz CPU and 512 MB memories. It is believed that such a portable volume imaging system will have many applications in the assessment of musculoskeletal tissues because of its easy accessibility.     

光学三维成像实验系统

建立光学投影层析三维成像系统,该系统包括光学成像、图像采集、断层重建及三维显示,重建算法为滤波反投影算法.实验结果表明:利用该系统得到的重建图像与样品的形状吻合,重建结果边缘清晰,伪迹较小.     

机载激光3D探测成像系统的发展现状

机载激光3D探测成像是通过激光主动成像产生目标的角-角-距、角-角-速度3D图像的一种新的探测成像技术.本文重点阐述了机载激光3D探测成像系统的原理、功能和系统的组成.介绍了该系统在军事和民用两大领域的应用,详细地讨论了近几年机载激光3D探测成像技术的国内外发展现状及动态,总结了该项技术的发展方向.认为国外的机载激光3...     

机载激光3D探测成像系统的发展现状

机载激光3D探测成像是通过激光主动成像产生目标的角-角-距、角-角-速度3D图像的一种新的探测成像技术。本文重点阐述了机载激光3D探测成像系统的原理、功能和系统的组成。介绍了该系统在军事和民用两大领域的应用,详细地讨论了近几年机载激光3D探测成像技术的国内外发展现状及动态,总结了该项技术的发展方向。认为国外的机载激光3D探测系统正向远距离、高分辨率、轻量化、低功耗、高实时性和人眼安全方向发展,而目前国内的相关研究仍处于实验室阶段,与国外相比还存在一定差距。文章最后以用户需求为例,从设计的角度对机载激光3D探测成像系统进行了分析,讨论了该系统在测距机制、扫描机构、探测器、数据处理和显示等方面的处理。