利用匹配区域的纹理特征改善重构三维图像的视觉质量

研究了计算机重构三维图像时分辨率低的问题,提出一种改善3D计算机全景重构图像的视觉质量的方法,该方法利用3D空间的物体部分在每个元素图像中形成的匹配区域的纹理特征,从两个相邻的元素图像中的匹配区域提取出多个像素,经过加权计算重构出相应的图像区域.该方法与传统的计算机重构方法相比,提高了图像分辨率,同时也消除了从每个元素图像中提取多个像素直接重构图像时存在的"像素块"效应,改善了重构图像的视觉质量.     

基于视差信息的三维图像的计算机重构*

为了解决全景成像技术中观察者位于观察区域之外看到的图像会存在失真的问题,提出了一种基于视差信息的计算机重构3D视图技术.利用3D场景中的物体点经过不同微透镜在元素图像中记录的视差信息,根据光学路径分析,对重构视图中的失真部分用其它元素图像中存在的同一物体点的匹配像素进行替代,从而得到无失真的3D视图.该技术能够在更宽的观察区域内产生3D图像.     

基于视差信息的三维图像的计算机重构

为了解决全景成像技术中观察者位于观察区域之外看到的图像会存在失真的问题,提出了一种基于视差信息的计算机重构3D视图技术.利用3D场景中的物体点经过不同微透镜在元素图像中记录的视差信息,根据光学路径分析,对重构视图中的失真部分用其它元素图像中存在的同一物体点的匹配像素进行替代,从而得到无失真的3D视图.该技术能够在更宽的观察区域内产生3D图像.     

圆柱物体内壁的锥面折反射全景图像展开

针对锥面折反射的全景成像系统采集的圆柱内壁全景图像存在畸变的问题,提出锥面双向投影模型下的圆柱内壁全景图像展开方法。建立含有畸变参数的正向和逆向投影模型,先将圆柱内壁全景图像的像素点逆向映射到展开图像,再将展开图像中缺失的像素点正向映射到原全景图像,通过全景图像和展开图像对应像素点的坐标映射关系,实现圆柱内壁全景图像的展开。实验结果表明:该方法较好地校正了圆柱内壁全景图像的切向和径向畸变,锥面双向投影模型定位精度为亚像素级,相比同心圆环近似展开法,信息熵和平均梯度均有不同程度的提高,能够有效应用于圆柱物体内壁全景图像的展开。     

基于元素图像阵列采样的集成成像重构方法

高质量的集成成像系统需要采集和存储大量图像数据。提出了一种新的计算机重构方法,可以减少集成成像系统显示端在计算机重构时所需要使用的数据量。传统的计算机重构方法要利用每个元素图像,而此方法对CCD相机采集的元素图像阵列进行周期采样,仅利用被采样的元素图像即可重构出多视点图像。这种方法充分利用集成成像中邻近的元素图像中具有匹配像素的特点,将未被采样的元素图像信息由邻近的被采样的元素图像中的匹配像素替代,从而减少了重构过程中使用的数据量,这给不同性能的集成成像显示端带来很大的灵活性,降低了对存储空间和传输带宽的要求。     

基于OLED微显示器和变形目镜的全景显示技术

全景成像在特种车辆内夜间驾驶与观察、警戒监视等应用中具有广泛的应用需求。本文提出了一种基于OLED微显示器和变形目镜的全景图像显示方法,并设计了一套全景显示实验系统,通过图像处理模块完成全景图像数据的存储、缓存、图像预处理和传输,以OLED微显示器的子像素作为显示像素进行驱动信号重编码,实现全景灰度图像的水平3倍压缩显示,最后利用变形目镜将OLED微显示器上显示的压缩图像复原,以供人眼正常观察。实验结果表明:采用现有系统搭建的变形目镜基本实现了双像素靶标条纹的亚像素分辨,并验证了本文全景显示方案的可行性。     

基于全景环带立体成像系统的深度信息估计

提出了一种基于全景环形透镜(PAL)的全景环带立体成像系统的立体信息提取方法。该成像系统由两组共轴PAL单元构成,其成像圆为两内外相接的圆环,能够实时提取360°水平视场角物体的立体信息。基于该系统的成像原理,针对非单视点成像系统特点建立相机模型对系统进行标定,并验证了标定结果。将尺度不变特征变换(SIFT)算法应用到对应点匹配上,充分利用本系统的共线约束来提高匹配的速度和准确度。应用三角测量原理从捕获的图像中提取有效深度信息。进行立体信息提取实验,给出了结果和误差分析。该系统能有效获取场景深度信息,3m距离范围误差率在±5.2%内,证明了该系统的可行性。     

双曲面折反射全景成像系统

给出了双曲面折反射全景成像系统的设计方法，推导了系统的逆投影计算公式，建立了虚拟像面内透视全景图像与实际像平面内全景图像的坐标映射关系，为全景视频图像的处理提供了必要的模型和计算方法。提出了全景成像系统设计方法，研制出双曲面反射镜，建立了双曲面折反射全景成像系统。     

基于仿视网膜成像器件的折反射全景系统设计

针对传统折反射全景成像系统的图像必须依赖展开技术的问题,提出一种基于仿视网膜成像器件的折反射全景系统设计。利用国内首款仿视网膜CMOS探测器各环上像元与周向、径向空间瞬时视场的对应关系,推导了双曲面反射镜的镜面参数,构建了基于BIT Retina52探测器的全景成像系统。系统实现了无需坐标变换的全景图像直接输出,较之传统折反射成像系统,改善了空间角分辨率变尺度分布问题。     

水平场景无畸变的折反射全景成像系统

基于透视成像模型，建立了一套较完整的水平场景无畸变的折反射全景成像系统设计方法，分析了该系统的近似透视成像性质；设计制作了特殊面形反射镜，建立了水平场景无畸变的折反射全景成像系统，给出了实验图像，并与双曲面折反射全景成像系统的实景图像和透视全景图像进行了比较。     

Computational integral imaging reconstruction method of 3D images using pixel-to-pixel mapping and image interpolation

In this paper, we propose a novel computational integral imaging reconstruction (CIIR) method to improve the visual quality of the reconstructed images using a pixel-to-pixel mapping and an interpolation technique. Since an elemental image is magnified inversely through the corresponding pinhole and mapped on the reconstruction output plane based on pinhole-array model in the conventional CIIR method, the visual quality of reconstructed output image (ROI) degrades due to the interference problem between adjacent pixels during the superposition of the magnified elemental images. To avoid this problem, the proposed CIIR method generates dot-pattern ROIs using a pixel-to-pixel mapping and substitutes interpolated values for the empty pixels within the dot-pattern ROIs using an interpolation technique. The interpolated ROIs provides a much improved visual quality compared with the conventional method because of the exact regeneration of pixel positions sampled in the pickup process without interference between pixels. Moreover, it can enable us to reduce a computational cost by eliminating the magnification process used in the conventional CIIR. To confirm the feasibility of the proposed system, some experiments are carried out and the results are presented.     

Three-dimensional image correlator using fast computational integral imaging reconstruction method based on pixel-to-pixel mapping

In this paper, a three-dimensional (3D) image correlator using a fast computational integral imaging reconstruction (CIIR) method based on a pixel-to-pixel mapping is proposed. In order to implement the fast CIIR method, we replace the magnification process in the conventional CIIR by a pixel-to-pixel mapping. The proposed fast CIIR method reconstructs two sorts of plane images; a plane image whose quality is sufficient, and a dot pattern plane image insufficient to view. This property is very useful to enhance the performance of a CIIR-based image correlator. Thus, we apply the fast CIIR method to a CIIR-based image correlator. To show the feasibility of the proposed method, some preliminary experiments on both pattern correlation and computational cost are carried out, and the results are presented. Our experimental results indicate that the proposed image correlator is superior to the previous method in terms of both correlation performance and complexity.     

Modified computational integral imaging-based double image encryption using fractional Fourier transform

In this paper, we propose an image encryption technique to simultaneously encrypt double or multiple images into one encrypted image using computational integral imaging (CII) and fractional Fourier transform (FrFT). In the encryption, each of the input plane images are located at different positions along a pickup plane, and simultaneously recorded in the form of an elemental image array (EIA) through a lenslet array. The recorded EIA to be encrypted is multiplied by FrFT with two different fractional orders. In order to mitigate the drawbacks of occlusion noise in computational integral imaging reconstruction (CIIR), the plane images can be reconstructed using a modified CIIR technique. To further improve the solution of the reconstructed plane images, a block matching algorithm is also introduced. Numerical simulation results verify the feasibility and effectiveness of the proposed method.     

A 3D image encryption technique using computer-generated integral imaging and cellular automata transform

A novel three-dimensional (3D) image encryption approach by using the computer-generated integral imaging and cellular automata transform (CAT) is proposed, in which, the two-dimensional (2D) elemental image array (EIA) digitally recorded by light rays coming from the 3D image is mapped inversely through the virtual pinhole array according to the ray-tracing theory. Next, the encrypted image is generated by using the 2D CAT scrambling transform for the 2D EIA. The reconstructed process is carried out by using the modified computational integral-imaging reconstruction (CIIR) technique; the depth-dependent plane images are reconstructed on the output plane. The reconstructed 3D image quality of the proposed scheme can be greatly improved, because the proposed encryption scheme carries out in a computer which can avoid the light diffraction caused by optical device CIIR, and solves blur problem caused by CIIR by using the pixel-averaging algorithm. Furthermore, the CAT-based encryption algorithm is an error-free encryption method; CAT as an orthogonal transformation offers considerable simplicity in the calculation of the transform coefficient, that is, it can improve the quality of the reconstructed image by reducing energy loss compared with the traditional complicated transform process. To show the effectiveness of the proposed scheme, we perform computational experiments. Experimental results show that the proposed scheme outperforms conventional encryption methods.     

Computational integral imaging reconstruction scheme of far 3D objects by additional use of an imaging lens

In this paper, we propose a novel performance-enhanced computational integral imaging reconstruction (CIIR) scheme by additional use of an imaging lens. In the proposed scheme, elemental images can be obtained by using a simultaneous pickup scheme of far three-dimensional (3D) objects from the lenslet array in both real and virtual image fields. And additional imaging lens produces an image shift effect of 3D objects located far away from the lenslet array and improve the visual quality of reconstructed images in CIIR by overcoming limitation of pickup range in integral imaging. To show the usefulness of the proposed system, some experiments are carried out for real 3D objects and its results are presented.     

Robust image encryption by combined use of integral imaging and pixel scrambling techniques

A robust image encryption method by using the integral imaging and pixel scrambling (PS) techniques is proposed. In this method, pixels of the cover image are scrambled with the PS technique and elemental images for this scrambled image are picked up through a lenslet array. Subsequently, an encrypted image is obtained by scrambling these picked-up elemental images. Since this encrypted image has the hologram-like property of data redundancy resulted from the integral imaging scheme, while it can as well be decoded by multiple keys such as the orders of pixel scrambling and the pickup conditions of the elemental images, its security against the various attacks could be dramatically improved. Good experimental results also confirm that the proposed method could provide more enhanced robustness against data loss and Gaussian noises compared to the conventional methods.     

Three-dimensional visualization of objects in scattering medium using integral imaging and spectral analysis

This paper presents a three-dimensional visualization method of 3D objects in a scattering medium. The proposed method employs integral imaging and spectral analysis to improve the visual quality of 3D images. The images observed from 3D objects in the scattering medium such as turbid water suffer from image degradation due to scattering. The main reason is that the observed image signal is very weak compared with the scattering signal. Common image enhancement techniques including histogram equalization and contrast enhancement works improperly to overcome the problem. Thus, integral imaging that enables to integrate the weak signals from multiple images was discussed to improve image quality. In this paper, we apply spectral analysis to an integral imaging system such as the computational integral imaging reconstruction. Also, we introduce a signal model with a visibility parameter to analyze the scattering signal. The proposed method based on spectral analysis efficiently estimates the original signal and it is applied to elemental images. The visibility-enhanced elemental images are then used to reconstruct 3D images using a computational integral imaging reconstruction algorithm. To evaluate the proposed method, we perform the optical experiments for 3D objects in turbid water. The experimental results indicate that the proposed method outperforms the existing methods.     

A novel three-dimensional digital watermarking scheme basing on integral imaging

A novel integral imaging-based three-dimensional (3D) digital watermarking scheme is presented. In the proposed method, an elemental image array (EIA) obtained by recording the rays coming from a 3D object through a pinhole array in the integral imaging system is employed as a new 3D watermark. The EIA is composed of a number of small elemental images having their own perspectives of a 3D object, and from this recorded EIA various depth-dependent 3D object images can be reconstructed by using the computational integral imaging reconstruction (CIIR) technique. This 3D property of the EIA watermark can make a robust reconstruction of the watermark image available even though there are some data losses in the embedded watermark by attacks. To show the robustness of the proposed scheme against attacks, some experiments are carried out and the results are discussed.     

Three-dimensional integral imaging with improved visualization using subpixel optical ray sensing

In this Letter, we propose an improved three-dimensional (3D) image reconstruction method for integral imaging. We use subpixel sensing of the optical rays of the 3D scene projected onto the image sensor. When reconstructing the 3D image, we use a calculated minimum subpixel distance for each sensor pixel instead of the average pixel value of integrated pixels from elemental images. The minimum subpixel distance is defined by measuring the distance between the center of the sensor pixel and the physical position of the imaging lens point spread function onto the sensor, which is projected from each reconstruction point for all elemental images. To show the usefulness of the proposed method, preliminary 3D imaging experiments are presented. Experimental results reveal that the proposed method may improve 3D imaging visualization because of the superior sensing and reconstruction of optical ray direction and intensity information for 3D objects.