Strategy for automatic and complete three-dimensional optical digitization

This Letter proposes a new strategy of a three-dimensional (3D) scanning pipeline to achieve complete 3D digitization of complex objects in a real scene. This strategy consists of a one-dimensional array of optical 3D sensors combined with an automatically controlled turntable. An efficient calibration method for the sensor array is presented to guarantee the accuracy of the 3D measurement. Furthermore, an automatic registration technique is also proposed for aligning multiple range images taken from sensor array. Experiment results are also presented to demonstrate the proposed approach.     

三维面形测量数据的计算全息可视化

提出利用计算机制全息进行三维面形测量数据立体重现的技术。首先利用三维面形测量技术同时获取三维物体的强度和距离像；然后根据三维面形测量数据，设计和制作菲涅耳计算全息图；最后将计算全息和光学全息相结合，以菲涅耳计算全息图的光学再现像为对象，记录光学像全息。这样既解决了计算机制全息术中真实三维物体立体信息数据捕捉的问题，又为三维面形检测提供了一个行之有效的立体重构技术。给出了这种方法的原理、计算全息的设计、制作方案和实验验证结果。     

Three-dimensional optical microscopy using axially distributed image sensing

We propose three-dimensional (3D) optical microscopy using axially distributed image sensing. In the proposed method, the micro-objects are optically magnified and their axially distributed images are recorded by moving the image sensor along a common optical axis. The 3D volumetric images are generated from the recorded axial image set using a computational reconstruction algorithm based on ray backprojection. Preliminary experimental results are presented. To the best of our knowledge, this is the first report on 3D optical microscopy using axially distributed sensing.     

Three-dimensional integral imaging with improved visualization using subpixel optical ray sensing

In this Letter, we propose an improved three-dimensional (3D) image reconstruction method for integral imaging. We use subpixel sensing of the optical rays of the 3D scene projected onto the image sensor. When reconstructing the 3D image, we use a calculated minimum subpixel distance for each sensor pixel instead of the average pixel value of integrated pixels from elemental images. The minimum subpixel distance is defined by measuring the distance between the center of the sensor pixel and the physical position of the imaging lens point spread function onto the sensor, which is projected from each reconstruction point for all elemental images. To show the usefulness of the proposed method, preliminary 3D imaging experiments are presented. Experimental results reveal that the proposed method may improve 3D imaging visualization because of the superior sensing and reconstruction of optical ray direction and intensity information for 3D objects.     

空间目标天基光学观测的序列图像仿真方法

利用STK和OpenGL,提出了一种能体现空间目标天基光学观测系统真实成像距离和系统性能的序列图像仿真方法。首先建立空间目标的三维模型和轨道模型,利用STK预测目标卫星和观测卫星的相对几何关系,然后在分析相机针孔成像和OpenGL透视投影成像模型关系的基础上,通过设置OpenGL的有关参数生成了包含目标和成像系统信息在内的目标仿真图像,最后生成运动空间目标近距离光学观测的二维图像序列,可为天基空间目标识别研究提供数据基础。     

基于自适应条纹投影的高反光物体三维面形测量

结构光投影方法在三维形貌测量中应用广泛,但是由于被测物体表面反射率变化范围较大,过度曝光会导致相位信息无法获取。而传统的高动态范围扫描技术步骤复杂,耗时较长。文中提出一种自适应条纹投影技术,向待测物体表面投射较高灰度级的条纹图,判断并标记过度曝光点。降低投射强度后通过非线性最小二乘法拟合来确定每个饱和像素点最适合的最大输入灰度,用重新生成的自适应条纹图来采集图像并进行相位计算和三维形貌恢复。通过实验验证,该方法可以对物体表面的高反光区域进行有效测量,避免过度饱和,仿真误差在0.02 mm范围内,实测误差约为0.14 mm,实际实验对过曝点的补偿率可达到99%。     

A flexible new three-dimensional measurement technique by projected fringe pattern

Aimed at the problems of inferior precision and bad maneuverability for three-dimensional (3D) measurement by projected fringe pattern, a flexible new 3D technique for performing system calibration and measuring was proposed. First, we analyzed the principle of conventional 3D measurement with projected fringe pattern, and pointed out the shortcoming of measurement system. Then, the CCD camera calibration technique is analyzed and we set up the perspective projection model which transforms the computer image coordinate to 3D world coordinate, and we get the coordinate of the CCD camera image lens. Third, the position of projection lens optical center can be obtained using the above model. At last, some experiment results presented show that this technique is more simple and robust in engineering than conventional measurement method.     

Resolution-enhanced 3D image correlator using computationally reconstructed integral images

In this paper, a novel resolution-enhanced three-dimensional (3D) image correlator using the computationally reconstructed integral images is proposed in order to extract target object’s 3D location data in a scene. Elemental images of the reference and target objects are picked up by lenslet arrays and using these elemental images, reference and target plane images are reconstructed on the output plane by means of a modified computational integral imaging reconstruction technique. Then, through cross-correlations between the reconstructed reference and the target plane images, 3D location data of the target object can be extracted from the correlation outputs. With the purpose of showing the feasibility of the proposed method, some computational and optical experiments on the target objects in space are carried out and the results are presented.     

Three-dimensional polarimetric integral imaging

A three-dimensional (3D) polarimetric image sensing and display technique based on integral imaging is proposed. Three-dimensional polarization distribution of reflected light from a 3D object can be measured as elemental image arrays by a rotating linear polarizer. After the measurement of the polarization of the 3D object, the 3D polarimetric object can be reconstructed optically by displaying the polarization-selected elemental images in spatial light modulators with two quarter-wave plates. Experimental demonstration of 3D polarimetric imaging of a 3D object attached to two orthogonal linear polarizers is presented. To the best of our knowledge, this is the first report on 3D polarimetric sensing imaging and 3D optical reconstruction by integral imaging.     

Registration and integration algorithm in structured light three-dimensional scanning based on scale-invariant feature matching of multi-source images

Based on the homography between a multi-source image and three-dimensional (3D) measurement points, this letter proposes a novel 3D registration and integration method based on scale-invariant feature matching. The matching relationships of two-dimensional (2D) texture gray images and two-and-a-half- dimensional (2.5D) range images are constructed using the scale-invariant feature transform algorithms. Then, at least three non-collinear 3D measurement points corresponding to image feature points are used to achieve a registration relationship accurately. According to the index of overlapping images and the local 3D border search method, multi-view registration data are rapidly and accurately integrated. Experimental results on real models demonstrate that the algorithm is robust and effective.     

Three-dimensional visualization of objects in scattering medium using integral imaging and spectral analysis

This paper presents a three-dimensional visualization method of 3D objects in a scattering medium. The proposed method employs integral imaging and spectral analysis to improve the visual quality of 3D images. The images observed from 3D objects in the scattering medium such as turbid water suffer from image degradation due to scattering. The main reason is that the observed image signal is very weak compared with the scattering signal. Common image enhancement techniques including histogram equalization and contrast enhancement works improperly to overcome the problem. Thus, integral imaging that enables to integrate the weak signals from multiple images was discussed to improve image quality. In this paper, we apply spectral analysis to an integral imaging system such as the computational integral imaging reconstruction. Also, we introduce a signal model with a visibility parameter to analyze the scattering signal. The proposed method based on spectral analysis efficiently estimates the original signal and it is applied to elemental images. The visibility-enhanced elemental images are then used to reconstruct 3D images using a computational integral imaging reconstruction algorithm. To evaluate the proposed method, we perform the optical experiments for 3D objects in turbid water. The experimental results indicate that the proposed method outperforms the existing methods.     

基于光流分层方法的平面3D运动估测

无人机自主着舰末端视觉导引中舰机间相对位姿的估测,可以看作机载摄像机对甲板平面3D运动的估测。提出了一种光流分层方法:首先利用已知焦距的机载摄像机拍摄着舰靶标区域的图像序列,并采用Lucas方法计算相邻两帧图像的光流场;而后通过分层模型,将由光流场进行3D运动检测的非线性问题转化为了两个线性问题。该方法无需图像间的特征匹配,可线性解算出着舰靶标区域相对于无人机的三维运动参数,进而得到舰机间的相对位姿信息。计算机合成图和摄像机实拍图像的实验结果验证了该算法的正确性和有效性。     

Lens distortion elimination for improving measurement accuracy of fringe projection profilometry

Fringe projection profilometry (FPP) is a powerful method for three-dimensional (3D) shape measurement. However, the measurement accuracy of the existing FPP is often hindered by the distortion of the lens used in FPP. In this paper, a simple and efficient method is presented to overcome this problem. First, the FPP system is calibrated as a stereovision system. Then, the camera lens distortion is eliminated by correcting the captured images. For the projector lens distortion, distorted fringe patterns are generated according to the lens distortion model. With these distorted fringe patterns, the projector can project undistorted fringe patterns, which means that the projector lens distortion is eliminated. Experimental results show that the proposed method can successfully eliminate the lens distortions of FPP and therefore improves its measurement accuracy.     

双探头三维表面轮廓测量系统

提出了一种将原子力显微(AFM)探头与位置敏感探测器测距探头相结合的双探头三维表面轮廓测量新方法, 可在获取样品表面轮廓的同时, 测定样品局部形貌。搭建了双探头三维表面轮廓测量系统, 阐述了系统的工作原理, 并对其结构组成包括双探头、步进扫描台和计算机控制平台进行了说明。用2000 line/mm的光栅进行了扫描实验, 对系统的测量范围进行了标定。以外径8 mm、内径4 mm的金属垫圈为样品, 进行了整体三维表面轮廓与局部表面形貌测量实验, 给出了垫圈表面图和局部三维形貌图。结果表明, 该系统能满足不同尺寸和材质的样品的测量要求, 即可实现对样品轮廓的大范围扫描测量, 又可对样品局部进行高精度形貌测量。     

3D shape reconstruction from synthetic images captured by a rotating periscope system with a single focal direction

A three-dimensional shape measurement system with only one camera and a rotating periscope is proposed. Many images are captured at every few degrees of periscope rotation. The distance along the optical axis of the camera from the focal point of the camera system to a certain point along the object surface is inversely proportional to the parallax. In this system, a circular streak is obtained by tracing a point on each image using the cross-correlation along the direction of periscope shift. The parallax can be calculated from the radius of the streak. Applying this method to shape measurement of the human face from synthetic images, the images were well reconstructed and the proposed system may be adaptable to a portable 3D shape acquisition system.     

基于二维彩色靶标的结构光三维测量系统快速标定方法

系统标定是基于结构光投影的主动式光学三维面形测量的关键技术之一,同时也是一项复杂和耗时的工作。提出了一种基于RGB彩色模型的系统快速标定新方法。利用一个彩色的二维平面靶标和由投影仪投影的彩色标记特征图像实现了摄像机和投影仪的同时快速标定,对靶标的每个标定姿态位置只需要拍摄一幅图像即可得到该位置的特征参数。与传统方法相比,标定过程简单快捷,所需的数据量较少。利用该方法对一个结构光三维测量系统进行了现场标定,并测量了一个平面和一个半圆柱物体,实验结果中点到拟合平面的最大距离为0.8039mm,平均误差为0.1693mm。利用该系统恢复半圆柱物体的面形与传统标定方法的测量结果符合得很好。实验表明,由该方法获得的结果准确可用,且标定速度快。     

Three-dimensional imaging and visualization of partially occluded objects using axially distributed stereo image sensing

In this Letter, we propose a multiperspective three-dimensional (3D) imaging system using axially distributed stereo image sensing. In this proposed method, the stereo camera is translated along its optical axis and multiple axial elemental image pairs for a 3D scene are collected. The captured elemental images are reconstructed in 3D using a computational reconstruction algorithm based on ray back-projection. The proposed method is applied to partially occluded object visualization. Optical experiments are performed to verify the approach.     

Three-dimensional particle imaging by defocusing method with an annular aperture

We propose an annular-aperture-based defocusing technique for three-dimensional (3D) particle metrology from a single camera view. This simple configuration has high optical efficiency and the ability to deal with overlapped defocused images. Initial results show that an uncertainty in depth of 23 microm can be achieved over a range of 10 mm for macroscopic systems. This method can also be applied in microscopy for the measurement of fluorescently doped microparticles, thus providing a promising solution for 3D flow metrology at both macroscales and microscales.     

Statistical properties of polarization image and despeckling method by multiresolution block-matching 3D filter

The theoretical and experimental investigations on the polarization imagery system of speckle statistical characteristics and speckle removing method are researched. A method to obtain two images encoded by polarization degree with a single measurement process is proposed. A theoretical model for polarization imagery system on Müller matrix is proposed. According to modern charge coupled device (CCD) imaging characteristics, speckles are divided into two kinds, namely small speckle and big speckle. Based on this model, a speckle reduction algorithm based on a dual-tree complex wavelet transform (DTCWT) and blockmatching 3D filter (BM3D) is proposed (DTBM3D). Original laser image data transformed by logarithmic compression is decomposed by DTCWT into approximation and detail subbands. Bilateral filtering is applied to the approximation subbands, and a suited BM3D filter is applied to the detail subbands. The despeckling results show that contrast improvement index and edge preserve index outperform those of traditional methods. The researches have important reference value in research of speckle noise level and removing speckle noise.     

Close-range optical measurement of aircraft''''s 3D attitude and accuracy evaluation

A new screen-spot imaging method based on optical measurement is proposed, which is applicable to the close-range measurement of aircraft's three-dimensional (3D) attitude parameters. Laser tracker is used to finish the global calibrations of the high-speed cameras and the fixed screens on test site, as well as to establish media-coordinate-frames among various coordinate systems. The laser cooperation object mounted on the aircraft surface projects laser beams on the screens and the high-speed cameras syn-chronously record the light-spots' position changing with aircraft attitude. The recorded image sequences are used to compute the aircraft attitude parameters. Based on the matrix analysis, the error sources of the measurement accuracy are analyzed, and the maximum relative error of this mathematical model is estimated. The experimental result shows that this method effectively makes the change of aircraft position distinguishable, and the error of this method is no more than 3' while the rotation angles of three axes are within a certain range.