基于单目结构光的大物体三维测量关键方法的研究

在单目结构光的三维测量系统中,由于投影仪倾斜投影, 参考平面上的条纹周期展宽, 给测量带来误差,降低了测量精度。同时受大物体自身几何和形貌等因素的影响,以及相交轴测量系统的限制,其单幅面测量范围受限,很难一次测量大物体完整的三维形貌,而且在测量大物体时,摄像机镜头非线性畸变也影响测量精度。根据参考平面上光栅条纹的周期变化规律,提出了一种适用性好、方便快捷的条纹周期校正的理论模型, 在此基础上, 提出了基于条纹周期校正的四步相移法的理论模型,进而提出了基于条纹周期校正的时间相位展开法的理论模型。采用摄像机镜头非线性畸变校正模型,提高测量精度。在被测物表面粘贴标志点,获取其三维坐标,利用SVD分解和L-M优化算法求取转换矩阵,并在设定的全局坐标系下实现三维图像拼接,采用线性加权算法,对重叠区域进行图像融合。实验结果表明,X轴的拼接误差为0.14 mm,Y轴的拼接误差为0.16 mm,Z轴的拼接误差为0.19 mm,其拼接误差均在测量误差允许范围之内。     

Lens distortion elimination for improving measurement accuracy of fringe projection profilometry

Fringe projection profilometry (FPP) is a powerful method for three-dimensional (3D) shape measurement. However, the measurement accuracy of the existing FPP is often hindered by the distortion of the lens used in FPP. In this paper, a simple and efficient method is presented to overcome this problem. First, the FPP system is calibrated as a stereovision system. Then, the camera lens distortion is eliminated by correcting the captured images. For the projector lens distortion, distorted fringe patterns are generated according to the lens distortion model. With these distorted fringe patterns, the projector can project undistorted fringe patterns, which means that the projector lens distortion is eliminated. Experimental results show that the proposed method can successfully eliminate the lens distortions of FPP and therefore improves its measurement accuracy.     

一种基于参数标定的投影条纹周期简易校正方法

基于三角测量原理的条纹投影轮廓测量系统中,倾斜投影到参考平面上的条纹将产生周期展宽现象,引起相位失真甚至影响测量精度。论文以条纹位置为控制变量推导出条纹周期校正的线性数学模型,通过简便的标定获得模型参数,由此反算出新的待投影条纹,并在参考平面上获得周期分布的投影条纹。实验结果表明校正后的条纹周期变化范围在±0.1像素内,并且该方法能够获得更为精确的三维轮廓测量结果。     

Period correction method for binary fringe defocused projection

Binary fringe defocused projection can resolve the problem caused by the nonlinear gamma of the projector. Owing to the intersecting axis measurement system, the broadening of the fringe period on the reference plane can cause measurement errors. Non-uniform periodical binary fringe defocused projection is utilized to overcome this problem. After appropriate defocused projection of non-uniform periodical binary fringe, uniform periodical sinusoidal fringe can be obtained on the reference plane. This method can prevent the nonlinear gamma effect and broadening of the fringe period, and filter high harmonics and high-frequency noise. Three-dimensional (3-D) shape measurement experiments of standard flat are performed with four-step phase-shift method. Experimental results demonstrate that the proposed method exhibits high measurement precision. Highly accurate 3-D measurements of large objects can also be performed with the proposed method.     

Flexible digital projector calibration method based on per-pixel distortion measurement and correction

When a digital projector is applied in high precision applications, the intrinsic parameters and distortion characteristics should be calibrated precisely. In this paper, a flexible full-field projector calibration method is proposed without any approximate distortion model. With planar homography theory and fringe projection technique, the projector distortion characteristic on each pixel can be measured independently and an initial distortion map is generated. The intrinsic parameters are calibrated afterwards. Then, the initial distortion map can be refined by correcting the non-perpendicularity between the optical axis and image plane. The original pattern to be projected is corrected with the refined distortion map. Thus, the calibrated projector can be regarded as an ideal projector conforming to the pinhole model. Experimental results show a nearly ideal residual map for the corrected projection pattern. In addition, the proposed calibration method is flexible without any sophisticated ancillary equipment or complicated procedure.     

利用预失真条纹校正PMP系统投影仪畸变的研究

依据摄像机畸变模型提出了一种投影条纹相位畸变校正方法来简化相位-高度映射关系.该方法首先通过投两套互相垂直的相移正弦条纹,以相位值代替投影仪像素坐标,将投影仪当成摄像机看待,标定出投影仪的内参量.然后根据标定出的投影仪镜头畸变参量对理想相位施加反向的畸变,在投影时反向畸变的光栅通过镜头畸变,又成为理想的光栅,从而简化了相位-高度映射关系.实验中,虽然由于测量误差的影响,校正后的投影仪径向畸变系数还是比原来小了1个数量级.     

利用预失真条纹校正PMP系统投影仪畸变的研究*

依据摄像机畸变模型提出了一种投影条纹相位畸变校正方法来简化相位-高度映射关系.该方法首先通过投两套互相垂直的相移正弦条纹,以相位值代替投影仪像素坐标,将投影仪当成摄像机看待,标定出投影仪的内参量.然后根据标定出的投影仪镜头畸变参量对理想相位施加反向的畸变,在投影时反向畸变的光栅通过镜头畸变,又成为理想的光栅,从而简化了相位-高度映射关系.实验中,虽然由于测量误差的影响,校正后的投影仪径向畸变系数还是比原来小了1个数量级.     

A novel three-dimensional shape measurement method based on a look-up table

Fringe projection profilometry is widely used for three-dimensional shape measurement. In an oblique-angle projection, the fringe cycle is broadened on the reference plane. Phase errors are mainly caused by the nonlinear gamma of the projector and fringe cycle broadening. This study describes a phase error compensation method to eliminate these phase errors. A look-up table that stores phase errors is constructed for phase error compensation. Based on it, a new height equation is proposed. The experimental results show that the proposed method can compensate for the phase errors of the fringe projection profilometry, thereby improving the measurement accuracy significantly.     

A 3D shape retrieval method for orthogonal fringe projection based on a combination of variational image decomposition and variational mode decomposition

The orthogonal fringe projection technique has as wide as long practical application nowadays. In this paper, we propose a 3D shape retrieval method for orthogonal composite fringe projection based on a combination of variational image decomposition (VID) and variational mode decomposition (VMD). We propose a new image decomposition model to extract the orthogonal fringe. Then we introduce the VMD method to separate the horizontal and vertical fringe from the orthogonal fringe. Lastly, the 3D shape information is obtained by the differential 3D shape retrieval method (D3D). We test the proposed method on a simulated pattern and two actual objects with edges or abrupt changes in height, and compare with the recent, related and advanced differential 3D shape retrieval method (D3D) in terms of both quantitative evaluation and visual quality. The experimental results have demonstrated the validity of the proposed method.     

复杂刚性运动物体的高精度三维测量算法

基于相移法的三维形貌重建精度高,对环境噪声和阴影等不敏感,但由于多幅条纹解相位,难以应用于动态物体的三维测量中,为此,提出了一种新的算法.基于Harris算法提取刚性运动棋盘格的角点,确定相邻两帧采集条纹图像之间的像素偏差并校正采集条纹图像;根据投影仪和摄像机的标定参数建立投影图像和采集图像之间的空间变换矩阵,并根据变...     

基于传像束的小视场双目结构光三维形貌恢复

提出基于传像束传像和双目结构光相结合的三维测量系统,实现对无法直接成像场景,如爆轰、冲击等环境下的小视场物体三维面形测量。测量时,结构光直接投影到待测物体表面,变形条纹图像首先被成像到传像束前端面,再被传递到传像束后端面,并最终被成像到相机像平面,再由三频相位展开技术计算出对应相位分布后,即可根据双目匹配计算出待测物体高度。实验表明,传像束系统能完成高精度的微小物体三维形貌重建,且由于传像束的引入,增加了测量系统的灵活性。     

一种微米级高度台阶镜面条纹反射的三维测量系统

提出了一种检测微米级高度衍射台阶结构的条纹反射三维检测方法.对条纹反射光路的理论分析表明,合理选择入射光线角度和液晶屏放置角度以及液晶屏像素尺寸等系统参数,条纹反射系统能够分辨微米乃至亚微米级的镜面台阶.实际构建了一套微米级台阶镜面条纹反射测量实验装置;采用四步相移法进行条纹相位解算,运用移动屏幕方法确定反射光线方程,结合三角交汇原理,对待测台阶镜面进行三维重构.实际测量了名义值为5μm和10μm的台阶镜面,测量结果不确定度在0.5μm内,和商业仪器测量结果的偏差<0.5μm,证明了设计方法的可行性.本文结果对于包含衍射台阶结构的光学元件三维测量研究具有一定的借鉴意义.     

Imaging surface topography using Lloyd's mirror in photoemission electron microscopy

We use Lloyd's mirror to modulate electron photoemission in photoemission electron microscopy. This results in the projection of Lloyd's fringes on to three-dimensional (3D) surface objects. An iterative reconstruction method is used to correct for distortions in the fringe pattern due to the cathode immersion lens, thereby providing a quantitative interpretation of surface shape. It is therefore possible to extract 3D height information directly from a two-dimensional, plan-view image. The technique is of sufficient intensity and contrast to study real-time changes in surface topography and we apply the method to study unusual contact-line dynamics during the reactive wetting of metal droplets.     

A composite-structured-light 3D measurement method based on fringe parameter calibration

This paper proposes a novel method for reducing measurement error caused by spectrum overlapping in composite-structured-light 3D measurement systems. For a composite-structured-light 3D measurement system, spectrum overlapping causes parameters of each deformed phase-shifting fringe to change, and therefore leads to phase measurement errors. The proposed fringe parameter calibration method is based on the fact that variations in each deformed fringe's parameters are independent of height and reflectivity of the measured object. Three frames of composite grating are projected on the reference plane, and each carrier channel includes the information of three phase-shifting sinusoidal gratings used in Phase Measuring Profilometry (PMP). With the parameter calculation formulas of PMP, the parameters of fringes demodulated from the same carrier channel can be calculated, and therefore parameter relation coefficients between fringes demodulated from different carrier channels may be obtained. When an object is measured, these relation coefficients can be used to calibrate the parameters of the deformed phase-shifting fringes. A new 3D measurement mathematical model is established to reconstruct the shape of the object. Experimental data proved that the proposed method can effectively restrain the effect of spectrum overlapping and improve measurement accuracy by more than three times.     

一种针对彩色物体的光栅投影三维测量方法

针对传统彩色编码光栅三维轮廓术中光栅易受到物体表面彩色纹理的干扰,从而造成编码条纹颜色误判和相位误差增大这一问题,提出一种基于互补彩色光栅的三维测量方法,给出了理论分析、光栅设计原理、补偿算法与实验分析。对图像进行初步的解耦校正后,通过预先设计的光栅互补特性,依据彩色响应模型求取物体表面逐点的反射率,并对红绿蓝(RGB)三通道反射率的不平衡进行补偿,消除物体表面彩色纹理的干扰,改善光栅的正弦性。以补偿后的图像来指导彩色编码条纹的分割解码并用傅里叶变换法提取出包裹相位,依据解码结果指导相位展开,继而完成整个三维测量过程。实验证明该方法对彩色纹理的补偿准确有效,降低了彩色纹理对测量的影响。     

基于球面透视投影约束的全景环形透镜畸变校正

全景环形透镜将折反射面集成到一起,能无扫描地瞬时得到围绕光轴的360度超大视场,在机器人导航、视频监控和虚拟现实领域得到了广泛的应用.其成像机理是将围绕光轴的视场二次反射投影到环形平面上,图像存在严重的切向和径向畸变.本文根据全景环形透镜的特点采用基于球面透视投影模型对图像进行校正.首先建立含有畸变参量的全景环形透镜校正模型,将空间直线点映射为球面点,然后使用遗传算法将球面点拟合为球面上的最佳大圆,求出变形校正参量,进而校正全景环形像.仿真和真实图像实验表明,环形图像的切向和径向畸变得到了很好的校正.     

Robust geometric,phase and colour structured light projection system calibration

This paper introduces a new comprehensive procedure for both geometric and colour calibration of structured light system. In order to perform both geometric and colour calibration procedure, a new calibration artifact is proposed. The intrinsic and extrinsic parameters of projector and camera are estimated by using an extended pinhole camera model with a tangential and radial distortion. Camera image plane coordinates are obtained by extracting features from images of a calibration artifact. Projector image plane coordinates are calculated on the basis of continuous phase maps obtained from a fringe pattern phase reconstruction procedure. In order to stereo calibrate camera-projector system, pairs of corresponding image plane points are calculated with subpixel accuracy. In addition, one of three pattern views is used in colour calibration. RGB values of a colour field pattern detected by camera and their reference values are compared. This comparison leads to derivation of a colour transformation matrix. The performance of the proposed method is tested by measuring plane, sphere and distance reference. Also 360 degrees complex object 3D model from a set of measurements is obtained. Residual mean errors for all tests performed are calculated.     

基于正弦和三角波条纹投影的三维测量方法

在现有的针对复杂物体表面形貌的三维测量方法中, 为了完成绝对相位的测量, 通常需要处理至少6幅条纹图像, 限制了测量速度。提出了采用2幅正弦条纹和2幅三角波条纹图来获得物体三维形貌的方法。利用两步相移正弦条纹和两步相移三角条纹得到截断相位, 再利用两步相移三角波条纹得到条纹级次, 减少了投影条纹幅数, 提高测量速度。在得到条纹级次时, 计算三角波条纹强度调制和强度对比度, 与计算相位相比, 可以减少数据处理的时间, 进一步提高测量速度, 同时能减小物体表面反射率的影响, 提高了测量精度。测量最大高度为39 mm的阶梯状标准块, 得到的最大绝对误差和最大的RMS误差分别为0.045 mm和0.041 mm。验证了该方法的有效性和实用性, 在高速实时的复杂形貌三维测量中有广泛的应用前景。     

A flexible fast 3D profilometry based on modulation measurement

This paper proposes a flexible fast profilometry based on modulation measurement. Two orthogonal gratings through a beam splitter are vertically projected on an object surface, and the measured object is placed between the imaging planes of the two gratings. Then the image of the object surface modulated by the orthogonal gratings can be obtained by a CCD camera in the same direction as the grating projection. This image is processed by the operations consisting of performing the Fourier transform, spatial frequency filtering and inverse Fourier transform. Using the modulation distributions of two grating patterns, we can reconstruct the 3D shape of the object. In the measurement process, we only need to capture one fringe pattern, so it is faster than the MMP and remains the advantages of it. In the article, the principle of this method, the setup of the measurement system, some simulations and primary experiment results are given. The simulative and experimental result proves it can restore the 3D shape of the complex object fast and comparatively accurate. Because only one fringe pattern is needed in the testing, our method has a promising extensive application prospect in real-time acquiring and dynamic measurement of 3D data of complex objects.