基于三线结构光的相机平面标定方法研究

相机标定技术是结构光三维视觉测量的关键技术之一,结构光系统的相机标定的精度对三维测量的精度有很大影响。首先对三线结构光系统图的相机标定方法进行了分析,简单介绍了工业相机成像的几何模型及标定的原理;其次利用Harris角点检测方法提取特征点坐标,并选用了BP神经网络来校正工业相机的畸变模型,以提高标定算法的优化速度和标定精度;最后采用张正友的平面标定法对校正后的摄像机模型进行标定实验,由实验结果知,该方法具有一定的准确性和有效性,在一定误差范围内,基于神经网络畸变校正的张正友相机标定能够有效提高视觉检测的精度。     

A novel calibration approach to structured light 3D vision inspection

Structured light 3D vision inspection is a commonly used method for various 3D surface profiling techniques. In this paper, a novel approach is proposed to generate the sufficient calibration points with high accuracy for structured light 3D vision. This approach is based on a flexible calibration target, composed of a photo-electrical aiming device and a 3D translation platform. An improved algorithm of back propagation (BP) neural network is also presented, and is successfully applied to the calibration of structured light 3D vision inspection. Finally, using the calibration points and the improved algorithm of BP neural network, the best network structure is established. The training accuracy for the best BP network structure is 0.083 mm, and its testing accuracy is 0.128 mm.     

A novel 1D target-based calibration method with unknown orientation for structured light vision sensor

The problem associated with calibrating a structured light vision sensor is that it is difficult to obtain the coordinates of the world calibration points falling on the light stripe plane. In this paper, we present a novel method to address this problem by randomly moving a 1D (one-dimension) target within the sensor's view field. At each position where the target is set, the world coordinates with one calibration point on the light stripe plane that can be obtained based on at least three preset known points on the 1D target by a proposed two-stage technique. Thus, as long as the 1D target is at least set at three different positions, not less than three such calibration points can be obtained to perform the structured light vision sensor calibration. The simulation and real experiments conducted reveal that the proposed approach has an accuracy of up to 0.065 mm. The advantages of the proposed method are: (1) 1D target is easily machined with high accuracy, which reduces the cost of the calibration equipment; (2) the method simplifies the calibration operation and can be convenient in on-site calibration; (3) the method is suitable for use in confined spaces.     

A flexible and rapid micro-adjustment algorithm for structured light 3D measurement system with camera–projector

The structured light 3D measurement system with camera–projector has been widely studied and applied because of its characteristics of simple structure. In practice, we find that slight shock, vibration, or long-term applying may slightly reduce its level of measurement accuracy; thus, correcting the system parameters is occasionally necessary. However, most calibration algorithms are complicated and time-consuming procedures, not suitable for flexible and rapid precise calibration operation. To address this limitation, a flexible and rapid system parameter micro-optimization algorithm based on an implicit projection model is proposed. With a flexible measurement of an arbitrary 3D gauge, the system parameters are optimized rapidly by Levenberg-Marquardt (L-M) algorithm; thus, the high degree of accuracy of the system can be restored. Experiments were performed to validate the availability and reliability of the adjustment method. The algorithm can meet the convenient and real-time accuracy maintenance in practical application for structured light 3D measurement system.     

平顶线结构光的中心检测算法及光刀平面标定

针对传统线结构光光刀平面标定方法测量精度不高,应用范围小的问题,提出基于平面标靶的线结构光系统光刀平面标定,对无激光的标靶图片进行迭代摄像机标定,有激光的标靶图片进行光刀平面标定.提出光强符合均匀分布的平顶激光检测中心算法,将平顶激光建模为矩形的台阶函数,估计背景亮度和前景亮度,确定亮条纹宽度,再将窗口内的有效像素参与重心计算,得到光条纹中心.用该算法对不同噪声及不同量块的图片进行处理,结果表明,处理后图像的均方根误差分别在0.149pixel和0.176pixel内,表明该算法抗噪声能力强、精度高.用该算法提取光条中心,计算光条在标靶上的位置,根据至少两个姿态下的光条中心三维点,基于最小二乘法拟合光刀平面.通过迭代摄像机标定和光刀平面标定,利用三角测量法,在立体视觉模型下获取物体的三维点云数据.实验测量两个距离为100.5mm的标准球,相机与标准球距离为500mm,比较两球心距离与标准距离,测得平均误差为0.236mm.表明平顶激光检测中心算法切实可行,光刀平面标定方法基本满足要求.     

An absolute phase to world coordinates method for the defocusing structured light shape measurement system

This paper proposes a flexible calibration method for the defocusing structured light three-dimensional (3D) imaging system. Neither a high accuracy translation stage nor the parameters of the projector is required. Therefore the method is more flexible in many practical applications. World coordinates for calibration are obtained based on the method of coordinates from known plane. The monotonic nonlinear relationships between the absolute phase and each world coordinate have been investigated. Different from other methods, in our method, the 3D shape is directly recovered by the absolute phase to world coordinates method. Experimental results show that, when polynomial curve fitting methods are used, the root-mean-squared (RMS) error for the flat plate reconstruction is less than 0.12 mm, and the measurement error of 3D points is less than −0.34%. Furthermore, when comparing the measurement results of our method with the method of coordinates from known plane based on camera calibration, the relative error is less than −0.05%. Therefore, camera calibration is considered as the major error source.     

编码光系统的颜色耦合与颜色失衡校正

为了减小编码光系统中的颜色耦合与颜色失衡的干扰,提高形状与颜色重建的准确度,建立了彩色编码光系统,并对其所采用的编解码方法、颜色重建的两个相关环节及颜色校正方法进行了研究。首先,给出了系统的彩色梯形相移强度比编解码法,分析了编解码过程中存在的RGB基色相互耦合现象,设计了应用Caspi模型硬件标定的颜色耦合校正方案;然后,给出了系统的逐点颜色重建法,分析了颜色重建过程中由表面曲率导致的颜色失衡现象,设计了利用表面几何信息校正颜色失衡的方案。实验结果表明：校正后单一绿色图像中的红色分量值约为校正前的1/10;单色表面色差约为0.1,趋近于人眼颜色分辨率,远低于校正前的0.4;重建的单色复杂被测表面颜色均匀、视觉效果良好,符合实际情况。提出的方法符合编码光系统抗干扰能力强的要求,有助于提高形状与颜色重建的准确度。     

Accurate calibration for a camera–projector measurement system based on structured light projection

The accurate calibration for a camera–projector measurement system based on structured light projection is important to the system measurement accuracy. This study proposes an improved systematic calibration method focusing on three key factors: calibration model, calibration artifact and calibration procedures. The calibration model better describes the camera and projector imaging process by considering higher to fourth order radial and tangential lens distortion. The calibration artifact provides a sufficient number of accurate 3D reference points uniformly distributed in a common world coordinate system. And the calibration procedures calibrate the camera and projector simultaneously based on the same reference points to eliminate the influences of the camera calibration error on the projector calibration. The experiments demonstrate that our calibration method can improve the measurement accuracy by 47%.     

结构光三维测量系统中投影仪标定技术研究

投影仪标定是单摄像机单投影仪结构光三维测量中的基础。采用双面标定块实现投影仪的标定。标定块正面为黑底白色圆点图案,通过Tsai两步法及非线性优化完成摄像机标定。背面为反射率均匀的白色平面,由投影仪投影双方向高亮度的直线来生成特征点。针对特征点三维坐标难以确定的问题,采用了两种方法:一是依靠摄像机标定结果;二是结合正面圆点图案,利用交比不变性获取更多的有效输入数据。标定设备简单,操作方便。实验结果证明具有较理想的标定精度。     

无需系统标定的三维视觉重建北大核心CSCD

为了解决传统三维重建需要依赖系统标定信息的问题,提出了一种基于相位图的不需要系统标定信息的三维视觉重建算法。首先使用结构光测量技术获得被测物体表面的相位图,再利用相位图的横向和纵向空间扭曲特性计算物体表面相对深度信息,最后实现被测物体的三维视觉重建。这种方法可以用在无法进行标定或无法获取标定信息的场合。实验结果表明,当被测物体表面结构简单时,这种方法的三维视觉重建效果较好。并通过对比传统三维重建结果验证了该方法的有效性。     

Constructing feature points for calibrating a structured light vision sensor by viewing a plane from unknown orientations

To calibrate a structured light vision sensor, it is necessary to obtain at least four non-collinear feature points that fall on the light stripe plane. We propose a novel method to construct non-collinear feature points used for calibrating a structured light vision sensor with a planar calibration object. After the planar calibration object is moved freely in the range of measuring of the structured light vision sensor at least twice, all the local world coordinates of the feature points falling on the light stripe plane can be readily obtained in site. The global world coordinates of the non-collinear feature points in the local world coordinate frame can be computed through the three-dimensional (3D) camera coordinate frame. A planar calibration object is designed according to the proposed approach to provide accurate feature points. The experiments conducted on a real structured light vision sensor that consists of a camera and a single-light-stripe-plane laser projector reveal that the proposed approach has high accuracy and is practical in the vision inspection applications. The proposed approach greatly reduces the cost of the calibration equipment and simplifies the calibrating procedure. It advances structured light vision inspection one step from laboratory environments to real world use.     

Line structured light vision sensor calibration using parallel straight lines features

Line structured light vision sensor (LSLVS) calibration is to establish the relation between the camera and the light plane projector. This paper proposes a geometrical calibration method for LSLVS via three parallel straight lines on a 2D target. The approach is based on the properties of vanishing points and lines. During the calibration, one important aspect is to determine the normal vector of the light plane, another critical step is to obtain the distance parameter d of the light plane. In this paper, we put the emphasis on the later one. The distance constraint of parallel straight lines is used to compute a 3D feature point on the light plane, resulting in the acquisition of the parameter d. Thus, the equation of the light plane in the camera coordinate frame (CCF) can be solved out. To evaluate the performance of the algorithm, possible factors affecting the calibration accuracy are taken into account. Furthermore, mathematical formulations for error propagation are derived. Both computer simulations and real experiments have been carried out to validate our method, and the RMS error of the real calibration reaches 0.134 mm within the field of view 500 mm × 500 mm.     

A fast and accurate calibration method for the structured light system based on trapezoidal phase-shifting pattern

Calibration plays an important part in the structured light system. It used to be regarded as time-consuming, expensive and hard to implement. In this paper, we introduce a novel and fast method to calibrate the structured light system by using the camera to control the projector to “capture” images. Firstly, we projected just six trapezoidal grayscale pattern to establish the corresponding pixel between the camera and the projector, then we converted the camera image to its corresponding projector image. Thus the structured light system can be easy controlled by the camera calibration. Experiments showed that the present calibration method is fast, easy and accurate.     

放疗3D剂量验证系统中光场相机点扩散函数获取

基于闪烁光场成像的放疗新型3D剂量测量中,需利用点扩散函数将每一个二维平面的真实闪烁光数据从重叠图像中提取出来。利用刀口法,结合光场数字重聚焦以及聚焦测距法,实验获取光场相机不同重聚焦位置处的点扩散函数,并给出棋盘格标定板在参数α=0.6时的重聚焦面聚焦在α=0.7位置处的高斯离焦点扩散函数表达式,研究光场相机点扩散函数的规律,通过测量几个必要值便可由函数拟合得到所有点扩散函数,减少光学分层成像中因分层数量增加引起的标定工作量。将结果引入图像处理,通过反卷积运算可获得每一个二维重聚焦面的真实闪烁光数据,有助于3D剂量的实时精确测量。     

A high dynamic range structured light means for the 3D measurement of specular surface

This paper presents a novel structured light approach for the 3D reconstruction of specular surface. The binary shifting strip is adopted as structured light pattern instead of conventional sinusoidal pattern. Based on the framework of conventional High Dynamic Range (HDR) imaging technique, an efficient means is first introduced to estimate the camera response function. And then, dynamic range of the generated radiance map is compressed in the gradient domain by introducing an attenuation function. Subject to the change of lighting conditions caused by projecting different structured light patterns, the structure light image with middle exposure level is selected as the reference image and used for the slight adjustment of the primary fused image. Finally, the regenerated structured light images with well exposing condition are used for 3D reconstruction of the specular surface. To evaluate performance of the method, some stainless stamping parts with strong reflectivity are used for the experiments. And the results showed that, different specular targets with various shapes can be precisely reconstructed by the proposed method.     

多光刀三维轮廓快速测量方法研究

提出了一种三维自由曲面多光刀快速测量方案,阐述了此方法的测量原理,讨论了多光刀阵列的实现方法,分析了影响其测试精度的主要因素.提出了采用虚拟网格标定法对各光刀分别进行标定,以及运用光刀编码的方法实现对复杂自由曲面测量的方法,结果表明:该方法是一种快速有效的三维轮廓测量方法.     

基于圆结构光照明和LED照明相结合的三维检测技术

针对孔内表面的检测问题,提出了一种新的基于结构光照明和LED照明相结合的三维检测技术。该方法主要包括三个步骤:首先通过圆结构光照明获取孔内表面的截面轮廓图像,并通过图像处理和系统标定得到当前截面上局部区域的深度值;然后通过平面光照明得到孔内表面的平面图像,并在分析成像关系的前提下,在对平面图像进行坐标变换后得到孔内表面的展开图像,结合图像处理算法,提取展开图像的局部区域的平面尺寸信息;最后将圆结构光数据和LED光源数据变换到同一全局坐标系下,得到内表面的三维信息。     

基于无约束系统的结构光三维测量方法

针对传统结构光系统进行三维测量时,要求满足双瞳平行于参考平面和摄像机光轴垂、直于参考平面这两个强约束条件,建立了新的系统结构,去除了平行和垂直的约束,摄像机和投影仪位置可自由摆放.基于该无约束系统结构,提出了一种新的系统标定方法,通过重建"投影仪摄像机参考平面"三者的空间关系,可以简便而精确地获取传统"高度相位"公式中参量:双瞳的距离和摄像机到参考平面距离;同时,推导了无约束系统结构下新的物相关系方程和高度计算公式.实物测量结果证明,基于无约束系统的结构光三维测量方法可操作性强,测量精度可达0.1 mm.     

Robust geometric,phase and colour structured light projection system calibration

This paper introduces a new comprehensive procedure for both geometric and colour calibration of structured light system. In order to perform both geometric and colour calibration procedure, a new calibration artifact is proposed. The intrinsic and extrinsic parameters of projector and camera are estimated by using an extended pinhole camera model with a tangential and radial distortion. Camera image plane coordinates are obtained by extracting features from images of a calibration artifact. Projector image plane coordinates are calculated on the basis of continuous phase maps obtained from a fringe pattern phase reconstruction procedure. In order to stereo calibrate camera-projector system, pairs of corresponding image plane points are calculated with subpixel accuracy. In addition, one of three pattern views is used in colour calibration. RGB values of a colour field pattern detected by camera and their reference values are compared. This comparison leads to derivation of a colour transformation matrix. The performance of the proposed method is tested by measuring plane, sphere and distance reference. Also 360 degrees complex object 3D model from a set of measurements is obtained. Residual mean errors for all tests performed are calculated.