单摄像机单投影仪结构光三维测量系统标定方法

系统参数的标定是结构光三维测量系统工作的基础,且参数标定的精度直接影响测量的精度,其中投影仪目前还存在标定过程复杂、精度较低等问题。为解决该问题,通过投影一组圆阵图案到一块本身带有特征圆的平板上,并由摄像机拍摄;基于二维射影变换理论,通过误差补偿法建立投影仪图像坐标和摄像机图像坐标的对应关系,利用该对应关系计算获取标定点的投影仪图像坐标;以标定点的两组图像坐标和世界坐标为初始值,使用非线性算法对系统进行全参数整体优化,完成系统的标定。实验验证了系统标定误差最大值小于0.05 mm,误差均方根小于0.03 mm,结果表明该方法标定过程简单,能够有效地提高标定精度,具有较广的适用性。     

一种三维数字成像系统的多视点姿态估计方法

为校准多视场深度数据,提出基于条纹投影的三维数字成像系统的多视点姿态估计方法。该方法至少在两个视点分别向被测物体投射出一组正交条纹图,利用条纹投影和相位重建技术,将相位图映射为物体的三维空间坐标。进而,利用投影仪的投射过程是摄像机成像过程的逆过程,建立投影仪的投射平面和摄像机的成像平面的对应关系,将“极线几何约束”应用到基于条纹投影的主动三维视觉的姿态估计问题,并在考虑测量数据受噪声影响的条件下,建立了求解视点姿态参量的数学模型。通过优化求解非线性方程可以获得多视点的姿态估计参量。所设计的实验及结果证明了所提出方法的有效性。     

用于实时三维成像的双频结构光编解码方法

对三维重建中的实时性问题进行了研究,提出一种新的结构光双频测量方法。首先,投影光栅将基频正弦图案和高频正弦图案结合在一起,并保留一张图片作为直流分量,高频图案用于得出鲁棒性较好的高频相位信息,基频图案得出基频相位,并对高频相位进行展开,共5幅图片。其次,用相应的解码方法计算每一像素点的相位,滤除噪声干扰,得到照相机与投影仪的对应关系。最后,根据相位计算出每一采样点的三维坐标,实现三维重建。实验结果表明:计算得到的相位误差的方差为5.559 110-6 rad2,扫描时间为0.156 3 s,在保证实时性的同时有相对较高的精度。对表面深度变化复杂的物体进行三维测量,验证方法的可行性。相比较于传统的双频测量方法,本方法将投影图片数量减小到5幅的同时保持了较好的精度,可应用于扫描动态物体。     

单摄像机虚拟立体视觉测量技术研究

以双目立体视觉传感器三维测量模型为基础,提出了一种用于测量空间三维点坐标的低成本单摄像机模型。该模型利用光学成像,把单摄像机镜像为一对虚拟摄像机,在一个CCD像面上采集到同一物体存在视差的两幅图像,从而恢复空间点的三维信息。讨论了单摄像机传感器测量空间三维点坐标的基本原理,建立了单摄像机传感器的测量模型,克服了双摄像机系统中成本高、切换采集左右摄像机的图像使检测速度减慢等诸多缺陷,为空间三维点的精密测量提供了经济、快速、有效的测量途径。实验表明．传感器可实现约0．8％的相对测量精度．证明了本方案合理、有效。     

结构位移摄像测量系统的设计与实现

针对飞机等大型工程结构的位移测量需求,设计实现了结构位移摄像测量系统.该系统采用多台数字式摄像机从不同方向拍摄飞机机身、机翼表面的人工合作标志点,在试验前对各个摄像机的参数进行精确标定,试验过程中实时分析各摄像机采集到的序列图像,检测跟踪得到标志点在图像上的二维像点坐标,根据像机参数和标志点二维像点坐标交会计算得到各标志点的三维坐标,即可得到整个结构的位移与变形参数.结构位移结果可进行三维动画显示,也可随时查看各标志点的位移曲线.精度测试结果表明该系统位移测量误差标准差小于1 mm,相对误差小于1%.该系统已成功应用于飞机机翼位移测量中.     

基于光学测棒的立体视觉坐标测量系统的研究

提出了一种基丁测量与校准功能合一的光学测棒的立体视觉坐标测最系统.采用光学测棒作为成像目标,通过任意放置的两台摄像机获取测棒上的发光特征点的图像实现被测物体三维坐标的测量,同时利用测量数据定期对两台摄像机外部方位参数进行校准.深入研究了两台摄像机内部参数和外部方位参数校准过程中的校准件和校准算法的设计,以及系统测量建模等关键技术,提出了相应的解决方案,减小了摄像机内外参数校准及测量模型对测量结果的影响,提高系统的测量精度.实验结果表明.该系统的最大测量误差为0.11 mm.     

基于神经网络的结构光系统标定

提出一种基于神经网络的系统标定方法.通过射影变换及误差补偿方法,建立摄像机图像平面与投影仪图像平面的映射关系,利用该映射关系和标定点的摄像机图像坐标,计算得到相应的投影仪图像坐标;建立三层结构的神经网络,该网络以两个图像坐标为输入,对应的世界坐标为输出,训练样本由得到的标定点的两个图像坐标及其世界坐标组成,采用BP算法训练该网络;训练过程即为神经网络逼近系统模型的过程,训练完成时,系统完成标定.实验表明,与传统的结构光标定方法对比,本文提出的方法简化了建模复杂度和标定过程,提高了标定精度,并具有普遍适应性.     

基于自适应条纹投影的彩色物体三维形貌测量

针对三维形貌测量技术中彩色物体表面反射率的非均匀性影响测量结果的问题,提出一种基于自适应条纹投影的三维形貌测量技术,该方法可避免彩色物体表面反射率非均匀的影响,提高系统的测量精度。彩色相机采集RGB光强图像,并根据物体表面颜色的反射特性计算每个像素点的最优投射光强和颜色;采集水平和垂直的正弦条纹序列,利用计算所得绝对相位值将相机图像坐标系中每一个像素点的最优投射光强和颜色映射到投影仪像素坐标系;投射自适应条纹序列进而测量彩色物体的三维形貌。实验结果表明,该方法能够有效测量彩色物体三维形貌,具有很高的测量精度。     

航空线阵摆扫式相机成像仿真

成像仿真是相机研制必不可缺的步骤。航空线阵摆扫式相机具有距离远、成像倾角大的特点,容易导致成像仿真过程中坐标投影计算迭代不收敛。针对这一问题,提出一种视向量分段迭代的坐标投影计算方法。首先将迭代窗口内的视向量进行分段,根据像点坐标和其所在扫描行的外方位元素计算各分段处的高程与对应的地面点的高程之差,寻找差值最小的分段;然后在该分段处继续构建迭代窗口进行计算,直至高程差值的最小值小于给定的阈值,得到像点坐标对应的地面点三维坐标;最后将该地面点对应的正射影像上的灰度值赋予模拟影像的像点,生成仿真影像。通过三组不同地形的实验数据成像仿真结果表明,该方法成像仿真的精度高于0.005pixel,且其稳健性较高,能够适用于大倾角成像方式的成像仿真。     

集成成像大纵深物体的三维形貌获取技术

为了满足现代工业所需的大纵深物体的三维形貌获取需求,解决传统结构光三维形貌获取技术纵深较小的问题, 借助集成成像这种阵列式多视点获取技术,构建了基于集成成像的大纵深物体的三维形貌获取技术。从集成成像原理出发,分析了集成成像三维物点和同名像点之间的关系,得到集成成像光学获取系统参数和三维物体纵深极限之间的关系。在此基础上,利用相机和电动平移台构建了扫描式相机集成成像三维形貌获取系统,并对纵深从600 mm到3 600 mm相对独立的2个物体构建的大纵深三维物体进行了形貌获取。光学实验结果显示,该集成成像大纵深物体三维形貌获取技术能够单次获取纵深为3 600 mm的三维物体的三维形貌,为大纵深物体的三维形貌获取提供了技术支持。     

Accurate calibration for a camera–projector measurement system based on structured light projection

The accurate calibration for a camera–projector measurement system based on structured light projection is important to the system measurement accuracy. This study proposes an improved systematic calibration method focusing on three key factors: calibration model, calibration artifact and calibration procedures. The calibration model better describes the camera and projector imaging process by considering higher to fourth order radial and tangential lens distortion. The calibration artifact provides a sufficient number of accurate 3D reference points uniformly distributed in a common world coordinate system. And the calibration procedures calibrate the camera and projector simultaneously based on the same reference points to eliminate the influences of the camera calibration error on the projector calibration. The experiments demonstrate that our calibration method can improve the measurement accuracy by 47%.     

一种分析薄膜振动模式的结构光条纹时间平均法

提出了一种用于振动物体表面快速测量的光学测试系统和方法。该系统采用结构光三维传感技术,利用时间平均法来实现对振动表面的测量和振动模式分析。用低帧频商用CCD相机记录由光栅投影到振动物体表面上形成的一系列变形正弦条纹,对获取的一帧变形条纹经过二维傅里叶变换、频谱滤波、逆傅里叶变换等处理得到调制物体振幅的零级贝塞尔函数分布。给出了该方法的理论分析,推导了相应的计算公式。计算机模拟和实验验证了该方法的可行性。实验证明,该方法具有数据获取速度快,全场非接触测量以及实验装置简单等优点。     

Constructing feature points for calibrating a structured light vision sensor by viewing a plane from unknown orientations

To calibrate a structured light vision sensor, it is necessary to obtain at least four non-collinear feature points that fall on the light stripe plane. We propose a novel method to construct non-collinear feature points used for calibrating a structured light vision sensor with a planar calibration object. After the planar calibration object is moved freely in the range of measuring of the structured light vision sensor at least twice, all the local world coordinates of the feature points falling on the light stripe plane can be readily obtained in site. The global world coordinates of the non-collinear feature points in the local world coordinate frame can be computed through the three-dimensional (3D) camera coordinate frame. A planar calibration object is designed according to the proposed approach to provide accurate feature points. The experiments conducted on a real structured light vision sensor that consists of a camera and a single-light-stripe-plane laser projector reveal that the proposed approach has high accuracy and is practical in the vision inspection applications. The proposed approach greatly reduces the cost of the calibration equipment and simplifies the calibrating procedure. It advances structured light vision inspection one step from laboratory environments to real world use.     

结构光三维测量系统中投影仪标定技术研究

投影仪标定是单摄像机单投影仪结构光三维测量中的基础。采用双面标定块实现投影仪的标定。标定块正面为黑底白色圆点图案,通过Tsai两步法及非线性优化完成摄像机标定。背面为反射率均匀的白色平面,由投影仪投影双方向高亮度的直线来生成特征点。针对特征点三维坐标难以确定的问题,采用了两种方法:一是依靠摄像机标定结果;二是结合正面圆点图案,利用交比不变性获取更多的有效输入数据。标定设备简单,操作方便。实验结果证明具有较理想的标定精度。     

基于空间二进制编码的3 D形貌测量方法

介绍了一种基于空间二进制编码的非接触３ Ｄ 形貌测量方法。它用一台ＬＣＤ 投影仪对被测物体表面进行空间编码,再用一台ＣＣＤ 摄像机获取物体编码信息,最后用三角法原理从摄像机图像中获取三维形貌数据。提出了基于三角法的空间二进制码的重要特性,描述了高效编码的构造方法。用这个构造方法构造出一个完全数字化的７ 位字长的二进制编码。基于这种编码的３ Ｄ 形貌测量方法在被测物体表面非常不连续和非构造的环境下取得了良好的测量结果。     

An absolute phase to world coordinates method for the defocusing structured light shape measurement system

This paper proposes a flexible calibration method for the defocusing structured light three-dimensional (3D) imaging system. Neither a high accuracy translation stage nor the parameters of the projector is required. Therefore the method is more flexible in many practical applications. World coordinates for calibration are obtained based on the method of coordinates from known plane. The monotonic nonlinear relationships between the absolute phase and each world coordinate have been investigated. Different from other methods, in our method, the 3D shape is directly recovered by the absolute phase to world coordinates method. Experimental results show that, when polynomial curve fitting methods are used, the root-mean-squared (RMS) error for the flat plate reconstruction is less than 0.12 mm, and the measurement error of 3D points is less than −0.34%. Furthermore, when comparing the measurement results of our method with the method of coordinates from known plane based on camera calibration, the relative error is less than −0.05%. Therefore, camera calibration is considered as the major error source.     

基于单数码相机的三维视觉测量数据拼接方法

针对大型物体三维形貌视觉测量,提出了一种新的视觉测量三维数据拼接方法。以一台高分辨率数码相机作为全局测量设备,在测量过程中固定不动,并以数码相机坐标系作为全局坐标系。视觉传感器流动到不同位置对物体各子区域进行测量,获得局部坐标系下的三维数据。以一平面靶标为中介将视觉传感器在各位置的局部坐标系统一到全局坐标系下,从而将三维数据统一到全局坐标系下,完成三维拼接。该方法无需在被测物上贴标记,因此适用于任何材质的被测物,且消除了拼接累积误差。实验结果表明,该方法相对拼接误差为0.076%。以Venus石膏像为被测对象,视觉传感器对其三个局部区域进行测量,给出了局部测量结果及拼接结果。     

A flexible and rapid micro-adjustment algorithm for structured light 3D measurement system with camera–projector

The structured light 3D measurement system with camera–projector has been widely studied and applied because of its characteristics of simple structure. In practice, we find that slight shock, vibration, or long-term applying may slightly reduce its level of measurement accuracy; thus, correcting the system parameters is occasionally necessary. However, most calibration algorithms are complicated and time-consuming procedures, not suitable for flexible and rapid precise calibration operation. To address this limitation, a flexible and rapid system parameter micro-optimization algorithm based on an implicit projection model is proposed. With a flexible measurement of an arbitrary 3D gauge, the system parameters are optimized rapidly by Levenberg-Marquardt (L-M) algorithm; thus, the high degree of accuracy of the system can be restored. Experiments were performed to validate the availability and reliability of the adjustment method. The algorithm can meet the convenient and real-time accuracy maintenance in practical application for structured light 3D measurement system.     

Thermal 3D modeling system based on 3-view geometry

In this paper, we propose a novel thermal three-dimensional (3D) modeling system that includes 3D shape, visual, and thermal infrared information and solves a registration problem among these three types of information. The proposed system consists of a projector, a visual camera and, a thermal camera (PVT). To generate 3D shape information, we use a structured light technique, which consists of a visual camera and a projector. A thermal camera is added to the structured light system in order to provide thermal information. To solve the correspondence problem between the three sensors, we use three-view geometry. Finally, we obtain registered PVT data, which includes visual, thermal, and 3D shape information. Among various potential applications such as industrial measurements, biological experiments, military usage, and so on, we have adapted the proposed method to biometrics, particularly for face recognition. With the proposed method, we obtain multi-modal 3D face data that includes not only textural information but also data regarding head pose, 3D shape, and thermal information. Experimental results show that the performance of the proposed face recognition system is not limited by head pose variation which is a serious problem in face recognition.     

Three-dimensional shape measurement for an underwater object based on two-dimensional grating pattern projection

In this paper, a practical method using phase tracking and ray tracing algorithms is proposed for measuring the three-dimensional (3D) shape of an underwater object. A 2D projected sinusoidal fringe goes through the water and illuminates the tested object. Firstly, the phase tracking algorithm is employed to identify homologous points in phase distributions of the deformed fringe captured by the camera and these of the fringe pattern projected by the projector. The projector is regarded as a special camera as regards the stereovision principle. In the calibrated system, both ray directions of the homologous points can be easily figured out. Secondly, the ray tracing algorithm is used to trace the propagation path of each ray and to calculate the 3D coordinates of each point on the tested object's surface. Finally, the whole shape of the tested object can be reconstructed.