逆向工程中基于共轴立体视觉的曲面边界测量（英文）

针对逆向工程中引导性曲面边界信息的快速获取问题,系统地研究了共轴立体视觉测量方法,建立该方法的数学模型,详细分析了摄像机焦距、基线距等系统结构参数及被测点空间位置对测量精度的影响,通过数学分析确定摄像机基线距的最佳取值范围,研究共轴立体视觉测量系统特殊的极线几何关系.提出基于共轴立体视觉的曲面边界快速测量方法,利用三坐标测量机的精密机械系统及精确的空间定位能力,用单个摄像机以两次共轴定位摄取图像的方式实现共轴立体视觉测量功能,然后利用共轴立体视觉外极线相互平行且通过各自像平面主点的特殊极线几何关系简化同源像点匹配过程,从而快速获取被测曲面的边界信息.实验结果表明:用基于三坐标测量机的单摄像机共轴立体视觉测量方法获取的曲面边界平均误差为0.268mm,基本满足逆向工程中对引导性曲面边界的测量精度要求.     

面向大视场视觉测量的摄像机标定技术

提出了一种面向大视场高精度视觉测量的摄像机标定新方法,该方法采用亮度自适应的单个红外发光二极管(IR-LED)作为目标靶点,将该靶点固定在三坐标测量机的测头上,并依次精确移动至预先设定的空间位置,每次靶点到达设定的空间位置时,摄像机对靶点进行图像采集。利用三坐标测量机的精确位移,在三维空间构成一个虚拟立体靶标。针对虚拟立体靶标在大视场摄像机标定中只能覆盖一小部分标定空间的问题,通过自由移动摄像机在多个方位对虚拟立体靶标进行拍摄,使得多个虚拟立体靶标分布于整个标定空间。摄像机在每个方位对虚拟立体靶标的拍摄都标定出一组摄像机的内、外参数,然后以摄像机内参数和摄像机在各个方位下拍摄的虚拟立体靶标在摄像机坐标系下的位置及姿态参数为优化变量,建立以所有三维靶点位置重投影误差平方和为最小的目标函数,采用非线性优化方法求解摄像机标定参数的最优解。该方法较好地解决了大视场视觉测量中大尺寸靶标加工困难、摄像机标定精度难以保证的问题。仿真和实际标定实验均证明此方法可以有效提高大视场摄像机的标定精度。     

光场相机视觉测量误差分析

光场相机通过一次曝光可以获取空间目标的位置和方向信息,具有重聚焦和多视角的特性,利用光场的这些特性可以进行视觉测量.本文对光场极平面图像视觉测量、重聚焦视觉测量、双目视觉以及多目视觉测量方法的测量原理和误差影响因素进行了理论分析,并通过实验验证了光场视觉测量误差跟不同视角基线长度,主透镜焦距大小,目标离相机的实际距离等结构参量的关系;理论分析和实验结果表明,由于相机基线较短,远距离测量误差较大,近距离测量具有较高的精度;在光场微透镜阵列大小有限条件下,采用多个视角组合的测量方法具有更高的测量精度.     

一种双目立体视觉系统的误差分析方法

基于摄像机透视成像的针孔模型,分析了立体视觉中摄像机标定和三维重建过程的主要误差来源。基于各主要误差源的模型分析,建立了双目视觉系统3D测量误差与摄像机参数、基线长度、测量距离等因素之间的关系式。如已知相关参数,可以估算出双目视觉系统的3D测量精度,或根据3D测量精度要求,初步确定摄像机的内部各项参数和基线长度、测量距离等参数。     

大尺度三维几何尺寸立体视觉测量系统实现

基于立体视觉的大尺度三维几何尺寸测量技术是对外形不规则的大型物体进行几何量测量的有效方法。与传统的视觉测量技术不同,大尺度视觉测量的精度随测量距离的增加而迅速下降,同时大尺度空间下照明条件难以控制,也使得测量变得不稳定。因此如何在大测量尺度的前提下提高测量精度成为这一领域的研究难点。从立体视觉测量系统的原理出发,分析了影响系统精度的各种因素,将相位一致性变换与极线约束条件引入结构光光条中心提取之中,显著提高了图像分析的精度。研制了测量系统的样机并给出了实验结果,现场测试表明该系统可以有效地保证大尺度条件下的测量精度。     

一种通用的共轴全向立体系统极线校正方法

对于全向立体视觉的三维环境测量系统,一般假设全向相机的光轴重合,即共轴立体。它具有径向上线性的对极几何关系,简化了立体匹配的搜索问题。但是在实际中,不可避免存在光轴之间的未对齐误差,从而降低了测量精度。为了补偿这种对齐误差,提出一种通用的共轴配置全向立体系统校正方法。推导并计算了泰勒模型下任意配置全向立体系统的本质矩阵。利用极曲线与其切空间的一一对应关系,将相机姿态校正到中心连线方向上,使得对应点被约束在径向直线上。图像重采样则保证图像对应点位于同一列上。算法只在图像平面上进行。最后的模拟和实验数据表明算法的有效性。     

单摄像机立体视觉测量系统的高精度变焦标定技术

针对现有用于光学测量的双目变焦系统标定方法难度大、测量精度受限于两摄像机内参一致性等问题。提出一种基于单摄像机的平行双目立体视觉系统实现及其高精度变焦标定方法。方法基于三角测量原理采集图像,利用高精度位移台驱动单摄像机进行平移以保证基线精度;求解离散焦距下的预标定结果并利用BP神经网络模型对其进行拟合,以实现任意焦距下系统内外参数动态估计。实验结果表明,系统预标定的重投影误差小于0.1664 pixel,变焦后图像畸变校正平均误差为0.0982 pixel,立体视觉测量尺寸绝对误差小于0.05mm。方法能弥补传统变焦标定方法的不足,消除双目内参不一致引入的误差,提高视觉系统的测量精度。     

基于SfS的3D视觉测量研究

提出了一种将Shape from Silhouette(SfS)技术应用在三坐标机上的新方法,即用摄像机获取图像,用三坐标机作移动平台,构建视觉测量系统,应用SfS技术对物体进行三维测量。该视觉测量系统扩展了坐标机功能,扩大了其应用范围。实验结果表明,该视觉测量系统具有SfS技术和坐标机两者的优点,重构物体三维模型的过程简单快捷,精度高于0.4mm,其结果可作为坐标机智能测量的基础,是一种非常实用的方法。     

一种用于三维曲面视觉测量的立体精匹配方法

根据立体视觉原理 ,针对三维曲面视觉测量的实际情况 ,提出一种基于空间不变量的立体精匹配方法。首先利用投影光栅 ,在曲面上形成变形条纹 ,采用小波变换检测出像素级的离散边缘点 ;然后用三次 B样条将条纹边缘插值成光顺曲线 ,根据对极几何特性 ,实现像素级的精匹配 ,解决了交向摆放姿态的双目立体视觉系统的匹配问题。     

基于光学参考棒的立体视觉测量系统现场标定技术

为实现大空间复杂工件的准确测量,精确标定立体视觉系统变得越来越重要。为了克服传统立体摄像机标定过程繁复、户外实现困难的弱点,提出了一种基于光学参考棒的灵活、有效的立体视觉测量系统标定技术。参考棒水平和深度方向各有三个距离已知的红外LED作为特征点。通过在测量范围内的不同位置和方位移动光学参考棒,两像机同时捕获参考棒上特征点的图像。基于匹配的特征像点以及对极线约束,利用线性算法和Levenberg-Marquardt(LM)迭代算法快速地标定立体视觉测量系统。两像机之间平移量的比例因子由参考棒上特征点间的已知距离确定。参量标定过程中,自动地控制光强,优化曝光时间,使不同位置处光点图像的强度均一致,可以获得高的信噪比,提高标定精度。实验结果表明,该方法灵活、有效,在线标定能达到很高的精度,将现场标定过程应用到实际的大空间三维测量系统中,测量最大误差为0.18 mm。     

Epipolar rectification method for a stereovision system with telecentric cameras

3D metrology of a stereovision system requires epipolar rectification to be performed before dense stereo matching. In this study, we propose an epipolar rectification method for a stereovision system with two telecentric lens-based cameras. Given the orthographic projection matrices of each camera, the new projection matrices are computed by determining the new camera coordinates system in affine space and imposing some constraints on the intrinsic parameters. Then, the transformation that maps the old image planes on to the new image planes is achieved. Experiments are performed to validate the performance of the proposed rectification method. The test results show that the perpendicular distance and 3D reconstructed deviation obtained from the rectified images is not significantly higher than the corresponding values obtained from the original images. Considering the roughness of the extracted corner points and calibrated camera parameters, we can conclude that the proposed method can provide sufficiently accurate rectification results.     

Implementation of opto-digital stereo object tracking system

In this paper, a new opto-digital stereo object tracking system using the variable window mask and the optical binary phase extraction joint transform correlator (BPEJTC) is proposed. At the first step, with the distance information from the stereo camera to the tracking object easily acquired by the structural elements of a stereo vision system, the area of the tracking object can be digitally extracted by using the variable window mask. And, at the second step, by carrying out the optical BPEJTC between this reference image obtained from the variable window mask and the stereo input image, the coordinates of the tracking object's location can be acquired, and then with these values, the convergence angle and the pan/tilt of the stereo tracking camera can be finally controlled. From some experimental results, the proposed system is found to be able to effectively extract the area of the target object from the input image having the background noises by using the variable window mask. And, with the location values of the tracking object obtained by using the optical BPEJTC, the convergence angle and the pan/tilt of the stereo cameras can be controlled. Finally, a feasibility of real-time implementation of the adaptive stereo object tracking system using the proposed algorithm is also suggested.     

Stereoscopic video surveillance system for detection of target’s 3D location coordinates and moving trajectories

In this paper, a novel stereoscopic video surveillance system to track a target person and detect its three-dimensional (3D) location coordinates and moving trajectory is implemented by using the pan/tilt-controlled stereo camera system. Stereoscopic video images of a target person are captured with stereo camera system and the target face and its location in the left image plane can be detected by use of YCbCr color model and centroid method. Also the target location in the right image plane can be obtained through correlation between the left face image and the right image by using the binary phase extraction joint transform correlator (BPEJTC) algorithm. With these location data of the target face in the left and right image planes the pan/tilt systems can control the stereo camera to track a target person by positioning the target face at the center of the camera’s FOV and making the focusing points of the right and left camera coincided on the target face. And then, with the resultant pan/tilt angles and geometric parameters of the stereo camera system, the target’s real 3D location coordinates and moving trajectory in the world space can be obtained. From some experiments with 900 frames of stereoscopic video image pairs, it is analyzed that the target’s center location after being tracked is kept to be very low error ratio of 0.62%, 2.04% on the average in the x, y directions of the image plane, respectively. Also, the error ratio between the calculated and measured values of the 3D location coordinates of a target person is found to be very low value of 2.1%, 5.7% on the average in the X and Y directions of the real world space, respectively.     

Defocus and binocular vision based stereo particle pairing method for 3D particle tracking velocimetry

We propose a new method, based on the depth-from-defocus technique and binocular vision, for solving the stereo particle pairing problem in 3D particle tracking velocimetry (PTV). Firstly, the apparent particle depth is measured with a single camera, using the depth-from-defocus technique. Secondly, a strict mathematical model of the particle-to-particle correspondence relationship between the left and right images, taking into account the refractions at the interfaces in the optical path, is presented, with the assumption that the apparent particle depth is measured. Thirdly, based on the apparent particle depth and particle-to-particle correspondence relationship, the epipoplar line is truncated into a short line segment by cutting off, where the apparent particle depth extends beyond its estimated range. For the first time, the range of the blur circle radius is employed as an additional stereo particle pairing constraint. Finally, the optimal pairing particle is selected by applying the epipolar line segment and blur circle radius constraints. The experimental results show that the rate of correct pairing is significantly improved compared with the epipolar line nearest neighbor analysis, especially when the particle density is increasing.     

Shape measurement by a multi-view methodology based on the remote tracking of a 3D optical scanner

Full field optical techniques can be reliably used for 3D measurements of complex shapes by multi-view processes, which require the computation of transformation parameters relating different views into a common reference system. Although, several multi-view approaches have been proposed, the alignment process is still the crucial step of a shape reconstruction.In this paper, a methodology to automatically align 3D views has been developed by integrating a stereo vision system and a full field optical scanner. In particular, the stereo vision system is used to remotely track the optical scanner within a working volume. The tracking system uses stereo images to detect the 3D coordinates of retro-reflective infrared markers rigidly connected to the scanner. Stereo correspondences are established by a robust methodology based on combining the epipolar geometry with an image spatial transformation constraint.The proposed methodology has been validated by experimental tests regarding both the evaluation of the measurement accuracy and the 3D reconstruction of an industrial shape.     

基于折反射全景相机的视觉里程计研究

为了实现折反射全景相机实时定位,提出了基于特征点法的可以用于折反射全景相机的视觉里程计算法。对折反射全景相机的投影模型重新设计了初始化模块,用于全景相机位姿的初始化。在初始化模块中,提出了适用于折反射全景相机的球面对极几何,通过球面对极几何计算初始化过程中两帧图像间位姿变化关系。为了验证算法鲁棒性和精确度,在相同场景下,将本文算法与使用针孔相机的特征点法的视觉里程计算法进行对比。结果表明,使用折反射全景相机的情况下,室外场景和室内场景下视觉里程计精度分别比针孔相机算法提升了38%和50%。     

单目多视点立体图像提取及应用

设计并实现了一种基于广角相机和平面镜的单目多视点立体图像摄像系统,给出了硬件装置的设计指标和优化方法;同时,在研究了硬件系统的标定方法基础上,实现了其在三维测距方面的应用。多枚平面镜构成的对称斗型腔体被放置在广角相机前面,物体光线经过不同平面镜反射后,投影到相机图像平面的不同区域,在相机投影平面上生成物体多个影像,形成单目多视点投影图像。该类图像等价于视点不同的多幅图像,可以使用多视点立体视觉算法实现三维测量。     

三维机器视觉中图象匹配的几种摄象机几何模型和误差分析

三维视觉中的一个主要问题是从不同的角度来确定物体的几何位置,而物体的位置则可由两幅实体图象的视差来确定.本文重点讨论图象匹配中几种摄象机的几何模型和误差分析.     

狭缝光栅自由立体显示器立体可视区域的研究

提出了反映观察区域某一点是否是合适的立体观察点立体图像质量因子的概念.根据狭缝光栅自由立体显示器的结构和工作原理并应用几何光学知识,分析得出了立体图像质量因子的计算公式,并给出了立体显示器的立体图像质量因子的计算结果.通过定义立体图像质量因子的阈值,得到狭缝光栅自由立体显示器的立体可视区域.     

立体图像质量的主观评价方案

立体图像质量评价在立体图像压缩、处理以及通信领域中有着十分重要的作用,一种好的立体图像质量客观评价方法也要依赖于立体图像的主观评价.本文基于人眼的立体视觉特性,提出了相对完整的立体图像质量主观评价方案,该方案主要分为立体图像库的建立、评测者的选择、观看条件的描述、评测者的训练和测试、数据处理和实验结果分析六个方面.实验中,评测者根据自己的主观感受,对所选取的立体图像进行评分,最后用数理统计理论对所得数据进行处理.结果表明,本文所提出的主观评价方案可行,能够正确反映立体图像质量的优劣.