Single-lens 3D digital image correlation system based on a bilateral telecentric lens and a bi-prism: Systematic error analysis and correction

Recently, we proposed a single-lens 3D digital image correlation (3D DIC) method and established a measurement system on the basis of a bilateral telecentric lens (BTL) and a bi-prism. This system can retrieve the 3D morphology of a target and measure its deformation using a single BTL with relatively high accuracy. Nevertheless, the system still suffers from systematic errors caused by manufacturing deficiency of the bi-prism and distortion of the BTL. In this study, in-depth evaluations of these errors and their effects on the measurement results are performed experimentally. The bi-prism deficiency and the BTL distortion are characterized by two in-plane rotation angles and several distortion coefficients, respectively. These values are obtained from a calibration process using a chessboard placed into the field of view of the system; this process is conducted after the measurement of tested specimen. A modified mathematical model is proposed, which takes these systematic errors into account and corrects them during 3D reconstruction. Experiments on retrieving the 3D positions of the chessboard grid corners and the morphology of a ceramic plate specimen are performed. The results of the experiments reveal that ignoring the bi-prism deficiency will induce attitude error to the retrieved morphology, and the BTL distortion can lead to its pseudo out-of-plane deformation. Correcting these problems can further improve the measurement accuracy of the bi-prism-based single-lens 3D DIC system.     

采用广角数码相机测量图像显示系统的几何畸变

准确地测量含有广角耦合物镜的图像显示系统的几何畸变是实现图像显示系统几何畸变数字校正的前提和关键。提出了一种以非量测广角数码相机为测量设备的几何畸变的测量方法，首先给出了广角数码相机镜头畸变的标定方法，确定了数码相机镜头畸变系数，然后讨论了基于广角数码相机和Photoshop软件进行图像显示系统几何畸变测量的测量方法，分析了影响测量精度的因素。最后，将本文的测量结果与基于点物成像原理，采用单轴转台和普通数码相机进行测量的测量结果进行了对比，二者吻合得较好。从测量结果看，本文给出的测量方法，其测量精度可以满足工程要求，简单、易行。     

摄像机镜头畸变的一种非量测校正方法

为了减少噪声对摄像机镜头畸变的校正结果带来的影响,提出了一种校正摄像机镜头畸变的非量测方法.先找出由直线畸变而成的曲线,再用直线段连接每条曲线的两个端点形成一些闭合曲线.把它们的面积平方和定义为畸变测度,并用遗传算法搜索畸变测度的最小值.以此得到畸变参量.计算表明,该畸变测度具有较好的抗噪声能力,而遗传算法能避免收敛于局部极小值,减少了矫正图像的均方根误差.实验表明,对多幅图像分别和联合校正,相应矫正图像之间的均方根误差较小,计算和实验郜表明该校正方法具有良好的稳健性.     

Accuracy evaluation of optical distortion calibration by digital image correlation

Due to its convenience of operation, the camera calibration algorithm, which is based on the plane template, is widely used in image measurement, computer vision and other fields. How to select a suitable distortion model is always a problem to be solved. Therefore, there is an urgent need for an experimental evaluation of the accuracy of camera distortion calibrations. This paper presents an experimental method for evaluating camera distortion calibration accuracy, which is easy to implement, has high precision, and is suitable for a variety of commonly used lens. First, we use the digital image correlation method to calculate the in-plane rigid body displacement field of an image displayed on a liquid crystal display before and after translation, as captured with a camera. Next, we use a calibration board to calibrate the camera to obtain calibration parameters which are used to correct calculation points of the image before and after deformation. The displacement field before and after correction is compared to analyze the distortion calibration results. Experiments were carried out to evaluate the performance of two commonly used industrial camera lenses for four commonly used distortion models.     

Accurate calibration for a camera–projector measurement system based on structured light projection

The accurate calibration for a camera–projector measurement system based on structured light projection is important to the system measurement accuracy. This study proposes an improved systematic calibration method focusing on three key factors: calibration model, calibration artifact and calibration procedures. The calibration model better describes the camera and projector imaging process by considering higher to fourth order radial and tangential lens distortion. The calibration artifact provides a sufficient number of accurate 3D reference points uniformly distributed in a common world coordinate system. And the calibration procedures calibrate the camera and projector simultaneously based on the same reference points to eliminate the influences of the camera calibration error on the projector calibration. The experiments demonstrate that our calibration method can improve the measurement accuracy by 47%.     

Using the camera pin-hole model restrictions to calibrate the lens distortion model

Camera calibration required the computation of camera pin-hole and lens distortion models. The lens distortion is estimated alone or together with the pin-hole model, by using some existing lens distortion non-metric or self-calibration methods. If both models are computed together, then the models are adjusted to training data, but not to real camera. This is because both pin-hole and lens distortion models are coupled. If they are computed separately, difficulties arise since calibration of lens distortion alone is an unstable process. To improve existing camera calibration methods, this paper proposes a metric calibration method to compute lens distortion separately from the pin-hole model. This method is solved under stable conditions, independently of the computed lens distortion model, since pin-hole and distortion models are computed separately. Images of a planar template are used. First, using distorted control points extracted from images, a set of undistorted points which fits in the pin-hole model are computed. Second, with distorted and undistorted control points, lens distortion is calibrated by using a metric calibration process.     

大视场短焦距镜头CCD摄像系统的畸变校正

从光学测量角度出发,结合计算机视觉中的摄像机标定方法,解决了大视场短焦距镜头CCD摄像系统的畸变校正问题。与摄像机标定不同,畸变校正中仅标定内部参数,外部参数作为已知条件。采用线性畸变模型,由最小二乘法解线性方程组得到摄像系统畸变模型的畸变系数。介绍了数字图像中像素间距和光学中心的标定方法。通过比较由标定参数得到的畸变图像和摄像机采集的畸变图像对实验标定精度进行评定,实验结果表明边缘视场(112°)的标定精度达到了0 75%。     

A stereoscopic digital speckle photography system for 3-D displacement field measurements

Stereoscopic digital speckle photography offers a technique to measure object shapes and 3-D displacement fields in experimental mechanics. The system measures the displacement of a random white light speckle pattern, which somehow is present on the object surface, using digital correlation. This paper describes a general physical model for stereo imaging systems. A camera calibration algorithm, which takes the distortion in the lenses into account, is also presented and evaluated by real experiments. Standard deviations of small deformations as low as 1% of the pixel size for in-plane deformations and 6% of the pixel size for the out-of-plane component are reported. Using the calibration algorithm described, the main source of errors is random errors originating from the correlation algorithm.     

Two-dimensional vision measurement approach based on local sub-plane mapping

The existing two-dimensional vision measurement methods ignore lens distortion, require the plane to be perpendicular to the optical axis, and demand a complex operation. To address these issues, a new approach based on local sub-plane mapping is presented. The plane calibration is performed by dividing the calibration plane into sub-planes, and there exists an approximate affine invariance between each small sub-plane and the corresponding image plane. Thus, the coordinate transformation can be performed precisely, without lens distortion correction. The real comparative experiments show that the proposed approach is robust and yields a higher accuracy than the traditional methods.     

摄像机标定技术在活塞视觉检测与分选中的应用研究

在机器人视觉检测及自动化分捡中,准确地校正摄像机镜头畸变对获取物体精确图像及确定物体准确位置具有重要意义。采用了带有径向畸变的小孔摄像机模型及基于线段斜率的标定方法。在标定过程中,应用线性算法求解出了镜头的径向畸变系数。实验表明,采用的标定方法简捷有效,其标定结果能够满足研究需要。     

Lens distortion elimination for improving measurement accuracy of fringe projection profilometry

Fringe projection profilometry (FPP) is a powerful method for three-dimensional (3D) shape measurement. However, the measurement accuracy of the existing FPP is often hindered by the distortion of the lens used in FPP. In this paper, a simple and efficient method is presented to overcome this problem. First, the FPP system is calibrated as a stereovision system. Then, the camera lens distortion is eliminated by correcting the captured images. For the projector lens distortion, distorted fringe patterns are generated according to the lens distortion model. With these distorted fringe patterns, the projector can project undistorted fringe patterns, which means that the projector lens distortion is eliminated. Experimental results show that the proposed method can successfully eliminate the lens distortions of FPP and therefore improves its measurement accuracy.     

A camera calibration method for large field optical measurement

A camera calibration method is presented for large field optical measurement, where the camera is close to the ground and the control points can only be located close to the ground, too. In such conditions, the camera's optical center and the control points are approximately coplanar. Only a single image of these control points captured by the camera in measurement state is used in the method. Neither to distribute the control points in space rationally nor to calibrate the camera's intrinsic parameters in laboratory in advance is needed. By the presented method, the camera's principal point position, focal length, radial and transverse tangency lens distortion coefficients, and the camera's position and attitude parameters can be estimated precisely. Then the calibration results can be used for precise large field optical measurement in the conditions that the camera's longitudinal tangency lens distortion can be neglected or the objects’ movement field is close to the ground, which is usually factual in practical applications. The presented camera calibration method has been successfully used in applications, such as automatic landing of UAV (Unmanned Aerial Vehicle) based on optical measurement guidance, to calibrate the cameras precisely.     

一种成像式亮度计校正方法北大核心CSCD

采用图像传感器的成像式亮度计可通过短焦距成像物镜实现大视场和空间分辨的亮度测量,但仍存在图像传感器像素非线性响应,短焦物镜产生的强烈渐晕效应及图像边缘畸变等问题。因此提出了一种成像式亮度计校正方法,利用标准辐射源法进行线性校正与平场校正,以获得线性修正系数和平场校正矩阵,通过几何坐标标定法获得畸变校正矩阵。采用焦距为12 mm的物镜及200万pixel的图像传感器搭建了成像式亮度计,经校正后完成了液晶显示屏发光亮度测量,与商用分光辐射亮度计进行了对比测试,测量相对误差不超过±2%,实现了大视场高精度空间分辨亮度测量。     

Evaluating 3D position and velocity of subject in parabolic flight experiment by use of the binocular stereo vision measurement

<正>A practical method for evaluating the three-dimensional(3D) position and velocity of a moving object used in the parabolic flight experiment is developed by using the binocular stereo vision measurement theory. The camera calibration mathematic model without considering the lens distortion is introduced.The direct linear transformation(DLT) algorithm is improved to accomplish the camera calibration.The camera calibration result and optimization algorithm are used to calculate the object's world coordinate from image coordinate.The 3D position and the velocity of the moving object are obtained.The standard uncertainty in estimating the velocity is 0.0024 m/s,which corresponds to 1%level of the velocity of the object in the experiment.The results show that this method is very useful for the parabolic flight experiments.     

基于两个正交一维物体的单幅图像相机标定

提出了一种利用两个正交一维物体构成"T"型靶标进行摄像机标定的新方法。该方法只需对"T"型靶标上已知坐标的5点投影一幅图像,然后根据柔性靶标原理计算出由虚点和标记点组成的共直线的4点,由射影变换同素性、接合性以及交比不变性标定出镜头的一阶径向畸变参数。利用已知畸变参数对图像进行畸变校正,然后由基于两个正交一维物体坐标变换的方法即可标定出相机的内外参数。该方法线性求解镜头畸变参数,避免了传统方法非线性迭代优化过程中产生的参数耦合现象。实验表明,不进行镜头畸变校正则相机标定精度随着图像噪声的增加呈不稳定状态;进行畸变校正后对简单标定计算的初始值进行优化得到稳定的高精度标定结果。整个实验设备简单,操作方便,只需一幅图像即可实现镜头畸变和相机内外参数的标定,可以达到实时的效果。     

非量测相机镜头光学畸变的改正

镜头的光学畸变是造成数字相机影像误差的主要原因之一,可以用径向畸变表示。为了改正相机的光学畸变,形成了多种径向畸变改正模型。在分析这些模型的基础上,引入了最大畸变量,推导出了这些模型的共同公式形式,揭示了这些模型背后的共性。     

Multi-directional lateral shearing interferometer based on rotatable prism pairs

The common camera lens usually includes the spherical glass/plastic lens and aspheric glass/plastic lens. However, spherical/aspheric shape measurement is still a key problem in the process of optical lens fabrication. At present, the in-process measurement of spherical/aspheric shape is conducted mainly by the probe-contacting method. But after a long time, its probe could be scratched severely and cause some big errors. Laser shearing interferometry is a good substitute to some degree. Nevertheless, it is not convenient for general shearing interferometer to carry out the in-process measurement because it is only suitable for certain kind of spherical/aspheric with respect to aperture or asperity. Here a new lateral shearing interferometer is proposed to solve the described problems. It is based on two Jamin plates and rotatable prism pairs which are used not only for shearing displacement and direction, but also for fringe period and tilt degree, in order to meet requirements of various spherical/aspheric shapes or asperities. The new interferometer features a simple optical structure and two symmetric light paths, which makes its system with minimal error. The relation between shearing displacement, fringe period and prism angle of rotation is given in this paper. And the error source is primarily from the manufacture errors of prisms and plates. The final experiments show that one can achieve good-quality fringe patterns according to the requirement of measurement, concerning the shearing direction, shearing displacement, fringe period, tilt degree, etc.     

Use of rigid-body motion for the investigation and estimation of the measurement errors related to digital image correlation technique

The aim of this work is to investigate the sources of errors related to digital image correlation (DIC) technique applied to strain measurements. The knowledge of such information is important before the measured kinematic fields can be exploited. After recalling the principle of DIC, some sources of errors related to this technique are listed. Both numerical and experimental tests, based on rigid-body motion, are proposed. These tests are simple and easy-to-implement. They permit to quickly assess the errors related to lighting, the optical lens (distortion), the CCD sensor, the out-of-plane displacement, the speckle pattern, the grid pitch, the size of the subset and the correlation algorithm. The errors sources that cannot be uncoupled were estimated by amplifying their contribution to the global error. The obtained results permit to address a classification of the error related to the used equipment. The paper ends by some suggestions proposed in order to minimize the errors.     

Line-based camera calibration with lens distortion correction from a single image

Camera calibration is a fundamental and important step in many machine vision applications. For some practical situations, computing camera parameters from merely a single image is becoming increasingly feasible and significant. However, the existing single view based calibration methods have various disadvantages such as ignoring lens distortion, requiring some prior knowledge or special calibration environment, and so on. To address these issues, we propose a line-based camera calibration method with lens distortion correction from a single image using three squares with unknown length. Initially, the radial distortion coefficients are obtained through a non-linear optimization process which is isolated from the pin-hole model calibration, and the detected distorted lines of all the squares are corrected simultaneously. Subsequently, the corresponding lines used for homography estimation are normalized to avoid the specific unstable case, and the intrinsic parameters are calculated from the sufficient restrictions provided by vectors of homography matrix. To evaluate the performance of the proposed method, both simulative and real experiments have been carried out and the results show that the proposed method is robust under general conditions and it achieves comparable measurement accuracy in contrast with the traditional multiple view based calibration method using 2D chessboard target.     

Calibration of a wide angle stereoscopic system

Inaccuracies in the calibration of a stereoscopic system appear with errors in point correspondences between both images and inexact points localization in each image. Errors increase if the stereoscopic system is composed of wide angle lens cameras. We propose a technique where detected points in both images are corrected before estimating the fundamental matrix and the lens distortion models. Since points are corrected first, errors in point correspondences and point localization are avoided. To correct point location in both images, geometrical and epipolar constraints are imposed in a nonlinear minimization problem. Geometrical constraints define the point localization in relation to its neighbors in the same image, and eipolar constraints represent the location of one point referred to its corresponding point in the other image.