中心折反射全方位摄像头的标定方法研究

提出一种适用于不同类型中心折反射全方位摄像头的标定方法。该方法不需标定模板的运动信息或限定全方位摄像头的类型,而只用通过摄像头观测分布在不同位置的标定模板,对所采集的标定模板图像提取角点,将包含内外部参数的非线性图像投影函数用泰勒级数展开表示,应用Levenberg-Marquardt算法计算摄像头外部参数,而通过对超定方程组的伪逆求解计算内部参数。整个标定过程简单,快速而且自动完成。利用某一中心折反射全方位摄像头对提出的方法进行了实验,实验结果表明,该方法可获得很好的标定效果。     

Camera calibration from vanishing points in a vision system

Camera calibration has been studied for many years and there are many methods available to find the parameters precisely. However, most existing methods require information of the known scene points in general three-dimensional positions for the calibration. A simple, geometrically intuitive method is proposed. The intrinsic parameters of the camera are determined by using the vanishing points in each image. The rotation matrix of the projection matrix is computed from the vanishing and image edges and the translation matrix are obtained with additional translation motion between the viewpoints. Our approach does not need any a priori information about the cameras being used. Computer simulations and real data experiments are carried out to validate our method.     

基于一维标定物和改进进化策略的相机标定

为了解决运动参数光电探测过程中的相机标定问题,制作一种两端及中间各安装一个红外反光标记球的一维标定物.不需要其它复杂标定装置,只要将这种特制的一维标定物在测量空间内多次随意移动并摄取其图像,即可实现标定.算法首先假定主点位于像面中心附近的某个位置,再求出焦距、旋转矩阵、平移向量和比例因子,最后通过评价函数将相机标定转换成寻找两相机最佳主点对的非线性最小化问题.在传统进化策略中引进个体的自我改进系数、个体间距离等概念,提出了求取子代个体间的欧式距离并排序的方法,设计了搜索最佳主点对的改进型进化策略算法.与传统标定方法相比,基于一维标定物的方法克服了多相机场合的遮挡问题,改进进化策略的引入打破了一维标定物需做某种特殊运动的限制,使一维标定物自由运动时相机内、外参数的同时求解成为可能,改进的模拟退火进化策略改善了算法的全局收敛性能并加快了收敛速度.     

基于光学测棒的立体视觉坐标测量系统的研究

提出了一种基丁测量与校准功能合一的光学测棒的立体视觉坐标测最系统.采用光学测棒作为成像目标,通过任意放置的两台摄像机获取测棒上的发光特征点的图像实现被测物体三维坐标的测量,同时利用测量数据定期对两台摄像机外部方位参数进行校准.深入研究了两台摄像机内部参数和外部方位参数校准过程中的校准件和校准算法的设计,以及系统测量建模等关键技术,提出了相应的解决方案,减小了摄像机内外参数校准及测量模型对测量结果的影响,提高系统的测量精度.实验结果表明.该系统的最大测量误差为0.11 mm.     

准同心广义经纬相机的成像模型及高精度标定

对于大尺度运动目标的参数测量,固定相机存在着视场与空间分辨率之间的矛盾,并且当测量空中或海上目标时相机的标定也十分困难。跟踪式相机(如光电经纬仪)能解决此问题,但存在体积大、成本高和操作复杂等缺点。结合两者特点取长补短,将相机固定在二维旋转平台上,尽可能实现同心放置,组成准同心广义经纬相机进行中远场高精度测量,测量过程中转台实时跟踪目标并为相机提供外参数。此方法并没有光电经纬仪非常严格的同心同轴的安装要求。在合理假设基础上建立了经纬相机成像模型,提出了线性求解及平差优化相机参数的方法。大量仿真与实际测量验证了模型和标定方法的正确性和高精度。广义经纬相机测量系统组合巧妙、装拆和操作简单、体积小、成本低、可全视场测量且测量精度高,有广泛且重要的应用前景。     

基于两个正交一维物体的单幅图像相机标定

提出了一种利用两个正交一维物体构成"T"型靶标进行摄像机标定的新方法。该方法只需对"T"型靶标上已知坐标的5点投影一幅图像,然后根据柔性靶标原理计算出由虚点和标记点组成的共直线的4点,由射影变换同素性、接合性以及交比不变性标定出镜头的一阶径向畸变参数。利用已知畸变参数对图像进行畸变校正,然后由基于两个正交一维物体坐标变换的方法即可标定出相机的内外参数。该方法线性求解镜头畸变参数,避免了传统方法非线性迭代优化过程中产生的参数耦合现象。实验表明,不进行镜头畸变校正则相机标定精度随着图像噪声的增加呈不稳定状态;进行畸变校正后对简单标定计算的初始值进行优化得到稳定的高精度标定结果。整个实验设备简单,操作方便,只需一幅图像即可实现镜头畸变和相机内外参数的标定,可以达到实时的效果。     

Self-calibration using two same circles

Camera calibration is a fundamental step in 3D reconstruction and computer vision. Considering the easy accessibility of two same circles, a method for self-calibration based on two same circles is proposed. The proposed method does not need any prior knowledge and known camera parameters. By taking three photos of the object containing two same circles from different views, the close solution for intrinsic and extrinsic parameters are first obtained by the invariance of circular points and common tangent of two circles. Then the solution is refined by the nonlinear optimization. This method could get the intrinsic parameters as well as the extrinsic parameters without complicated matching process. Extensive results show the accuracy, robustness and wide applications of the proposed method.     

Extended gravitational pose estimation

The model-to-image registration problem is a problem of determining the position and orientation (the pose) of a three-dimensional object with respect to a camera coordinate system. When there is no additional information available to constrain the pose of the object and to constrain the correspondence of object features to image features, the problem is also known as simultaneous pose and correspondence problem, or correspondenceless pose estimation problem. In this paper, we present a new algorithm, called extended gravitational pose estimation (EGPE), for determining the pose and correspondence simultaneously. The algorithm is based on gravitational pose estimation (GPE) algorithm. In our algorithm, the original GPE has been revised to deal with the problem with false image points. For problems with both occluded object points and false image points, we firstly applied single-link agglomerative clustering algorithm to pick out occluded object points when a local minimum has been found, then the revised GPE is applied again on the clustering result to update rotation and translation of the object model. EGPE has been verified on both synthetic images and real images. Empirical results show that EGPE is faster, more stable and reliable than most current algorithms, and can be used in real applications.     

A calibration method for stereo vision sensor with large FOV based on 1D targets

Large FOV (field of view) stereo vision sensor is of great importance in the measurement of large free-form surface. Before using it, the intrinsic and structure parameters of cameras should be calibrated. Traditional methods are mainly based on planar or 3D targets, which are usually expensive and difficult to manufacture especially for large dimension ones. Compared to that the method proposed in this paper is based on 1D (one dimensional) targets, which are easy to operate and with high efficiency. First two 1D targets with multiple feature points are placed randomly, and the cameras acquire multiple images of the targets from different angles of view. With the fixed angle between vectors defined by the two 1D targets we can establish the objective function with intrinsic parameters, which can be later solved by the optimization method. Then the stereo vision sensor with two calibrated cameras is set up, which acquire multiple images of another 1D target with two feature points in unrestrained motion. The initial values of the structure parameters are estimated by the linear method for the known distance between two feature points on the 1D target, while the optimal ones and intrinsic parameters of the stereo vision sensor are estimated with non-linear optimization method by establishing the minimizing function involving all the parameters. The experimental results show that the measurement precision of the stereo vision sensor is 0.046 mm with the working distance of about 3500 mm and the measurement scale of about 4000 mm×3000 mm. The method in this paper is proved suitable for calibration of stereo vision sensor of large-scale measurement field for its easy operation and high efficiency.     

一种利用图像序列进行摄像机标定的方法

结合消隐点的有关知识,利用图像序列中运动的人体及其阴影的垂直关系,给出了一种实用性比较强的摄像机标定方法.该方法采用线性的方法计算出了可变焦摄像机5参数的内参数矩阵及旋转矩阵,并在一定的条件下计算出平移矩阵,最终将摄像机完全标定.计算内参数及旋转矩阵时不必考虑图像之间对应点之间的关系,从而大大减少了图像检测期间算法的复杂度,提高了标定的速度.此外,模拟和实际图像实验也表明该自标定方法具有较高的鲁棒性和准确性,适用于在线摄像机标定系统.     

结构光三维成像系统的计算机仿真

基于相位测量轮廓术和摄像机模型,提出一种结构照明三维成像系统的高精度计算机仿真算法。对于给定的物体三维模型,首先根据系统结构,采用Z缓冲技术消除遮挡和阴影部分,得到与摄像机像素点对应的物体表面采样点三维坐标,再使用统一的数学模型和方法处理投影过程。根据摄像机及投影仪的内、外参数,最终得到了摄像机像素点、物体表面采样点和投影仪像素坐标三者之间的对应关系,从而实现了结构照明三维成像系统仿真。为实际系统的结构设计、调整和参数校正提供了参考。     

Sphere-based calibration method for trinocular vision sensor

A new method to calibrate a trinocular vision sensor is proposed and two main tasks are finished in this paper, i.e. to determine the transformation matrix between each two cameras and the trifocal tensor of the trinocular vision sensor. A flexible sphere target with several spherical circles is designed. As the isotropy of a sphere, trifocal tensor of the three cameras can be determined exactly from the feature on the sphere target. Then the fundamental matrix between each two cameras can be obtained. Easily, compatible rotation matrix and translation matrix can be deduced base on the singular value decomposition of the fundamental matrix. In our proposed calibration method, image points are not requested one-to-one correspondence. When image points locates in the same feature are obtained, the transformation matrix between each two cameras with the trifocal tensor of trinocular vision sensor can be determined. Experiment results show that the proposed calibration method can obtain precise results, including measurement and matching results. The root mean square error of distance is 0.026 mm with regard to the view field of about 200×200 mm and the feature matching of three images is strict. As a sphere projection is not concerned with its orientation, the calibration method is robust and with an easy operation. Moreover, our calibration method also provides a new approach to obtain the trifocal tensor.     

Calibration for stereo vision system based on phase matching and bundle adjustment algorithm

Calibration for stereo vision system plays an important role in the field of machine vision applications. The existing accurate calibration methods are usually carried out by capturing a high-accuracy calibration target with the same size as the measurement view. In in-situ 3D measurement and in large field of view measurement, the extrinsic parameters of the system usually need to be calibrated in real-time. Furthermore, the large high-accuracy calibration target in the field is a big challenge for manufacturing. Therefore, an accurate and rapid calibration method in the in-situ measurement is needed. In this paper, a novel calibration method for stereo vision system is proposed based on phase-based matching method and the bundle adjustment algorithm. As the camera is usually mechanically locked once adjusted appropriately after calibrated in lab, the intrinsic parameters are usually stable. We emphasize on the extrinsic parameters calibration in the measurement field. Firstly, the matching method based on heterodyne multi-frequency phase-shifting technique is applied to find thousands of pairs of corresponding points between images of two cameras. The large amount of pairs of corresponding points can help improve the accuracy of the calibration. Then the method of bundle adjustment in photogrammetry is used to optimize the extrinsic parameters and the 3D coordinates of the measured objects. Finally, the quantity traceability is carried out to transform the optimized extrinsic parameters from the 3D metric coordinate system into Euclid coordinate system to obtain the ultimate optimal extrinsic parameters. Experiment results show that the procedure of calibration takes less than 3 s. And, based on the stereo vision system calibrated by the proposed method, the measurement RMS (Root Mean Square) error can reach 0.025 mm when measuring the calibrated gauge with nominal length of 999.576 mm.     

基于大数据分析的移动对象轨迹预测方法

对移动对象的轨迹预测将在移动目标跟踪识别中具有较好的应用价值。移动对象轨迹预测的基础是移动目标运动参量的采集和估计,移动目标的运动参量信息特征规模较大,传统的单分量时间序列分析方法难以实现准确的参量估计和轨迹预测。提出一种基于大数据多传感信息融合跟踪的移动对象轨迹预测算法。首先进行移动目标对象进行轨迹跟踪的控制对象描述和约束参量分析,对轨迹预测的大规模运动参量信息进行信息融合和自正整定性控制,通过大数据分析方法实现对移动对象运动参量的准确估计和检测,由此指导移动对象轨迹的准确预测,提高预测精度。仿真结果表明,采用该算法进行移动对象的运动参量估计和轨迹预测的精度较高,自适应性能较强,稳健性较好,相关的指标性能优于传统方法。     

Camera calibration based on paraxial raytracing

Traditional camera calibration is based on the pinhole model, which is an approximation algorithm using untrue geometrical assumptions and giving a single lumped result for the multiple optical elements in a camera. To provide an alternative method of camera calibration, we extend the traditional 2×2 matrix-based paraxial raytracing method to 6×6 in order to trace paraxial rays by using the first-order Taylor series expansion of Snell’s laws. Then we establish the geometric relationship between images and objects. Compared with the Snell’s Law camera calibration model of our previous work, the paraxial model offers explicit analytical sensitivity analysis for the mathematical manipulation of problematical conditions. Compared with the existing pinhole model, the proposed method, in addition to five intrinsic and six extrinsic parameters, gives the position parameters of each optical element of the camera system.     

基于十字靶标的双目立体测量系统标定

提出了一种基于十字靶标的双目立体测量系统标定方法。采用多视图几何约束和光束平差优化精确获得两相机内参数,同时得到在两相机各自坐标系下重建出的靶点三维坐标点集;由两组三维点集之间的刚体变换直接求得系统外参数。该方法只需双相机同时对十字靶标拍摄一次,再由两相机单独拍摄若干幅靶标图像即可,现场操作简单灵活。在标定结果的基础上,对长度为611.800mm的标尺进行多次测量,平均值为611.776mm,标准差为0.030mm。     

Real-time camera pose estimation based on volleyball court view

The use of technology in sports has increased in recent years. One of the most influential of these technologies is referee support systems. Team sports such as volleyball require accurate and robust tracking systems that do not affect either the players or the court. This paper introduces the application of intrinsic and extrinsic camera calibration in a 12-camera volleyball referee system. Intrinsic parameters are calculated by using the classic pinhole model and Zhang’s method. To perform extrinsic calibration in real time, the volleyball court is treated as a global calibration artifact. Calibration keypoints are defined as court-line intersections. In addition, a new keypoint detection algorithm is proposed. It enables achievement of an accurate camera pose in regard to the court. With all 12 cameras calibrated in a common coordinate system, a dynamic camera stereo pair creation is possible. Therefore, with known ball 2D image coordinates, the 3D real ball coordinates can be reconstructed and the ball trajectory can be estimated. The performance of the proposed method is tested on a synthetic data set, including 3Ds Max rendering and real data scenarios. The mean camera pose error calculated for data biased with keypoint detection errors is approximately equal to 0.013% of the measurement volume. For the real data experiment with a human hand phantom, it is possible to determine the presence of the human phantom on the basis of the ball reflection attitude.     

基于特征匹配的快速鲁棒数字稳像

针对手持移动摄像装置拍摄视频序列相邻帧间存在平移、小角度旋转运动,而且易受噪声、光照变化的影响等问题,提出一种基于优化Oriented FAST and rotated BRIEF(ORB)特征匹配的实时鲁棒电子稳像算法。对相邻帧预处理后用Oriented FAST算子检测特征点,再用Rotated BRIEF描述提取的特征点并采用近邻汉明距离匹配特征点对,然后采用级联滤波去除误匹配点对,最后使用迭代最小二乘法(ILSM)拟合模型参量进行运动补偿实现稳像。图像匹配测试和稳像实验结果表明:基于改进的ORB算法的电子稳像方法补偿每一帧的时间均小于0.1 s,定位精度可达亚像素级,能有效补偿帧间平移旋转运动,而且对噪声和光照变化有较强鲁棒性。经稳像处理后,实拍视频质量明显提高,峰值信噪比（PSNR）平均提高了10 db。     

目标跟踪与定位中的视觉标定算法研究

目标跟踪与定位中的一个重要步骤就是摄像机标定,其目的是估计摄像机的外部和内部参数。在严格的几何约束关系之上建立准确的数学模型,提出一种快速得到摄像机中心的方法,然后通过合理的求解次序获得其他摄像机参数,保证了标定参数的精度。利用计算出来的标定参数校正失真图像中的各个像素位置以重新得到像素间原来的空间关系,从而产生精确的不失真图像,并且利用摄像机标定参数对标定模板上的点进行位置计算后,再和实际位置比较进行检验。图像的校正效果实验以及精度验算的结果表明：提出的算法得到了准确可靠的标定参数,和其他算法相比有效提高了精度,能够满足运动跟踪时目标特征位置估计的精度要求。