利用结构光进行三维测量的新方法

提出一种利用三维图像实验三维标定的测量方法。用增行光投射光栅,使之产生一系列相互平行的光切面,这些光切面投射到物体表面之后,在物体表面形成一系列的光条。我们利用Ｈｅ－Ｎｅ激光器产生的激光实验ＣＣＤ测头的定位和光条的识别,从而实现编码。编码后的图像经过细化、边界提取等处理后可以进行接下来的计算工作。由于我们是利用一幅图像来提取三维信息,从推导提取等处理后可以进行接下来的计算工作。由于我们是利用一幅图     

3D surface topography from the specular lobe of scattered light

Scattered light from a surface contains a huge amount of information including surface slope, roughness, pattern, texture, etc. In this paper, the relationship between the intensity distribution of scattered light from a surface and the 3D surface topography will be investigated. From the geometrical point of view the intensity distribution of scattered light from a surface may be modelled with three components, the specular spike, specular lobe and diffuse lobe. In the situation when light is scattered from a relatively smooth surface whose roughness is much larger than the wavelength of the incident light, the scattered light intensity distribution will consist of only a diffuse lobe and a specular lobe, which are well described by a combination of the Lambertian and Torrance–Sparrow geometrical models. Based on the light scattering phenomenon, in this paper a scanning method capable of measuring the 3D surface topography with 500 mm scanning width, high scanning speed, and micron resolution is presented. The 3D topography measurement is implemented by using a linear photodiode array to measure scattered light intensity distribution at different angles against the surface normal. Then the specular lobe of the scattered light will be extracted at each scanning point to calculate the surface normal distribution. Sequentially, the 3D surface topography is obtained by using gradient integration techniques.     

基于彩色栅线的结构光动态三维测量技术研究

结构光动态三维测量能够实现运动或者变形物体型面重构。将6色3次伪随机条纹序列的色彩信息溶入亮度呈余弦周期性变化的数字栅线图中,构成彩色栅线空域编码图案。图像解码采用仿视觉过程。在直觉处理阶段,通过亮度峰值与对应的色彩信息来实现周期划分;在专注处理阶段,通过局部亮度变化关系来进行空域解相。实验结果证明,测量系统只需投影单幅图案即可实现物体形貌的三维重构,可满足动态测量的要求,结合亚像素匹配可保证一定的测量精度,能形成多分辨率测量。     

应用神经网络的复杂物体三维测量

将神经网络引入基于结构光投影的复杂物体三维面形测量。在测量过程中,利用神经网络强大的函数逼近能力,得到离散条纹图的连续逼近函数,从中解出物体的相位分布信息,获得物体的三维面形分布。应用神经网络方法,在结构光投影条件下,只需要获取一幅条纹图,便可以完成复杂物体的三维面形测量。该方法相比传统的傅里叶变换轮廓术,不存在滤波操作,不会在测量过程中丢失被测物体的高频分量,具有更高的空间带宽积和灵敏度,能准确测量出复杂物体的细节,更加适用于恢复复杂物体的三维面形。并且该方法在条纹图存在阴影的情况下与傅里叶变换轮廓术相比,能更好地提取出物体的相位信息,恢复物体的三维面形。模拟及实验均验证了该方法的可行性。     

Robust geometric,phase and colour structured light projection system calibration

This paper introduces a new comprehensive procedure for both geometric and colour calibration of structured light system. In order to perform both geometric and colour calibration procedure, a new calibration artifact is proposed. The intrinsic and extrinsic parameters of projector and camera are estimated by using an extended pinhole camera model with a tangential and radial distortion. Camera image plane coordinates are obtained by extracting features from images of a calibration artifact. Projector image plane coordinates are calculated on the basis of continuous phase maps obtained from a fringe pattern phase reconstruction procedure. In order to stereo calibrate camera-projector system, pairs of corresponding image plane points are calculated with subpixel accuracy. In addition, one of three pattern views is used in colour calibration. RGB values of a colour field pattern detected by camera and their reference values are compared. This comparison leads to derivation of a colour transformation matrix. The performance of the proposed method is tested by measuring plane, sphere and distance reference. Also 360 degrees complex object 3D model from a set of measurements is obtained. Residual mean errors for all tests performed are calculated.     

Anti-spoof touchless 3D fingerprint recognition system using single shot fringe projection and biospeckle analysis

Fingerprint is a unique, un-alterable and easily collected biometric of a human being. Although it is a 3D biological characteristic, traditional methods are designed to provide only a 2D image. This touch based mapping of 3D shape to 2D image losses information and leads to nonlinear distortions. Moreover, as only topographic details are captured, conventional systems are potentially vulnerable to spoofing materials (e.g. artificial fingers, dead fingers, false prints, etc.). In this work, we demonstrate an anti-spoof touchless 3D fingerprint detection system using a combination of single shot fringe projection and biospeckle analysis. For fingerprint detection using fringe projection, light from a low power LED source illuminates a finger through a sinusoidal grating. The fringe pattern modulated because of features on the fingertip is captured using a CCD camera. Fourier transform method based frequency filtering is used for the reconstruction of 3D fingerprint from the captured fringe pattern. In the next step, for spoof detection using biospeckle analysis a visuo-numeric algorithm based on modified structural function and non-normalized histogram is proposed. High activity biospeckle patterns are generated because of interaction of collimated laser light with internal fluid flow of the real finger sample. This activity reduces abruptly in case of layered fake prints, and is almost absent in dead or fake fingers. Furthermore, the proposed setup is fast, low-cost, involves non-mechanical scanning and is highly stable.     

基于传像束的小视场双目结构光三维形貌恢复

提出基于传像束传像和双目结构光相结合的三维测量系统,实现对无法直接成像场景,如爆轰、冲击等环境下的小视场物体三维面形测量.测量时,结构光直接投影到待测物体表面,变形条纹图像首先被成像到传像束前端面,再被传递到传像束后端面,并最终被成像到相机像平面,再由三频相位展开技术计算出对应相位分布后,即可根据双目匹配计算出待测物体...     

Stereophotogrammetric 3D shape measurement by holographic methods using structured speckle illumination combined with interferometry

We present a unique combination of the numerical three-dimensional (3D) reconstruction of the shape of an object with interferometric deformation measurements. Two cameras record several holograms of an object that is illuminated by structured illumination. This illumination is realized by speckle patterns. To improve the image quality, an inplace speckle reduction technique is combined with the structured illumination to reduce the effect of disturbing subjective speckles which appear in the reconstructed images. Stereophotogrammetric methods are applied to extract the 3D surface information of the object out of the reconstructed images. Since the recording is done by holography and because stereophotogrammetry enables a pointwise correlation between the two views, it is possible to combine other holographic techniques with the reconstructed 3D shape. This is demonstrated by an interferometric deformation measurement of an object cooling down. The resulting interferometric fringes are mapped onto the reconstructed 3D surface. Hence, the proposed method enables automatic and dense matching of interferometric fringe-maps recorded by spatially separated holograms onto the surface of the object, which has not yet been realized by existing techniques.     

放疗3D剂量验证系统中光场相机点扩散函数获取

基于闪烁光场成像的放疗新型3D剂量测量中,需利用点扩散函数将每一个二维平面的真实闪烁光数据从重叠图像中提取出来.利用刀口法,结合光场数字重聚焦以及聚焦测距法,实验获取光场相机不同重聚焦位置处的点扩散函数,并给出棋盘格标定板在参数α=0.6时的重聚焦面聚焦在α=0.7位置处的高斯离焦点扩散函数表达式,研究光场相机点扩散函...     

无需系统标定的三维视觉重建北大核心CSCD

为了解决传统三维重建需要依赖系统标定信息的问题,提出了一种基于相位图的不需要系统标定信息的三维视觉重建算法。首先使用结构光测量技术获得被测物体表面的相位图,再利用相位图的横向和纵向空间扭曲特性计算物体表面相对深度信息,最后实现被测物体的三维视觉重建。这种方法可以用在无法进行标定或无法获取标定信息的场合。实验结果表明,当被测物体表面结构简单时,这种方法的三维视觉重建效果较好。并通过对比传统三维重建结果验证了该方法的有效性。     

Pixel-by-pixel absolute phase retrieval using three phase-shifted fringe patterns without markers

This paper presents a method that can recover absolute phase pixel by pixel without embedding markers on three phase-shifted fringe patterns, acquiring additional images, or introducing additional hardware component(s). The proposed three-dimensional (3D) absolute shape measurement technique includes the following major steps: (1) segment the measured object into different regions using rough priori knowledge of surface geometry; (2) artificially create phase maps at different z planes using geometric constraints of structured light system; (3) unwrap the phase pixel by pixel for each region by properly referring to the artificially created phase map; and (4) merge unwrapped phases from all regions into a complete absolute phase map for 3D reconstruction. We demonstrate that conventional three-step phase-shifted fringe patterns can be used to create absolute phase map pixel by pixel even for large depth range objects. We have successfully implemented our proposed computational framework to achieve absolute 3D shape measurement at 40 Hz.     

结构光编码的MATLAB程序优化设计

结构光编码在光学非接触三维测量中是一种重要的图像编码方法。因为它要对多幅图像中的对应像素点进行处理,数据量很大,循环运算次数很多,因而通常是在代码执行效率较高的VisualC++上实现。由于VisualC++编程和调试都比较困难,所以不是一种理想的研究平台。由于MATLAB具有很强的矩阵运算、信号处理、数据分析、图像处理和显示等功能,应用和扩展方便简单,因而MATLAB是理想的结构光编码研究平台。尝试在MATLAB中实现高效的结构光编码算法,用向量化代替常规的循环判断,使程序运行效率提高较大,进而与其它部分一起组合成为统一、方便、快速和灵活的与结构光编码相关的光学无接触三维测量研究平台。     

3D multi-directional sensor with pyramid mirror and structured light

Structured-light-based 3D multi-directional sensors are widely used due to their flexible field of view (FOV), which is a significant benefit. Nevertheless, existing 3D multi-directional sensors based on linear lasers are only capable of measuring a slice of a 3D scene at low resolution. In addition, other 3D multi-directional sensors are capable of measuring 3D scenes by shooting 2D structured light patterns in different directions through curved mirrors. However, the projected and captured structured light patterns are blurred due to the optical aberration property of curved mirrors, resulting in inaccurate 3D reconstruction. This paper proposes a 3D, high-resolution, high-accuracy, real-time multi-directional sensor that utilizes pyramid mirrors to decompose the FOVs into different directions and reduce the optical aberration phenomenon. The mathematical model of the 3D sensor is presented, and the FOV is analyzed. A dual-frequency phase-shifting fringe pattern is used for 3D reconstruction in real time. Moreover, the sensor is calibrated using a planar circle calibration gauge and the Householder reflection constraint. Finally, the experimental results demonstrate that the measurement error of the 3D multi-directional sensor is less than 1 mm and 0.03 rad, thus verifying the method's feasibility.     

基于单目视觉和圆结构光的目标姿态测量方法

为解决实际工程中无法在被测目标表面设置固定特征来配合单目视觉系统实现目标姿态测量的难题,将圆结构光源引入单目视觉系统中。通过建立圆结构光的视觉姿态测量模型,提出了一种基于单目视觉和圆结构光的目标姿态测量方法。利用图像处理获取不同姿态下目标表面的结构光光条图像的数学参数;然后将其输入到姿态测量算法中,得到目标表面结构光光条的法向量;最后利用目标表面的参考点与结构光光条中心之间的距离约束关系确定唯一解。实验结果表明,该方法有效可行,测量误差平均在0.5°以内,更便于机器人抓取等工程领域的应用。     

基于数字微镜器件的自适应高动态范围成像方法及应用

在结构光三维扫描测量中,强反射表面因编码结构光照射后易产生局部镜面反射的特性,引起相机曝光饱和,淹没了所要检测的表面几何特征信息.为解决强反射表面的视觉成像难题,基于数字微镜器件(digital micromirror device,DMD)具有调制入射光线空间信息的特性,本文提出一种基于DMD的自适应高动态范围成像方法.设计与搭建了一套新型可编程的计算成像系统,建立其光学系统模型,并实现了DMD微镜与CMOS像素的匹配与映射;分析了基于逐像素编码曝光的高动态范围成像原理,并设计了基于DMD的光强编码控制算法,实现对入射光线强度的自适应精确调制,从而使进入成像系统中的入射光强始终处于相机的合适曝光强度内.实验表明:该方法突破了普通数字相机的动态范围限制,能够精确地控制被测强反射表面各个区域的入射光线强弱,并实现了对强反射表面的局部过曝光区域的清晰成像.该研究成果将为从根源上解决强反射表面因局部过曝光造成的三维点云缺失问题提供重要的解决方案.     

相干X射线衍射成像三维重建的数字模拟研究

利用相干X射线衍射成像“过采样”采集样品的远场相干衍射图样, 结合相位重建迭代算法重建物空间样品信息. 三维重建过程中, 边界约束条件是相位重建算法中最为关键的部分. 本文采用数字模拟的方法, 利用灰度值图像作为物空间的样品, 研究并实现了边界条件的自动寻找, 重建结果显示比以往采用较“松”的边界约束更为精确. 利用噪声模拟方法, 研究了衍射图样中不同噪声类型的滤除对重建结果的影响. 研究发现传统的去噪方法在高噪声情况下不能直接应用于相干X射线衍射成像, 并找到了适用于相干X射线衍射成像噪声滤除的有效方法. 研究表明, 此方法能非常有效地降低噪声对重建结果的影响. 利用模拟三维纳米金颗粒作为样品, 完成了对纳米金颗粒中电子密度分布的三维重建, 在有随机噪声的影响下, 也得到了很好的重建结果, 并找到了成功实现三维重建的噪声限为信噪比不低于27. 关键词： X射线相干衍射成像 过采样 三维相位重建 显微成像     

基于圆结构光照明和LED照明相结合的三维检测技术

针对孔内表面的检测问题,提出了一种新的基于结构光照明和LED照明相结合的三维检测技术。该方法主要包括三个步骤:首先通过圆结构光照明获取孔内表面的截面轮廓图像,并通过图像处理和系统标定得到当前截面上局部区域的深度值;然后通过平面光照明得到孔内表面的平面图像,并在分析成像关系的前提下,在对平面图像进行坐标变换后得到孔内表面的展开图像,结合图像处理算法,提取展开图像的局部区域的平面尺寸信息;最后将圆结构光数据和LED光源数据变换到同一全局坐标系下,得到内表面的三维信息。     

X射线光场成像技术研究

X射线三维成像技术是目前国内外X射线成像研究领域的一个研究热点.但针对一些特殊成像目标,传统X射线计算层析(CT)成像模式易出现投影信息缺失等问题,影响CT重建的图像质量,使得CT成像的应用受到一定的限制.本文主要研究了基于光场成像理论的X射线三维立体成像技术.首先从同步辐射光源模型出发,对X射线光场成像进行建模;然后,基于光场成像数字重聚焦理论,对成像目标场在深度方向上进行切片重建.结果表明:该方法可以实现对成像目标任一视角下任一深度的内部切片重建,但是由于光学聚焦过程中的离焦现象,会引入较为严重的背景噪声.当对其原始数据进行滤波后,再进行X射线光场重聚焦,可以有效消除重建伪影,提高图像的重建质量.本研究既有算法理论意义,又可应用于工业、医疗等较复杂目标的快速检测,具有较大的应用价值.     

一种符号阵列编码结构光三维检测方法

编码结构光检测技术是一种主动视觉方法,利用投射的模式光,通过三角原理获得深度信息。根据伪随机阵列的特性,提出了一种可用于检测场景目标的一次投射模式的结构光三维检测方法。符号的拐点、交叉点比传统的基于伪随机序列及M阵列模式提供了更多的检测点。符号阵列能够提供足够多的码字使所有的子模式获得全局唯一性。基于符号链分解算法及角度变化的轮廓特征,解码方法能够识别绝大多数码字。重建实验表明可以对一定曲面变化的物体进行检测,并能重建其形廓。     

Improved matrix inversion in image plane parallel MRI

A new 3D parallel magnetic resonance imaging (MRI) method named Generalized Unaliasing Incorporating Support constraint and sensitivity Encoding (GUISE) is presented. GUISE allows direct image recovery from arbitrary Cartesian k-space trajectories. However, periodic k-space sampling patterns are considered for reconstruction efficiency. Image recovery methods such as 2D SENSE (SENSitivity Encoding) and 2D CAIPIRINHA (Controlled Aliasing In Parallel Imaging Results IN Higher Acceleration) are special instances of GUISE where specific restrictions are placed on the k-space sampling patterns used. It is shown that the sampling pattern has large impacts on the image reconstruction error due to noise. An efficient sampling pattern design method that incorporates prior knowledge of object support and coil sensitivity profile is proposed. It requires no experimental trials and could be used in clinical imaging. Comparison of the proposed sampling pattern design method with 2D SENSE and 2D CAIPIRINHA are made based on both simulation and experiment results. It is seen that this new adaptive sampling pattern design method results in a lower noise level in reconstructions due to better exploitation of the coil sensitivity variation and object support constraint. In addition, elimination of the non-object region from reconstruction potentially allows an acceleration factor higher than the number of receiver coils used.