基于二进制条纹加相位编码条纹离焦投影的三维测量方法

复杂表面的精密三维测量在工业无损检测中非常重要。二进制条纹离焦投影方法在快速三维测量中有重要的应用前景,但该方法难以实现复杂表面高精度三维测量。为此,提出了基于二进制条纹加相位编码条纹离焦投影的三维测量方法。由于离焦投影滤除了高次谐波和高频噪声,可以克服投影仪的非线性伽马效应,与传统投影正弦条纹方法相比,提高了其测量精度。针对离焦投影时,随着相位编码条纹频率增大,条纹级次判决困难,出现周期错位,导致相位解包裹出错,提出了相移编码方法来解决以上问题。采用相移编码方法校正周期错位,使条纹级次判决准确,进一步提高其测量精度。实验结果表明,其测量精度可以达到0.044 mm,验证了本方法的有效性和实用性。     

Removing harmonic distortion of measurements of a defocusing three-step phase-shifting digital fringe projection system

Binary defocusing method was adopted in 3D profilometry as it allows real-time measurement and does not need to handle the luminance nonlinearity of a projector. Current patch-based binary fringe patterns are periodic and carry strong harmonic distortion as compared with the ideal sinusoidal fringe patterns, which affects the measuring performance remarkably. In this paper, we propose a framework for generating aperiodic fringe patterns based on optimized patches. The produced fringe patterns can significantly lower the noise floor and suppress the harmonic distortion in the constructed phase map. Accordingly, the achieved depth measuring performance can be significantly improved. Special care is also taken during the optimization of the patches in our framework such that the depth measuring performance is robust to fringe period and defocusing extent.     

Pulse-width modulation in defocused three-dimensional fringe projection

Shape measurements by fringe projection methods require high-quality sinusoidal fringes. We present a sinusoidal fringe generation technique that utilizes slightly defocused binary fringe projection. The proposed method is a spatial version of the well-known pulse-width modulation (PWM) technique of electrical engineering. PWM is easy to implement using off-the-shelf projectors, and it allows us to overcome the gamma problem (i.e., the nonlinear projector response) in the output light intensity. We will demonstrate that, with a small defocusing level--lower than with other techniques proposed in the literature--a high-quality sinusoidal pattern is obtained. Validation experiments using a commercial video projector are presented.     

Optimized dithering technique in frequency domain for high-quality three-dimensional depth data acquisition

On the basis of the objective functions, dithering optimization techniques can be divided into the intensity-based optimization technique and the phase-based optimization technique. However, both types of techniques are spatial-domain optimization techniques, while their measurement performances are essentially determined by the harmonic components in the frequency domain. In this paper, a novel genetic optimization technique in the frequency domain is proposed for highquality fringe generation. In addition, to handle the time-consuming difficulty of genetic algorithm(GA), we first optimize a binary patch, then join the optimal binary patches together according to periodicity and symmetry so as to generate a full-size pattern. It is verified that the proposed technique can significantly enhance the measured performance and ensure the robustness to various amounts of defocusing.     

Fringe contrast-based 3D profilometry using fringe projection

Quality-guided algorithm is a widely used method in phase unwrapping. This paper shows an accurate quality map based on fringe contrast for 3D shape measurement. Phase-shifted fringe patterns are projected onto an object surface by a programmable liquid crystal projector and recorded by a CCD camera. A wrapped phase map and a fringe contrast map are extracted from the deformed fringe patterns by the phase-shifting technique. Guided by the contrast map, the quality-guided unwrapping algorithm minimizes unwanted shadow and non-uniform surface reflectance effects and is able to retrieve a correct surface profile. Validity of the proposed method is tested on a fish model and a cutting tool specimen.     

基于双声光偏转器的变频三维数字成像

提出了一种基于双声光偏转器的时序变频三维数字成像系统.此系统可以实时产生并投射具有不同空间频率的条纹结构光序列照明被测物体,可以以视频速率完成任意形状物体的三维传感.整体系统采用全固态结构,无任何机械运动部件,具有高精度、全场测量、动态可编程、普适性好等特点.给出了该三维数字成像系统对一个台阶状物体形貌测量的应用实例.结果证明DAOP对于解决具有复杂几何形状或拓扑结构物体的三维形貌测量问题是一种有效技术.     

Calibration method for fringe projection profilometry with a binary defocusing technique

A novel and simple calibration method for fringe projection profilometry with a binary defocusing technique is proposed and verified by experiments. This paper theoretically presents the principle that the one-to-one mapping servers as spatially invariant to environment in the phase domain when the projector is defocused. In terms of this principle, only two reference planes are introduced in the volume of projector defocusing (the measured volume) to specify one constraint, i.e., the emitted light beams, which are determined by the sub-pixel homologous pairs from the measured object to the reference planes in the phase domain. The nonlinear camera model is utilized to define the other constraint, i.e., the reflected light beams. Then, combining these two constraints will calibrate the 3D information of the measured object. It is pointed out that the proposed method does not require the calibration of the projector. Experiments demonstrate the performance of our proposed approach: the measurement accuracy can reach about 0.0916 mm with the binary defocusing technique.     

基于液晶显示投影技术的数字影栅云纹相移实现方法

影栅云纹是物体离面变形和表面形貌测量常用的一种比较简单的方法,用单纯的影栅云纹法即便在最好的光学系统配置情况下测量精度也只有1~100μm左右,在影栅云纹测试方法中引进相移技术是提高测量精度的主要手段。采用液晶投影仪和数字图像处理技术实现数字影栅云纹测量的准确数字相移,避免了在影栅云纹法中使用结构比较复杂或特制的相移机构。由计算机产生相移条纹图经液晶显示投影,应用实时图像灰度算术相减技术得到数字相移影栅云纹条纹图。该方法具有“基准栅”的栅距和相移步长实时可调,配置高速图像采集系统和图像后处理软件,可将相移技术引入动态测量中,从而提高动态测量的精度的优点。最后的悬臂梁实验结果证实了该方法的有效性。     

基于梯形与正弦相移算法的非线性误差校正北大核心CSCD

相移轮廓术是一种广泛使用的光学三维测量方法,其精度不仅受相位展开算法本身的影响,也受测量系统中投影仪和摄像机的非线性影响。理论上,投射更多的相移条纹可减弱非线性误差的影响,但是增加了测量时间。为了提高误差校正的效率,提出了一种基于梯形正弦相移的测量方法。该方法需要两组改进的梯形相移条纹和一幅正弦条纹。梯形条纹提供图像强度信息和条纹级次信息,图像强度信息用来求取系统的非线性响应曲线,进一步消除系统的非线性。正弦条纹经过希尔伯特变换可求得额外的条纹图像,用来计算截断相位信息。经过校正的截断相位信息,可进一步获取精度较高的三维信息。相较于先前的梯形与正弦误差校正方法,该方法的测量效率提高了28%。     

Absolute phase recovery in structured light illumination systems: Sinusoidal vs. intensity discrete patterns

Structured light illumination is a well-established technology for noncontact 3D surface measurements. A common challenge in those systems is to obtain the absolute surface information using few measurement frames. This work discusses techniques based on the projection of multiple sinusoidal fringe patterns with different fringe period, as well as the projection of intensity discrete Gray Code and grey-level coded patterns. The use of sinusoidal multi-frequency techniques has been since years an on-going area of research, where various algorithms have been developed based on beats, look-up tables, or number-theoretical approaches. This work shows that a related technique, the so-called algebraic reconstruction technique that is borrowed from the area of multi-wavelength interferometry can be used for this purpose. This approach provides a robust analytical solution to the phase-unwrapping problem. However, this work argues that despite these advances, the acquisition of additional phase maps obtained with different fringe periods requires too many measurement frames, and hence is inefficient. Motivated by that, this work proposes a new grey level coding scheme that uses only few measurement frames, overcomes typical defocus errors, and has an error detecting feature. The latter feature makes the need of separate error detecting algorithms obsolete. This so-called closed-loop space filling curve can be implemented with an arbitrary number of N grey-levels enabling to code up to (2N) code-words. The performance of this so-called closed-loop space filling curve is demonstrated using experimental data.     

Single fringe projection profilometry based on sinusoidal intensity normalization and subpixel fitting

A novel fringe projection profilometry using a single sinusoidal fringe pattern projected is proposed. Computer-generated sinusoidal fringe and uniform intensity patterns are firstly projected on a testing object by a liquid crystal display projector. The variable reflection intensity of a fringe pattern is then roughly normalized by division operation applied to the grabbed fringe and uniform intensity patterns projected. Fringe intensity is further normalized by employing an interpolation algorithm. The deformed sinusoidal pattern encoding object shape is converted to a wrapped phase map without using phase-shifting or Fourier transform. Computer simulation and experimental performance are evaluated to demonstrate the validity of the proposed method. The experimental results compared with those of the four-step phase-shifting and fast Fourier transform methods are also presented.     

Superfast 3D absolute shape measurement using five binary patterns

This paper presents a method that recovers high-quality 3D absolute coordinates point by point with only five binary patterns. Specifically, three dense binary dithered patterns are used to compute the wrapped phase; and the average intensity is combined with two additional binary patterns to determine fringe order pixel by pixel in phase domain. The wrapped phase is temporarily unwrapped point by point by referring to the fringe order. We further developed a computational framework to reduce random noise impact due to dithering, defocusing and random noise. Since only five binary fringe patterns are required to recover one 3D frame, extremely high speed 3D shape measurement can be achieved. For example, we developed a system that captures 2D images at 3333 Hz, and thus performs 3D shape measurement at 667 Hz.     

A novel fringe adaptation method for digital projector

Aimed to obtain high-quality sinusoidal fringe projection, a new method to correct the output fringe of digital projector is presented. The method is based on the proposed fringe transform model, which describes the relationship of the input and output fringe pattern. Firstly, a series of fringe patterns are projected and from the fringe images, the transform function is calculated by the pattern shifting method. At last, by modifying the input fringe pattern, a standard sinusoidal output fringe can be achieved. Different from the previous methods, the waveform nonlinearity is estimated by varying the intensity of the projected fringe pixel by pixel; thus the waveform nonlinearity can be estimated precisely and the time cost is considerably reduced. Experimental results show that by modification of the input projection patterns the projector can project fringe with high-quality sinusoidal waveform leading to high performance of the projection system.     

Improved intensity-optimized dithering technique for 3D shape measurement

The recently proposed optimized dithering techniques are able to improve measurement quality obviously. However, those phase-based optimization methods are sensitive to the amount of defocusing while intensity-based optimization methods cannot reduce the phase error efficiently. This paper presents a novel method, minimizing a proposed objective function named intensity residual error (IRE), as well as a novel framework, optimizing pixels group by group, to construct binary patterns for high-quality 3D shape measurement. Both the simulation and experimental results show that this proposed algorithm can achieve phase quality improvements over other recently optimized dithering techniques with various amounts of defocusing.     

Background and amplitude encoded fringe patterns for 3D surface-shape measurement

This paper presents a new fringe projection method for surface-shape measurement that uses background and amplitude encoded high-frequency fringe patterns. The background and amplitude, combined as a codeword, identify the wrapped phase fringe order to partially unwrap the phase to a low frequency. The low-frequency wrapped phase map is then directly used to reconstruct the surface based on geometry constraints without requiring additional images as in other temporal phase-unwrapping methods. Measurements performed on a double-hemisphere, mask, and manikin head, using projected fringe patterns with 48 periods, demonstrated the ability of the method to perform 3D shape measurement with only four projected patterns and captured images, using a single camera and projector.     

单幅彩色条纹投影的不连续物体表面三维形貌测量

提出了基于单幅彩色条纹投影的不连续物体及动态三维形貌的测量方法。该方法利用计算机产生一幅正弦条纹图和两幅单一强度图分别通过红蓝绿三个通道合成为一幅彩色条纹图,由液晶投影仪投影到被测物体表面,彩色CCD采集变形条纹图并保存在计算机中。通过三色分离,同时获得正弦条纹图和反映表面反射率分布及背景信息图,通过图像除法运算及亚像素精度归一化处理实现物体三维形貌的恢复。对于表面形貌不连续的物体,利用蓝色分量的灰度图像进行二值化处理定位阴影或暗背景,从而引导正确的相位求解。实验验证了该方法对不连续物体动态测量方面的可行性。     

Fringe pattern analysis by S-transform

S-transform proposed in 1996 by Stockwell R.G is a simple and popular technique for the time–frequency analysis. It has been introduced in optical three-dimensional shape measurement, recently. In this paper, a study about applications of S-transform in the demodulation of deformed fringe patterns is performed. We focus on discussing not only the S-transform spectrum filtering technique, the S-transform ridge technique and the phase gradient calculation method based on S-transform used in fringe pattern demodulation, but also the phase unwrapping technique. In addition, a generalized S-transform was introduced to analyze fringe patterns, which is helpful to improve the measurement accuracy and flexibility of the method based on S-transform. The reconstruction results based on S-transform were compared with that on wavelet transform and windowed Fourier transform in fringe analysis.     

Study on Fourier transforms profilometry based on bi-color projecting

Projecting a bicolor sinusoidal fringe pattern consisting of two interlaced RGB format base color fringe patterns with π phase difference onto an object thought digital light projector, we can capture a deformed color pattern by color digital camera, then decode two individual sinusoidal fringe patterns with π phase difference by color-separating technique. Accessing these two fringe patterns, not only are zero-order spectra eliminated, but mask function is also built to mark valid unwrapping area in FTP, automatically.Moreover, because the wrapped phase just inside the valid areas is needed unwrapping, we can mark these areas with mask function, which avoids the error transferring resulting from unwrapping the invalid areas and shortens the unwrapping time. Furthermore, in Fourier transform processing, the full-field deformed fringe pattern generally needed to guarantee measurement precision can be formed by expanding non-full-field fringe pattern captured using the mask function.     

Optimal pulse width modulation for sinusoidal fringe generation with projector defocusing

Recently, a study showed that generating sinusoidal fringe patterns by properly defocusing binary ones can significantly simplify three-dimensional shape measurement system development and drastically improve its speed. However, when the fringe stripes are very wide, it is very difficult for this technique to achieve high-quality measurement. This Letter presents a method to improve this technique by selectively eliminating high-frequency harmonics induced by a squared binary pattern. As a result, better sinusoidal fringe patterns can be generated with a small degree of defocusing even for wide fringe stripes. Simulation and experiments will be presented to verify the performance of this proposed technique.     

一种三维数字成像系统的多视点姿态估计方法

为校准多视场深度数据,提出基于条纹投影的三维数字成像系统的多视点姿态估计方法。该方法至少在两个视点分别向被测物体投射出一组正交条纹图,利用条纹投影和相位重建技术,将相位图映射为物体的三维空间坐标。进而,利用投影仪的投射过程是摄像机成像过程的逆过程,建立投影仪的投射平面和摄像机的成像平面的对应关系,将“极线几何约束”应用到基于条纹投影的主动三维视觉的姿态估计问题,并在考虑测量数据受噪声影响的条件下,建立了求解视点姿态参量的数学模型。通过优化求解非线性方程可以获得多视点的姿态估计参量。所设计的实验及结果证明了所提出方法的有效性。