BP neural network applied to 3D object measurement based on fringe pattern projection

In the fringe projection profilometry, the traditional triangle method, such as Fourier-transform profilometry (FTP), is difficult to recover the stepped shape object from the deformed fringe pattern. In order to solve this problem, the neural network is introduced to deal with this kind of fringe patterns and gain the three-dimensional (3D) information of the measured object. By training the network, the relationship between the deformed fringe pattern and the height of the object can be obtained, and thereby the height of the object can be obtained. Furthermore, the object can be reconstructed perfectly without knowing the optical parameters of the experiment system. An obvious merit of this network method is that it can recover the 3D object in a short time and only need one deformed fringe pattern. Computer simulations and experiment validate the feasibility of the method.     

Shifted-phase calibration for a 3-D shape measurement system based on orthogonal composite grating projection

This paper proposes a novel method for reducing measurement error caused by spectrum overlapping in orthogonal-composite-grating-based 3-D measurement method. For 3-D measurement systems based on orthogonal composite grating projection, spectrum overlapping causes phase of each deformed phase-shifting fringe changed differently, which violates the principle that the shifted phases between adjacent deformed fringes must be equivalent to 2π/3, and therefore results in phase measurement error. The proposed shifted-phase calibration method is based on that phase variation of each deformed fringe is independent of height and reflectivity of the measured object. Three composite gratings are projected on the reference plane, and each carrier channel includes three phase-shifting gratings needed in phase measuring profilometry (PMP). Because the adjacent phase-shifting fringes demodulated from the same carrier channel have the phase difference of 2π/3, we can respectively calculate the reference plane's phases of three carrier channels by the phase algorithm of PMP method, and the shifted phases between them are obtained. When an object is measured, the shifted phases between deformed phase-shifting fringes can be calibrated. A new 3-D measurement mathematical model is set to reconstruct object. Our experiments prove that the proposed method can effectively restrain the effect of spectrum overlapping and improve measurement accuracy almost one times.     

Dynamic 3-D shape measurement method based on FTP

In this paper, we propose a method for dynamic three-dimensional (3-D) shape measurement based on Fourier transform profilometry. A sequence of dynamic deformed fringe images can be grabbed by a CCD camera and saved on a disk rapidly. By a Fourier transform, filtering and inverse Fourier transform, a sequence of phase-maps can be obtained. By unwrapping these phase maps in 3-D phase space, we can obtain the shape of the dynamic object at different times. In this paper we also propose the algorithm of a phase difference between two deformed fringes, and the 3-D phase unwrapping method based on the phase difference algorithm. The computer simulation and experiment results show that this method can efficiently deal with the dynamic 3-D shape measurement.     

小波变换轮廓术的测量范围研究

利用小波“脊”处的小波系数来提取变形条纹中的相位信息可以在很大程度上抑制条纹图中有用的基频分量与零频和其它谐波频率分量的混叠,弥补了傅里叶变换轮廓术的不足。从离散信号频域分析角度,推导了变形条纹小波变换的频谱描述形式,讨论了其测量范围,包括结构条件和抽样条件。结果表明,只有在无周期内瞬时频谱混叠,即任意位置处物体瞬时高度变化满足h/xx=b<1/3条件时,和不存在抽样引起的周期间瞬时频谱混叠的抽样条件下(即一个周期内的抽样点数m≥4时),小波变换轮廓术才能正确恢复被测物体的三维面型。计算机模拟和实验验证了该结论。     

一种两步相移相位解算方法

提出一种将傅里叶与相移法结合的三维物体快速测量方法.通过时域提取精确的均值包络与频域滤波结合的方法预处理条纹,结合基于相位半角的两步相移,只需要两幅相移条纹图,即可得到精确的相位信息.通过仿真和实验将本文方法与现有方法进行了分析对比,实验结果证明,本文方法可以获得优于现有两步相移方法的准确度,一般测量环境下的均方根误差在3×10~(-3) rad以内.本文提出的方法对噪声和表面突变不敏感,具有鲁棒性好、运算速度快、准确度高等优点,在三维快速测量领域有较高的应用价值.     

简化的三维体轮廓测量术

基于直接条纺位移分析的三维测量具有简单，快速，精确的特点，本给出了该方法的光学调制和计算机解调原理，以及用该方法进行简单三维测量的主要步骤。     

A novel color fringe projection based Fourier transform 3D shape measurement method

A novel Fourier transform 3D shape measurement method based on color fringe projection is proposed in order to solve the spectrum overlapping and phase unwrapping problems existed in Fourier transform profilometry (FTP). The R and G components of the color fringe are set to two sinusoidal patterns with different frequencies and the B component is set to the average value of R or G component. Then this pattern is projected to the object and the deformed fringe image is captured. Three gray patterns are separated from the color fringe, the background and high frequency noise can be eliminated using our method and the accurate unwrapped phase can be got. Only one shot color pattern is projected to get the 3D information of the object. Experiment results show that the 3D information of an object can be obtained rapidly and accurately.     

3-D surface profilometry based on modulation measurement by applying wavelet transform method

A new analysis of 3-D surface profilometry based on modulation measurement technique by the application of Wavelet Transform method is proposed. As a tool excelling for its multi-resolution and localization in the time and frequency domains, Wavelet Transform method with good localized time-frequency analysis ability and effective de-noizing capacity can extract the modulation distribution more accurately than Fourier Transform method. Especially for the analysis of complex object, more details of the measured object can be well remained. In this paper, the theoretical derivation of Wavelet Transform method that obtains the modulation values from a captured fringe pattern is given. Both computer simulation and elementary experiment are used to show the validity of the proposed method by making a comparison with the results of Fourier Transform method. The results show that the Wavelet Transform method has a better performance than the Fourier Transform method in modulation values retrieval.     

Fourier transform profilometry: : a review

Fourier transform profilometry is one of the popular non-contact 3-D measurement methods, where a Ronchi grating or sinusoidal grating is projected onto a diffuse three-dimensional surface, and the resulting deformed grating image is detected by a CCD camera and processed by a computer. This method requires only one frame (or two frames) of the deformed fringe pattern in some algorithms to retrieve the surface of measured object, so it has obvious advantage for real time data acquisition and 3-D measurement of dynamic process. In this paper, we review some algorithms in FTP, discuss some important problems, including frequency spectra overlapping, phase unwrapping, sampling, and 3-D measurement of dynamic process. With the development of computer hardware and software and availability of high-resolution image grabber, FTP method will be a promising one for acquiring 3-D data of object, and more and more researchers pay attention to it.     

基于椭圆形光强分布光栅投影的三维面形测量方法

基于椭圆形光强分布光栅投影测量物体三维面形的方法,将椭圆形光强分布光栅投影到被测物体表面,用摄像机获取变形条纹图,通过系统参量和条纹图携带的相位信息求解出物体的三维面形.推导出通过椭圆形光强分布光栅条纹求解相位的计算公式并对提出方法作了计算机仿真.实验结果表明该方法可以比较准确地测量物体的三维面形,在噪音较大的情况下测量结果仍具有较高准确度.     

基于椭圆形光强分布光栅投影的三维面形测量方法

基于椭圆形光强分布光栅投影测量物体三维面形的方法,将椭圆形光强分布光栅投影到被测物体表面,用摄像机获取变形条纹图,通过系统参量和条纹图携带的相位信息求解出物体的三维面形.推导出通过椭圆形光强分布光栅条纹求解相位的计算公式并对提出方法作了计算机仿真.实验结果表明该方法可以比较准确地测量物体的三维面形,在噪音较大的情况下测量结果仍具有较高准确度.     

A flexible 3D profilometry based on fringe contrast analysis

This paper proposed a flexible 3D profilometry based on fringe contrast analysis. A series of sinusoidal fringes are projected on the surface of the testing object that is laid in front of the imaging plane of the fringes, and captured through a beam splitter by a CCD camera in the same direction as the axis of the projection. After the fringe contrast obtained using phase-shifting technique, the height of the object can be restored through searching the look-up table of the contrast and the height. In the measurement process, we only need to capture fringe patterns in one position, without changing the imaging plane of the fringes, so it is faster and more convenient than the existing method based on fringe contrast analysis. Our system is simple and flexible by reason of no special devices used. In this paper, the principle of this method, the setup of the measurement system and primary experiment results are given. The experimental results prove this method can restore the height of the complex object accurately and effectively.     

Fourier fringe processing using a regressive Fourier-transform technique

Since the introduction of a fourier fringe algorithm by Takeda, it has been possible to determine the phase of a particular light source impinging on an object from one sole image. This has led to applications in many whole field optical measurement techniques such as ESPI, holography, profilometry and so on. However, the basic processing technique, in case of the 2D-Fourier transform, is subject to a major drawback. Because this technique supposes periodicity in a fringe image, the so-called leakage effects occur. This gives rise to non-negligible errors, which can be resolved by using a regressive Fourier transformation technique. In the method introduced in this article, the fringe signal is represented by a model using sines and cosines where the frequency is not fixed (which is the case for classical FFT-techniques). The coefficients of those sines and cosines together with the frequency components are then estimated locally by means of a frequency domain system identification technique. This allows the fringe pattern to be unwrapped without any distortion. This method will be applied in particular to Fourier-transform profilometry (determines object geometry using shifts of projected fringes) although it can be used in any of the techniques mentioned above. Moreover, it will be shown that the proposed method can deal with other distortions that occur in practice such as over-modulation and varying fringe visibility. The proposed technique will be validated on both simulations and on a profile measurement of a pipe section.     

Modified fourier transform profilometry for the measurement of 3-D steep shapes

Analysing the principle of Fourier transform profilometry (FTP) for the measurement of 3-D object shapes and improved Fourier transform profilometry (IFTP) for the measurement of 3-D steep object shapes, the disadvantage of IFTP is discussed. Through the measurable slope of the height variation normal to grating line can be extended to nearly three times in IFTP, and phase-shift error is introduced. In this paper modified Fourier transform profilometry (MFTP) is described for the measurement of 3-D steep object shapes, which gets rid of the disadvantage of IFTP by utilizing the nature of FTP. The measuring precision and the measureable steepness can be ensured in this way.     

Discuss the measuring range of dual-frequency wavelet transform profilometry

We discuss the structure condition and sampling condition of wavelet transform profilometry (WTP) based on dual-frequency fringe pattern in this work. In the mentioned method a grating fringe with dual-frequency components is projected onto an object. And two wavelet ridge lines can be extracted by means of wavelet analysis, from which we can calculate two groups of wrapped phase information. Afterwards the retrieved phase with higher precision can be obtained through phase unwrapping process. However, it should be noted that the spectral aliasing of the deformed fringe pattern must be avoided in order to restore the correct phase information. And the two fringe carrier frequencies have to obey some rules as well. In this paper, the structure condition and sampling condition of the proposed method is deduced from the point of view of frequency analysis. It is proven that there would be no frequency overlapping in the deformed fringe pattern only when both of the two conditions mentioned previously are fulfilled. The results of computer simulations and experiments verify the validity of our theory.     

Gerchberg迭代法在三维面形测量中的应用

在基于结构光照明的三维面形测量中,针对有孤立区域物体的条纹图像存在不规则缺陷的问题,提出先对其进行Gerchberg迭代,消除或减少条纹缺陷,获取较完善的迭代条纹,然后再利用傅里叶变换轮廓术(FTP)重建面形。设计了迭代流程,并分析了影响迭代精度的因素,解决了光学加工用具磨盘表面不完善条纹Gerchberg迭代过程中存在的问题,成功地重建了磨盘的三维面形。该工作为表面存在孤立区域的被测物体三维面形测量提供了可供参考的技术方案,也给可实时形变的应力盘三维面形动态测量奠定了基础。     

Surface profile inspection of a moving object by using dual-frequency Fourier transform profilometry

The 2π phase ambiguity caused by surface isolations and large height step can be solved by dual-frequency projection grating profilometry. However, in the Fourier transform profilometry (FTP) of a moving object, only one single deformed fringe pattern can be obtained. In order to introduce the dual-frequency technique into the FTP of moving object, a novel experimental system is designed to capture two fringe patterns with different frequency at the same time. A grating structure comprising two regions with different frequencies is projected upon the surface of the detected object. Two line-scan CCD cameras are used to capture the surface images encoded by the two kinds of patterns, respectively. By getting the corresponding image intensity at the same point of the object surface in the two acquired images, the dual-frequency technique is applied to extract the real phase without phase ambiguity. The surface profile of a specimen with a large height step is measured to prove the feasibility of the proposed method. The experimental results show that the proposed method can solve the 2π phase ambiguity problem successfully in the surface profile inspection of a moving object.     

应用神经网络的复杂物体三维测量

将神经网络引入基于结构光投影的复杂物体三维面形测量。在测量过程中,利用神经网络强大的函数逼近能力,得到离散条纹图的连续逼近函数,从中解出物体的相位分布信息,获得物体的三维面形分布。应用神经网络方法,在结构光投影条件下,只需要获取一幅条纹图,便可以完成复杂物体的三维面形测量。该方法相比传统的傅里叶变换轮廓术,不存在滤波操作,不会在测量过程中丢失被测物体的高频分量,具有更高的空间带宽积和灵敏度,能准确测量出复杂物体的细节,更加适用于恢复复杂物体的三维面形。并且该方法在条纹图存在阴影的情况下与傅里叶变换轮廓术相比,能更好地提取出物体的相位信息,恢复物体的三维面形。模拟及实验均验证了该方法的可行性。     

傅里叶变换轮廓术中频谱泄漏的讨论

讨论了频谱泄漏对傅里叶变换轮廓术测量精度的影响。由于用傅里叶变换轮廓术进行三维面形测量时 ,测得的变形光场是空间有限函数 ,故离散傅里叶变换时先要进行周期拓展 ,如果拓展周期选择不当 ,拓展后的条纹将不连续 ,对之进行傅里叶变换会产生频谱泄漏。文章从理论上推导了拓展周期与变形结构光场频谱泄漏之间的关系 ,给出了由泄漏引起的视场边缘误差的计算模型和定量分析。提出采用条纹外插以减小泄漏误差的方法 ,计算机模拟及初步实验证实了该方法的有效性。     

Neural network applied to reconstruction of complex objects based on fringe projection

The neural network has been introduced into the reconstruction of the complex object based on fringe projection. In this method, the neural network with powerful property of approximation is used to get the continuous approximate function of a discrete fringe pattern captured by an image frame grabber. The depth-related phase of the measured object modulated into the fringe pattern can be demodulated by dealing with the approximate function. Compared with the Fourier transform profilometry (FTP), in the network method, one deformed fringe pattern is needed to reconstruct the tested object, and a high spatial resolution is maintained for no filtering process. Therefore, this method performs better than FTP in the measurement of the complex object. Moreover, the network method is capable of demodulating more depth-related phase even in the case that the local shadow exists in the fringe pattern. Computer simulations and experiments validate the feasibility of this method.