基于彩色光栅投影的快速三维测量方法

 针对条纹投影术提取物体高度信息的问题,提出了一种新的基于彩色光栅投影的三维测量方法。对选取G分量为255,R,B分量各取0或255而组成的青、白、黄、绿四色遵循格雷码原理进行编码,然后将G分量作正弦调制形成投影光栅投向被测物体。提取采集到的光栅变形图中G分量,利用傅里叶变换方法得到其初始相位;同时对采集到图像中的R,B分量作阈值迭代分割而G分量自动赋值为255,综合三分量信息得到条纹颜色信息进而获取条纹的周期信息,从而展开相位。全过程仅需投影一幅彩色光栅图就能完成三维测量,实验结果表明该算法易于实现,在测量实时性和精确性上表现良好。     

BP neural network applied to 3D object measurement based on fringe pattern projection

In the fringe projection profilometry, the traditional triangle method, such as Fourier-transform profilometry (FTP), is difficult to recover the stepped shape object from the deformed fringe pattern. In order to solve this problem, the neural network is introduced to deal with this kind of fringe patterns and gain the three-dimensional (3D) information of the measured object. By training the network, the relationship between the deformed fringe pattern and the height of the object can be obtained, and thereby the height of the object can be obtained. Furthermore, the object can be reconstructed perfectly without knowing the optical parameters of the experiment system. An obvious merit of this network method is that it can recover the 3D object in a short time and only need one deformed fringe pattern. Computer simulations and experiment validate the feasibility of the method.     

Fringe contrast-based 3D profilometry using fringe projection

Quality-guided algorithm is a widely used method in phase unwrapping. This paper shows an accurate quality map based on fringe contrast for 3D shape measurement. Phase-shifted fringe patterns are projected onto an object surface by a programmable liquid crystal projector and recorded by a CCD camera. A wrapped phase map and a fringe contrast map are extracted from the deformed fringe patterns by the phase-shifting technique. Guided by the contrast map, the quality-guided unwrapping algorithm minimizes unwanted shadow and non-uniform surface reflectance effects and is able to retrieve a correct surface profile. Validity of the proposed method is tested on a fish model and a cutting tool specimen.     

Performance analysis of a 3D full-field sensor based on fringe projection

This article analyzes the measurement performance of a 3D full-field imaging system based on the projection of grating and active triangulation. We first explore the exact mathematical relationship that exists between the height of an object's surface, the phase and the parameters of the experimental setup, which relationship can be used to obtain the precise shape of an object. We then investigate in detail the influence on the measurement results of the introduction of an inaccuracy into the determination of the system's parameters. Finally, using simulated data, we conduct experiments to evaluate the measurement performance.     

Three-dimensional shape measurement for an underwater object based on two-dimensional grating pattern projection

In this paper, a practical method using phase tracking and ray tracing algorithms is proposed for measuring the three-dimensional (3D) shape of an underwater object. A 2D projected sinusoidal fringe goes through the water and illuminates the tested object. Firstly, the phase tracking algorithm is employed to identify homologous points in phase distributions of the deformed fringe captured by the camera and these of the fringe pattern projected by the projector. The projector is regarded as a special camera as regards the stereovision principle. In the calibrated system, both ray directions of the homologous points can be easily figured out. Secondly, the ray tracing algorithm is used to trace the propagation path of each ray and to calculate the 3D coordinates of each point on the tested object's surface. Finally, the whole shape of the tested object can be reconstructed.     

Whole 3D shape reconstruction of vascular segments under pressure via fringe projection techniques

Understanding and modelling vascular wall mechanics is a primary issue in the study of circulatory diseases. Although theoretical and numerical studies on arteries compliance are continuously increasing, relatively little work has been documented on the use of non-invasive imaging techniques for monitoring 3D vascular wall deformations. Usually, 2D video dimension analyzer (VDA) systems recover diameter and length variations during inflation/extension tests by tracking position changes of few markers put on the blood vessel surface. Then, strain determination relies on the assumption of axisymmetric deformations. However, more rigorous evaluations of whole wall deformation map are required for properly modelling the highly anisotropic and inhomogeneous vascular tissue mechanical response.

This paper describes the development and application of a fringe projection (FP)-based procedure for the 360° 3D shape reconstruction of tubular samples subjected to internal pressure. A specially designed fixture for mounting and inflating the tubular segment allows specimen rotation about its axis. Movement is controlled by a high-precision rotational stage. This yields accurate positioning of the surface to be investigated with respect to the viewing direction. Data point clouds obtained from multiple recorded images are then processed and merged in a CAD environment, thus providing the whole shape of the sample with very high spatial resolution.

The entire procedure has successfully been applied to latex specimens and porcine vascular segments. Further improvements will make the present procedure suitable for in vitro tests under more closely reproduced physiological conditions.     

Lens distortion elimination for improving measurement accuracy of fringe projection profilometry

Fringe projection profilometry (FPP) is a powerful method for three-dimensional (3D) shape measurement. However, the measurement accuracy of the existing FPP is often hindered by the distortion of the lens used in FPP. In this paper, a simple and efficient method is presented to overcome this problem. First, the FPP system is calibrated as a stereovision system. Then, the camera lens distortion is eliminated by correcting the captured images. For the projector lens distortion, distorted fringe patterns are generated according to the lens distortion model. With these distorted fringe patterns, the projector can project undistorted fringe patterns, which means that the projector lens distortion is eliminated. Experimental results show that the proposed method can successfully eliminate the lens distortions of FPP and therefore improves its measurement accuracy.     

Characterization of the 3D resolution of topometric sensors based on fringe and speckle pattern projection by a 3D transfer function

The increasing importance of optical 3D measurement techniques and the growing number of available methods and systems require a fast and simple method to characterize the measurement accuracy. However, the conventional approach of comparing measured coordinates to known reference coordinates of a test target faces two major challenges: the precise fabrication of the target and - in case of pattern projecting systems - finding the position of the reference points in the obtained point cloud. The modulation transfer function (MTF) on the other hand is an established instrument to describe the resolution characteristics of 2D imaging systems. Here, the MTF concept is applied to two different topometric systems based on fringe and speckle pattern projection to obtain a 3D transfer function. We demonstrate that in the present case fringe projection provides typically 3.5 times the 3D resolution achieved with speckle pattern projection. By combining measurements of the 3D transfer function with 2D MTF measurements the dependency of 2D and 3D resolutions are characterized. We show that the method allows for a simple comparison of the 3D resolution of two 3D sensors using a low cost test target, which is easy to manufacture.     

基于四步相移光栅投影的三维形貌测量系统

为了实现对具有明显跳变面物体的轮廓测量,建立了四步相移光栅投影的三维形貌测量系统,并对所采用的四步相移测量算法进行研究。在介绍四步相移原理的基础上以有明显跳变面的三棱锥橡皮块为例,建立针对明显跳变面的测量算法。通过对4幅相移图算术求和并除以4得到平均灰度图;将平均灰度图二值化处理定位明显跳变面或阴影部分;将二值化图像与包裹相位图卷积,而后对包裹相位图进行解包裹,从而得到正确的连续相位,最终获取物体三维形貌。根据上述算法测量三棱锥的三维形貌并计算其体积,测量实验表明:被测物的体积平均相对精度为0.47%。     

Leaf cuticle topography retrieved by using fringe projection

The combination (often referred to as phase-stepping profilometry, PSP) of the fringe projection technique and the phase-stepping method allowed us to retrieve topographic maps of cuticles isolated from the abaxial surface of leaves; these were in turn sampled from an apple tree (Malus domestica) of the variety Golden Delicious. The topographic maps enabled us to assess the natural features on the illuminated surface and also to detect the whole-field spatial variations in the thickness of the cuticle. Most of our attention was paid to retrieve the highly-resolved elevation information from the cuticle surface, which included the trace (in the order of tens of micrometers) left by ribs and veins. We expect that the PSP application for retrieving the cuticle topography will facilitate further studies on the dispersion and coverage of state-of-the-art agrochemical compounds meant to improve the defending properties of the cuticle. Methodological details are provided below.     

Background and amplitude encoded fringe patterns for 3D surface-shape measurement

This paper presents a new fringe projection method for surface-shape measurement that uses background and amplitude encoded high-frequency fringe patterns. The background and amplitude, combined as a codeword, identify the wrapped phase fringe order to partially unwrap the phase to a low frequency. The low-frequency wrapped phase map is then directly used to reconstruct the surface based on geometry constraints without requiring additional images as in other temporal phase-unwrapping methods. Measurements performed on a double-hemisphere, mask, and manikin head, using projected fringe patterns with 48 periods, demonstrated the ability of the method to perform 3D shape measurement with only four projected patterns and captured images, using a single camera and projector.     

A study on carrier-removal techniques in fringe projection profilometry

This paper describes a comparison of several carrier-removal techniques normally used in fringe projection for surface shape measurement. The performance of various algorithms, including the necessity for manual intervention, the complexity in data recording, and the side effect on measurement accuracy, is evaluated. The applicability of nonlinear carrier removal and the restrictions on the direction of carrier fringe in various algorithms are also investigated in this paper. It is also shown that an advanced algorithm is able to achieve carrier removal with minimal manual intervention and significantly simplify the calibration process of a fringe projection system.     

Single fringe projection profilometry based on sinusoidal intensity normalization and subpixel fitting

A novel fringe projection profilometry using a single sinusoidal fringe pattern projected is proposed. Computer-generated sinusoidal fringe and uniform intensity patterns are firstly projected on a testing object by a liquid crystal display projector. The variable reflection intensity of a fringe pattern is then roughly normalized by division operation applied to the grabbed fringe and uniform intensity patterns projected. Fringe intensity is further normalized by employing an interpolation algorithm. The deformed sinusoidal pattern encoding object shape is converted to a wrapped phase map without using phase-shifting or Fourier transform. Computer simulation and experimental performance are evaluated to demonstrate the validity of the proposed method. The experimental results compared with those of the four-step phase-shifting and fast Fourier transform methods are also presented.     

Fringe projection based quantitative 3D microscopy

A fringe projection based quantitative three-dimensional microscopy (FP-3DM) is presented. The image formation for FP-3DM is formulated based on a concept of active micro stereovision. The problem of point correspondences in active stereo imaging can be solved with help of the phase measuring technique. A prototype of the FP-3DM is also established and calibration strategy for proposed FP-3DM is suggested. Some preliminary experiment results are also presented to verify this approach. The FP-3DM can provide quantitative 3D micro imaging especially for quantitative characterization of 3D microstructures.     

Analysis of phase distortion in phase-shifted fringe projection

This paper describes the analysis of phase distortion in phase-shifted fringe projection method. A phase distortion occurs when the phase shifting technique is applied to extract the phase values from projected fringe patterns in surface contouring. The phase distortion will induce measurement errors especially in the measurement of micro-components. The cause of such phase distortion is investigated and the influence of phase distortion on the measurement of micro-components is discussed. To eliminate the phase distortion, a continuous wavelet transform (CWT) is employed to extract phase values from object surface modulated fringe patterns. Principle of the proposed CWT phase extraction method is described and experiments are conducted to verify the proposed method. It is shown that by the use of CWT phase extraction method phase distortion induced in conventional phase-shifting technique can be completely eliminated.     

Self-calibration of a fringe projection system using epipolar constraint

A new self-calibration method for a fringe-projection based 3D measurement system is proposed. To determine homologous points in the proposed camera/projector configuration, the phase map is converted to the u, v coordinates in the projected image. The projector can conceptually be regarded as camera acting in a reversed mode. Taking the epipolar constraint into account, this approach can allow self-calibration of the fringe projection system. Considering the effect of noise, we propose a nonlinear self-calibrating model. The experimental results show the effectiveness of this approach.     

基于二进制条纹加相位编码条纹离焦投影的三维测量方法

复杂表面的精密三维测量在工业无损检测中非常重要。二进制条纹离焦投影方法在快速三维测量中有重要的应用前景,但该方法难以实现复杂表面高精度三维测量。为此,提出了基于二进制条纹加相位编码条纹离焦投影的三维测量方法。由于离焦投影滤除了高次谐波和高频噪声,可以克服投影仪的非线性伽马效应,与传统投影正弦条纹方法相比,提高了其测量精度。针对离焦投影时,随着相位编码条纹频率增大,条纹级次判决困难,出现周期错位,导致相位解包裹出错,提出了相移编码方法来解决以上问题。采用相移编码方法校正周期错位,使条纹级次判决准确,进一步提高其测量精度。实验结果表明,其测量精度可以达到0.044 mm,验证了本方法的有效性和实用性。     

Period correction method for binary fringe defocused projection

Binary fringe defocused projection can resolve the problem caused by the nonlinear gamma of the projector. Owing to the intersecting axis measurement system, the broadening of the fringe period on the reference plane can cause measurement errors. Non-uniform periodical binary fringe defocused projection is utilized to overcome this problem. After appropriate defocused projection of non-uniform periodical binary fringe, uniform periodical sinusoidal fringe can be obtained on the reference plane. This method can prevent the nonlinear gamma effect and broadening of the fringe period, and filter high harmonics and high-frequency noise. Three-dimensional (3-D) shape measurement experiments of standard flat are performed with four-step phase-shift method. Experimental results demonstrate that the proposed method exhibits high measurement precision. Highly accurate 3-D measurements of large objects can also be performed with the proposed method.     

Microscopic surface contouring by fringe projection method

This paper describes the use of optical fringe projection method for 3D surface profile and deformation measurement of micro-components. In this method, sinusoidal linear fringes are projected on a micro-component surface by a grating phase shifting projector and a long working distance microscope (LWDM). The image of the fringe pattern is captured by a high-resolution CCD camera and another LWDM and processed by phase-shifting technique. A simple procedure is described which enables calibration of the optical set-up for subsequent quantitative measurement of micro-components of unknown shapes. This method is relatively simple and accurate, and is capable of conducting fully automated measurements. In this paper, two micro-components, a micro-mirror (0.1 mm×0.1 mm) and a micro-electrode pad are used to demonstrate deformation measurement and microscopic surface contouring.     

Improved 3D displacement measurements method and calibration of a combined fringe projection and 2D-DIC system

An improved measurement method and an automatic calibration procedure are proposed for a combined 2D Digital Image Correlation and Fringe Projection system that allows measuring in- and out-of-plane displacement maps with only one image at each deformation stage of a specimen. The proposed method increases the accuracy and range of the out-of-plane displacements by taking into account the divergences of both the projected fringes (uncollimated) and the camera (with non-zero FOV). The calibration is performed automatically by acquiring a sequence of images of a reference plane by displacing perpendicular to it the camera and fringe projector with a motorized translation stage. The acquired images are then used to obtain a fringe function for each pixel and the necessary parameters required for the correction of the in-plane displacements. Furthermore, a closed form expression is obtained that relates the out-of-plane displacements with the shifted phase at each pixel for a given experimental set-up. This expression is in good agreement with the fringe function obtained by fitting a simple 2nd order polynomial to the experimental obtained calibration data. Finally, the polynomial approach is proposed as a fringe function because it avoids the errors in the determination of the required parameters of the theoretical expression as well as some small misalignment or aberration effects.