Microscopic structured light 3D profilometry: Binary defocusing technique vs. sinusoidal fringe projection

This paper compares the binary defocusing technique with conventional sinusoidal fringe projection under two different 3D microscopic profilometry systems: (1) both camera and projector use telecentric lenses and (2) only camera uses a telecentric lens. Our simulation and experiments found that the binary defocusing technique is superior to the traditional sinusoidal fringe projection method by improving the measurement resolution approximately 19%. Finally, by taking the speed advantage of the binary defocusing technique, we presented a high-speed (500 Hz) and high-resolution (1600×1200) 3D microscopic profilometry system that could reach kHz.     

Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment

Conventional methods based on analyses of the absolute gray levels of pixels in fringe pattern images are affected by the problems of image saturation, interreflection, and high sensitivity to noise when obtaining three-dimensional (3D) shape measurements of shiny surfaces. This study presents a robust, adaptive, and fast 3D shape measurement technique, which adaptively adjusts the pixel-wise intensity of the projected patterns, thus it avoids image saturation and has a high signal to noise ratio (SNR) during 3D shape measurement for shiny surfaces. Compared with previous time-consuming methods using multiple exposures and the projection of fringe patterns with multiple intensities, where a large number of fringe pattern images need to be captured, the proposed technique needs to capture far fewer pattern images for measurement. In addition, it can greatly reduce the time costs to obtain the optimal projection intensities by the fusion of uniform gray level patterns and coordinates mapping. Our experimental results demonstrate that the proposed technique can achieve highly accurate and efficient 3D shape measurement for shiny surfaces.     

A novel 3D measuring method for discontinuous object by non-integral twin-frequency grating

A new 3D shape measurement method based on non-integral twin-frequency grating projection is proposed. In this paper, the projected composite grating is composed of two sinusoidal gratings, and the quotient of whose frequencies is not an integer. By using appropriate phase-shifting algorithms, two wrapped phases can be obtained from sixteen frames of the distorted grating patterns. In aid of appropriate phase unwrapping method, the unwrapped phase of high frequency fringe is obtained only from the relation of the two wrapped phases by a pixel-to-pixel phase unwrapping technique. Therefore the unwrapped phase of high frequency fringe pattern is independent of the low frequency fringe pattern, different from traditional integral twin-frequency grating projection methods in which the phase unwrapping error of low frequency fringe pattern may be propagated onto the unwrapped phase of high frequency fringe pattern. The new theory proves that the proposed method is applicable to measure discontinuous object, and has considerable measurement accuracy.     

基于彩色光栅投影的快速三维测量方法

 针对条纹投影术提取物体高度信息的问题,提出了一种新的基于彩色光栅投影的三维测量方法。对选取G分量为255,R,B分量各取0或255而组成的青、白、黄、绿四色遵循格雷码原理进行编码,然后将G分量作正弦调制形成投影光栅投向被测物体。提取采集到的光栅变形图中G分量,利用傅里叶变换方法得到其初始相位;同时对采集到图像中的R,B分量作阈值迭代分割而G分量自动赋值为255,综合三分量信息得到条纹颜色信息进而获取条纹的周期信息,从而展开相位。全过程仅需投影一幅彩色光栅图就能完成三维测量,实验结果表明该算法易于实现,在测量实时性和精确性上表现良好。     

Three-dimensional data acquisition by digital correlation of projected speckle patterns

Reliable methods for the optical acquisition of three-dimensional (3D) coordinates like the fringe projection technique or 3D laser scanning are sensible to object movements because they require the recording of a sequence of images. In contrast, techniques using the projection of a random pattern reduce the measurement time to a single exposure time.     

3D shape measurement of larger complex objects based on fringe cycle correction

The grating fringe on the reference plane is broadened in the intersecting axis system because of oblique-angle projection. In order to solve this problem, we study the theoretical model of the temporal phase unwrapping method based on the fringe cycle correction. We also study the 3D shape measurement theoretical model of the larger complex objects after considering the coordinate deviation and lens distortion. Experimental results demonstrate that the fringe cycle on the reference plane can be corrected to a constant value, the lens distortion can be corrected, and 3D shape of larger complex objects can be accurately measured.     

A novel color fringe projection based Fourier transform 3D shape measurement method

A novel Fourier transform 3D shape measurement method based on color fringe projection is proposed in order to solve the spectrum overlapping and phase unwrapping problems existed in Fourier transform profilometry (FTP). The R and G components of the color fringe are set to two sinusoidal patterns with different frequencies and the B component is set to the average value of R or G component. Then this pattern is projected to the object and the deformed fringe image is captured. Three gray patterns are separated from the color fringe, the background and high frequency noise can be eliminated using our method and the accurate unwrapped phase can be got. Only one shot color pattern is projected to get the 3D information of the object. Experiment results show that the 3D information of an object can be obtained rapidly and accurately.     

Anti-spoof touchless 3D fingerprint recognition system using single shot fringe projection and biospeckle analysis

Fingerprint is a unique, un-alterable and easily collected biometric of a human being. Although it is a 3D biological characteristic, traditional methods are designed to provide only a 2D image. This touch based mapping of 3D shape to 2D image losses information and leads to nonlinear distortions. Moreover, as only topographic details are captured, conventional systems are potentially vulnerable to spoofing materials (e.g. artificial fingers, dead fingers, false prints, etc.). In this work, we demonstrate an anti-spoof touchless 3D fingerprint detection system using a combination of single shot fringe projection and biospeckle analysis. For fingerprint detection using fringe projection, light from a low power LED source illuminates a finger through a sinusoidal grating. The fringe pattern modulated because of features on the fingertip is captured using a CCD camera. Fourier transform method based frequency filtering is used for the reconstruction of 3D fingerprint from the captured fringe pattern. In the next step, for spoof detection using biospeckle analysis a visuo-numeric algorithm based on modified structural function and non-normalized histogram is proposed. High activity biospeckle patterns are generated because of interaction of collimated laser light with internal fluid flow of the real finger sample. This activity reduces abruptly in case of layered fake prints, and is almost absent in dead or fake fingers. Furthermore, the proposed setup is fast, low-cost, involves non-mechanical scanning and is highly stable.     

Simple calibration of a phase-based 3D imaging system based on uneven fringe projection

Phase-based fringe projection metrology systems have been widely used to obtain the shape of 3D objects. One vital step is calibration, which defines the relationship between the phase and depth data. Existing calibration methods are complicated because of the dependence of the relationship on the pixel position. In this Letter, a simple calibration procedure is introduced based on an uneven fringe projection technique, in which the relationship between phase and depth becomes independent of the pixel position and can be represented by a single polynomial function for all pixels. Therefore, given a set of discrete points with a known phase and depth in the measuring volume, the coefficient set of the polynomial function can be determined. A white plate having discrete markers with known separation is used to calibrate the 3D imaging system. Experimental results demonstrate that the proposed calibration method is simple to apply and can build up an accurate relationship between phase and depth data.     

3D coordinate measurement based on inverse photogrammetry and fringe analysis

A method based on inverse photogrammetry and fringe analysis is presented for 3D coordinate measurement. Measurement system mainly consists of a micro-camera fixed on one end of a measuring rod, a measuring probe on the other end and a liquid crystal display screen for displaying 2D fringe pattern in the measurement. In the measurement process, the probe contacts the surface of the measured object, and the CCD camera captures the stripes image on displays screen. The coordinates of camera principal point in the world coordinate system may be determined by the phase information carried in the fringe pattern. The coordinate relations between the principal point of the camera and the measuring probe can be determined with a least square optimization technique in camera coordinate system. This method has the advantage of large measurement range, good flexibility, and portable, which is suitable for field measurement. A result of our method is compared with that of the Coordinate Measuring Machine (CMM), which shows that the measurement accuracy of this method can meet accuracy requirement of the field measurement in large dimension.     

形貌与微变形全场光学同时测量方法

在实际工程应用中,对材料形貌和结构变形等参量的检测是必不可少的,而且往往需要进行多参量同时测量。针对该背景,采用数字散斑干涉与数字条纹投影相结合的测量方法, 设计了一种集成光路,通过在数字散斑干涉实验光路中引入一个投影设备,实现物体表面形貌和微变形的同时测量。所提出的方法具有全场非接触测量的优点,且测量光路简单、操作方便、效率高、可靠性强。该方法的形貌测量分辨率优于10 μm,形变测量分辨率优于30 nm。     

A flexible fast 3D profilometry based on modulation measurement

This paper proposes a flexible fast profilometry based on modulation measurement. Two orthogonal gratings through a beam splitter are vertically projected on an object surface, and the measured object is placed between the imaging planes of the two gratings. Then the image of the object surface modulated by the orthogonal gratings can be obtained by a CCD camera in the same direction as the grating projection. This image is processed by the operations consisting of performing the Fourier transform, spatial frequency filtering and inverse Fourier transform. Using the modulation distributions of two grating patterns, we can reconstruct the 3D shape of the object. In the measurement process, we only need to capture one fringe pattern, so it is faster than the MMP and remains the advantages of it. In the article, the principle of this method, the setup of the measurement system, some simulations and primary experiment results are given. The simulative and experimental result proves it can restore the 3D shape of the complex object fast and comparatively accurate. Because only one fringe pattern is needed in the testing, our method has a promising extensive application prospect in real-time acquiring and dynamic measurement of 3D data of complex objects.     

Superfast 3D absolute shape measurement using five binary patterns

This paper presents a method that recovers high-quality 3D absolute coordinates point by point with only five binary patterns. Specifically, three dense binary dithered patterns are used to compute the wrapped phase; and the average intensity is combined with two additional binary patterns to determine fringe order pixel by pixel in phase domain. The wrapped phase is temporarily unwrapped point by point by referring to the fringe order. We further developed a computational framework to reduce random noise impact due to dithering, defocusing and random noise. Since only five binary fringe patterns are required to recover one 3D frame, extremely high speed 3D shape measurement can be achieved. For example, we developed a system that captures 2D images at 3333 Hz, and thus performs 3D shape measurement at 667 Hz.     

3D deformation and shape measurement using phase-stepping DSPI

A new optical arrangement of phase-stepping digital speckle pattern interferom-etry is presented.The system can be used to measure 3D deformation and shape of a curvesurface simultaneously.The phase at each pixel can be determined by appling phase-steppingtechniques.This not only provides high accurate measurement results,but also permits auto-matic analysis of the experimental data.A speckled object reference beam is used,and itmakes the system has the advantage that the measurements are less sensitive to vibration andwhole body motion.     

A genetic optical interferometric inspection on micro-deformation

This paper describes a feasibility study of an optical method for measuring nanoscale deformation of micro-components that are commonly employed in the field of microelectromechanical systems (MEMS). Both theoretical and experimental results demonstrate that an optical interference fringe pattern resulted from an air gap consisting of two surfaces (object and reference surfaces) is a simple function of the deformation of the micro-component. A microscopic system incorporating a coaxial monochromatic light illumination and a high resolution CCD sensor is utilized to record the interference fringe pattern. The experimental results on different micro-components show that the proposed technique is applicable to the deformation measurement on micro-components of MEMS devices.     

Microscopic surface contouring by fringe projection method

This paper describes the use of optical fringe projection method for 3D surface profile and deformation measurement of micro-components. In this method, sinusoidal linear fringes are projected on a micro-component surface by a grating phase shifting projector and a long working distance microscope (LWDM). The image of the fringe pattern is captured by a high-resolution CCD camera and another LWDM and processed by phase-shifting technique. A simple procedure is described which enables calibration of the optical set-up for subsequent quantitative measurement of micro-components of unknown shapes. This method is relatively simple and accurate, and is capable of conducting fully automated measurements. In this paper, two micro-components, a micro-mirror (0.1 mm×0.1 mm) and a micro-electrode pad are used to demonstrate deformation measurement and microscopic surface contouring.     

A 3D shape retrieval method for orthogonal fringe projection based on a combination of variational image decomposition and variational mode decomposition

The orthogonal fringe projection technique has as wide as long practical application nowadays. In this paper, we propose a 3D shape retrieval method for orthogonal composite fringe projection based on a combination of variational image decomposition (VID) and variational mode decomposition (VMD). We propose a new image decomposition model to extract the orthogonal fringe. Then we introduce the VMD method to separate the horizontal and vertical fringe from the orthogonal fringe. Lastly, the 3D shape information is obtained by the differential 3D shape retrieval method (D3D). We test the proposed method on a simulated pattern and two actual objects with edges or abrupt changes in height, and compare with the recent, related and advanced differential 3D shape retrieval method (D3D) in terms of both quantitative evaluation and visual quality. The experimental results have demonstrated the validity of the proposed method.     

傅里叶变换轮廓术中相位失真的预矫正方法

介绍了一种基于傅里叶变换轮廓术的三维面形测量系统中相位失真的预矫正方法。由于投影系统和成像系统的空间三角位置关系、投影仪的发散照明和两套系统蕴含的光学畸变,投影一幅相位与空间坐标成理想线性关系的标准正弦光场,拍摄到的条纹相位和空间坐标不再呈线性分布,引起相位失真,甚至会影响系统测量精度。该方法借鉴反向条纹投影的思想,计算拍摄光场的非线性相位分布与理想的线性相位分布之间的关系,预先矫正,反算出一个新的待投影光场。实验结果表明这种方法能有效地减小该类相位失真所导致的测量误差,获得了更好的测量结果．     

Novel 3D shape measurement method with lower occlusion for the bottom of cavity

Because the bottom of the cavity has the shadow and occlusion, the angle between the projection system and imaging system is limited. So the traditional fringe projection technique based on the principle of optical triangulation is inapplicable. This Letter presents a 3D shape measurement method of using the light tube for the cavity. The method can measure an object from two opposite views at the same time, which means it will obtain two different groups of 3D data for the same object in a single measurement. The experimental results show the feasibility and validity of the 3D shape measurement method.     

A flexible new three-dimensional measurement technique by projected fringe pattern

Aimed at the problems of inferior precision and bad maneuverability for three-dimensional (3D) measurement by projected fringe pattern, a flexible new 3D technique for performing system calibration and measuring was proposed. First, we analyzed the principle of conventional 3D measurement with projected fringe pattern, and pointed out the shortcoming of measurement system. Then, the CCD camera calibration technique is analyzed and we set up the perspective projection model which transforms the computer image coordinate to 3D world coordinate, and we get the coordinate of the CCD camera image lens. Third, the position of projection lens optical center can be obtained using the above model. At last, some experiment results presented show that this technique is more simple and robust in engineering than conventional measurement method.