The use of a consumer grade photo camera in optical-digital correlator for pattern recognition and input scene restoration

In this work an optical-digital correlator for pattern recognition and input scene restoration is described. Main features of the described correlator are portability and ability of multi-element input scenes processing. The correlator consists of a consumer grade digital photo camera with a diffractive optical element (DOE) inserted as a correlation filter. Correlation of an input scene with a reference image recorded on the DOE are provided optically and registered by the digital photo camera for further processing. Using obtained correlation signals and DOE’s point spread function (PSF), one can restore the image of the input scene from the image of correlation signals by digital deconvolution algorithms.The construction of the correlator based on the consumer grade digital photo camera is presented. The software procedure that is necessary for images linearization of correlation signals is described. Experimental results on optical correlation are compared with numerical simulation. The results of images restoration from conventionally and specially processed correlation signals are reported. Quantitative estimations of accuracy of correlation signals as well as restored images of the input scene are presented.     

Quantization and truncation conditions of fourier power spectrum for good performance in binary subtracted joint transform correlator

Binary subtracted joint transform correlator (BSJTC) provides sharp autocorrelation peaks and better discrimination for similar targets even though many reference images are arranged regularly in an input scene. The effects of the number of reference patterns, the quantization levels and truncation of the Fourier power spectra on the performance of BSJTC are investigated. The number of effective quantization levels to obtain sharp and clear autocorrelation peaks is estimated by computer simulations using the input scenes with many binary images (alphabetic characters) and halftone images (human portraits). Experimental results of BSJTC are also shown using a hybrid system with a Bi₁₂SiO₂₀ spatial light modulator and a personal computer.     

Binary phase only filters for rotation and scale invariant pattern recognition with the joint transform correlator

The joint transform correlator (JTC) is one of the two main optical image processing architecture which provides a highly effective way of comparing images in a wide range of applications. Traditionally, an optical correlator is used to compare an unknown input scene with a pre-captured reference image library, to detect if the reference occurs within the input. Strength of the correlation signal decreases rapidly as the input object rotates or varies in scale relative to the reference object. The aim of this paper is to overcome the intolerance of the JTC to rotation and scale changes in the target image. Many JTC systems are constructed with the use of ferroelectric liquid crystal (FLC) spatial light modulators (SLMs) as they provide fast two-dimensional binary modulation of coherent light. Due to the binary nature of the FLC SLMs used in the JTC systems, any image addressed to the device need to have some form of thresholding. Carefully thresholding the grey scale input plane and the joint power spectrum (JPS) has significant effect on the quality of correlation peaks and zero order (DC) noise. A new thresholding technique to binarise the JPS has been developed and implemented optically. This algorithm selectively enhances the desirable fringes in the JPS which provide correlation peaks of higher intensity. Zero order noise is further reduced when compared to existing thresholding techniques.Keeping in mind the architecture of the JTC and limitations of FLC SLMs, a new technique to design rotation and scale invariant binary phase only filters for the JTC architecture is presented. Filers design with this technique have limited dynamic range, higher discriminability among target and non-target objects, and convenience for implementation on FLC SLMs. Simulation and experiments shows excellent results of various rotation and scale invariant filters designed with this technique. A rotation invariant filter is needed for various machine vision applications of the JTC. By fixing the distance between camera and input object, the scale sensitivity of the correlator can be avoided. In contrast to the industrial machine vision applications, scale factor is very important factor for the applications of the JTC systems in defence and security. A security system using a scale invariant JTC will be able to detect a target object well in advance and will provide more time to take a decision.     

Complementary-reference and complementary-scene for real-time fingerprint verification using joint transform correlator

In this paper, a new configuration for the input joint images in the joint transform correlator is proposed for fast real-time binary characters and fingerprints verification. In the proposed scheme, the input joint image has a complementary-reference image and a complementary target image in addition to the reference and the target images. We use the cross-correlation peak value between the reference and the complementary target image and the cross-correlation peak value between the complementary reference and the target images as the criteria to perform the recognition of the target in the input scene. It is shown that these two cross-correlation peak values will be zero if and only if the input target matches the reference image. One advantage of using the proposed scheme is the elimination of the usual and necessary time-consuming normalization of the input images in the general correlation-based matching processes. Another advantage of the proposed scheme is the insensitive to light-sources intensity fluctuations that usually limits the matched-based recognition approaches. The scheme is employed to verify binary characters and fingerprints images; further, it is employed to verify occluded fingerprints target images on one hand, and to determine if a specific part or pattern exists in the target fingerprint image on the other hand.     

修正振幅调制的光电混合圆谐联合变换相关器作旋转不变的目标检测

提出一种修正振幅调制的光电混合圆谐联合变换相关器作旋转不变的目标检测的实验系统。参考图像（即圆谐展开分量的实部和虚部）、圆盘状的局部偏置函数以及目标图像同时显示于输入面。此方法对联合功率谱作了修正,先将联合功率谱减去纯输入景物（含局部偏置函数）的功率谱和参考图像（含局部偏置函数）的功率谱,再加上局部偏置函数的功率谱,然后将所得修正的联合功率谱乘以振幅调制滤波函数。这种方法能产生比普通的圆谐联合变换     

High-pass filtering and frequency spectrum correlation for larger size image recognition

A new method for larger size images recognition is proposed based on high-pass filtering and frequency spectrum correlation. The input images are first filtered by a high-pass filter. Then the filtered input images, which are overlapped rather than displaced from each other in the input plane, serve as the input images for frequency spectrum correlator. As a result, only one sharp correlation peak yields in the center of output plane when the target image matches with the reference image. More importantly, the method is especially suitable for larger size image recognition because of the input and correlation ways, which ensures better utilization of the space-bandwidth product and efficient utilization of the spatial light modulator and detector. Computer simulation results are presented to demonstrate the feasibility and effectiveness of this method.     

基于KNSBN:Cu晶体的光折变联合变换相关器

给出基于KNSBN:Cu晶体的光折变二波耦合联合变换相关器(TBJTC).以KNSBN:Cu晶体作为平方律转换器,将强度较大且携带参考图象和待识别图象联合频谱的信号光波与一强度较弱的相干平面参考光波同时输入于KNSBN:Cu晶体,通过光折变二波耦合过程的非线性能量转移,实现功率谱转换,进而实现相关识别.理论分析和实验结果表明,除输入输出外,该光学相关器无需CCD、LCLV等器件和相应的数字处理,是一个全光光学相关器.     

Image displacement based on phase-encoded reference joint fractional transform correlator

In order to utilize the space of an input plane efficiently and make the optical structure more flexible, an image displacement measurement based on phase-encoded reference joint fractional transform correlator (PER-JFrTC) is proposed. We use a random phase mask to encode the reference image and overlay it with the target image forming the input image. Joint power spectrum (JPS) of the input image is obtained by Fourier transform and the resultant is encoded by the same phase mask. Then a fractional Fourier transform with an order p is applied to the phase-encoded JPS (PJPS), resulting in a correlation output with a sharp cross-correlation peak, which includes the displacement information between the reference and the target image. Contrast to displacement measurement based on traditional joint transform correlator (JTC), PER-JFrTC can use the space of the input plane efficiently and reduces the influence of the auto-correlation. Also the position of cross-correlation peak can be fixed arbitrarily according to the fractional order p as well as the optical set-up can be more flexible and easier to implement. Results based on digital computation show that PER-JFrTC could detect the displacement accurately and verify our proposal. A possible optical set-up is suggested.     

A New Method for Rotation and Brightness Invariant Pattern Recognition Based on Modified Multiple Circular Harmonic Expansions

A new method for rotation and brightness invariant pattern recognition was proposed by applying multiple circular harmonic expansions to the joint transform correlator. The amplitudes of the multiple orders of circular harmonic expansions made from a detecting image were synthetically modified to respond to the same auto-correlation peaks. These modified circular harmonic expansions were arranged in the input plane as reference patterns together with an arbitrary target pattern, and the correlation signals between them were calculated in the subtracted joint transform correlator. The fraction of the correlation-peak intensities between the target and the references were extracted as a new discrimination parameter. This new parameter performs pattern recognition under rotation and brightness invariance with good discriminability. Its high discriminability has been proved in computer simulations using the face image patterns of many individuals.     

Effects of threshold on single-target detection by using modified amplitude-modulated joint transform correlator

Effects of threshold value on detection performance of the modified amplitude-modulated joint transform correlator are quantitatively studied using computer simulation. Fingerprint and human face images are used as test scenes in the presence of noise and a contrast difference. Simulation results demonstrate that this correlator improves detection performance for both types of image used, but moreso for human face images. Optimal detection of low-contrast human face images obscured by strong noise can be obtained by selecting an appropriate threshold value.     

Spectral band independent recognition in a differential binary joint transform correlator

Images of a target in a specific spectral band in general show no correlation with images of the same target in a different spectral band. Hence in a joint transform correlator (JTC) architecture, if the reference and input target are the images captured through a visible (e.g., charge-coupled device or CCD camera) and infrared (IR) detector, autocorrelation peaks are not obtained. This drawback has been overcome in this paper by the use of a CCD–IR fused image as the reference image. Daubechies wavelet transform, which produces the least root-mean-square (RMS) error in the fusion process in comparison to other wavelets, has been used for the purpose. A comparative analysis of the proposed idea has been carried out for the classical JTC (CJTC), binary JTC (BJTC) and differential binary JTC (DBJTC) algorithms. Since the DBJTC removes the dc completely and produces sharp correlation peaks compared to the other techniques, computer simulation and experimental results are shown for the proposed idea using DBJTC. The same fused reference image has also been used to identify multiple targets in a scene using DBJTC. Performance measures like correlation peak intensity (CPI), dc/ac and peak correlation energy (PCE) have been calculated as metrics of goodness for the proposed scheme.     

Multitarget Detection Using a Hybrid Optical Joint Transform Correlator with Power Spectrum Subtraction

Multitarget detection using a hybrid optical joint transform correlator with power spectrum subtraction is proposed. This architecture is a programmable single spatial light modulator joint transform correlator. It consists of a liquid crystal display panel, an imaging lens, and a liquid crystal light valve to enhance resolution and space-bandwidth production. In this technique, it has two joint images in the input plane. In the second joint image, the reference image is contrast-reversal. With this technique, the second joint power spectrum is subtracted from the first joint power spectrum and the subtracted joint power spectrum is then taken the inverse Fourier transform. This technique is found to yield better correlation output performance than that of the classical joint transform correlator. Computer simulation results and the optical experimental results for input scene of the multitarget are given.The results have verified the correctness of the system design and performance analysis.     

Resolution-enhanced 3D image correlator using computationally reconstructed integral images

In this paper, a novel resolution-enhanced three-dimensional (3D) image correlator using the computationally reconstructed integral images is proposed in order to extract target object’s 3D location data in a scene. Elemental images of the reference and target objects are picked up by lenslet arrays and using these elemental images, reference and target plane images are reconstructed on the output plane by means of a modified computational integral imaging reconstruction technique. Then, through cross-correlations between the reconstructed reference and the target plane images, 3D location data of the target object can be extracted from the correlation outputs. With the purpose of showing the feasibility of the proposed method, some computational and optical experiments on the target objects in space are carried out and the results are presented.     

Spectral band invariant wavelet-modified MACH filter

Filters synthesized with images of a specific spectral band in general fail to recognize targets in a different spectral band. In this paper, we therefore demonstrate the use of the wavelet-modified maximum average correlation height (WaveMACH) filter for automatic target recognition applications in both the visible and infrared (IR) spectral bands. As any input target appears different when imaged through two different sensors, i.e., a CCD or an IR camera, a WaveMACH filter synthesized using a CCD image shows no correlation with the image of the same target from an IR camera and vice-versa. Hence, separate filters are required to match the input targets from the two sensors. To avoid the synthesis and storage of separate filters, the images from CCD and IR camera are fused using Daubechies wavelet and then the rotation-invariant WaveMACH filter generated with the fused image. In all, 18 WaveMACH filters (each of 20° range) are required for in-plane rotation invariance in both the spectral bands for the full range of 0–360°. Computer simulation and experimental results implemented in hybrid digital–optical correlator architecture are shown for the proposed idea. The same filters have also been used to identify multiple targets in a scene. Performance measures like peak-to-sidelobe ratio (PSR), peak correlation energy (PCE) and correlation peak intensity (CPI) have been calculated as metrics of goodness.     

Multitarget Detection Using a Hybrid Optical Joint Transform Correlator with Power Spectrum Subtraction

１ＩｎｔｒｏｄｕｃｔｉｏｎＦｏｒｍｕｌｔｉｔａｒｇｅｔｄｅｔｅｃｔｉｏｎ,ｔｈｅｊｏｉｎｔｔｒａｎｓｆｏｒｍｃｏｒｅｌａｔｏｒ（ＪＴＣ）ｉｓａｎｅｘｔｒｅｍｅｌｙｕｓｅｆｕｌａｒｃｈｉｔｅｃｔｕｒｅ［１］．ＨｏｗｅｖｅｒｔｈｅｃｌａｓｉｃａｌＪＴＣｐ...     

多目标识别的联合变换相关器的研究

提出了一种可用于多目标识别的联合变换相关器。为改善相关信号的性能,对功率谱作了优化处理。为消除相关面上的零级项和目标间的相关项,可用联合功率谱减去纯目标输入的功率谱和参考图像的功率谱;为增强和锐化相关峰,将相减的功率谱作指数函数滤波处理。分析了指数滤波参数对相关结果的影响。计算机模拟结果表明,这种相关器所输出的相关信号比经典联合变换相关器和二元联合变换相关器输出的相关信号更好,互相关得到了抑制,自相关得到了增强,具有很好的抗噪能力。     

基于相位编码的畸变不变联合变换相关器的设计

采用综合鉴别函数(SDF)的方法合成几个子参考图象,用于解决畸变不变识别问题.通过相位编码技术和对联合功率谱的振幅调制,缩小了零级相关峰的宽度,锐化了相关峰,消除了多目标输入时各目标图象之间的互相关项和参考图象及各目标图象之间的共轭相关项,增强了对目标定位和识别的能力,最后给出计算机模拟结果.     

使用振幅调制和功率谱相减的联合变换相关器作多目标检测

提出一种使用振幅调制和功率谱相减的联合变换相关器作多目标检测，这一方法对联合功率谱作了修正，先将联合功率谱减去纯输入景物的功率谱和参考图象的功率谱，再将所得修正的联合功率谱乘以振幅调制滤波函数。分析和量化了输入景物噪声对联合变换相关器性能的影响。这种方法比条纹调节的联合变换相关器和修正的条纹调节的联合变换相关器能产生更好的相关输出和适应输入景物噪声的能力。     

基于多变量鉴别分析的光学畸变不变性图像识别

提出一种基于鉴别分析的光学畸变不变性图像识别方法：对包含各种畸变的训练图像集采用主成分分析得到若干本征图像,作为参考模式与测试图像做光学相关,利用本民输入图像的相关结果作为识别特征,采用最佳鉴别分析做了训练和识别,即可实现对输入图像的畸变为性快速识别。采用非相干光相关器为光学实现硬件,给出了实验结果。     

基于液晶光阀非线性变换的实时光学相关识别

提出了一种高鉴别能力的实时光学相关器，它采用液晶光阀作为实时输入器件，并利用其非线性变换特性对图像微分预处理，全息记录材料采用光折变晶体，且使用全取球面波作参考光。所给出的实验结果表明，该光学相关具有鉴别能力高，实时性和灵活性强，以及结构２紧凑的特点。