多传感器图像自动配准技术研究

多传感器图像自动配准技术是军事领域里多传感器图像融合的必要前提。根据配准的步骤综述了现有的多传感器图像自动配准技术,以可见光和红外图像配准为例,提出采用小波变换、图像处理技术和人工智能技术相结合的方法来解决这一难题。     

Study of mutual information multimodality medical image registration based on modified simplex optimization method

Because of a different imaging mechanism and highly complexity of body tissues and structures. Different modality medical images provide non-overlay complementary information. This has very important significance for multimodal medical image registration. Image registration is the first and key part of problem to be solved in the integrations. When the spatial position of two medical images is same, the registration could be achieved. For two CT and PET images, the principal axis method is adopted to achieve the rough registration. The modified simplex algorithm is employed to implement global search using the mutual information as similarity measure. The initial registration parameters are achieved through principal axis Based on the results of test, improved simplex method can adjust reflecting distance. Stepped-up optimization algorithm on the new experimental points through the methods of “reflection”, “enlargement”, “shrinkage” or “global systolic”. A mutual information registration based on modified simplex optimization method is presented in this paper to improve the speed of medical image registration.Results indicate that the proposed registration method prevents the optimizing process from falling into local extremum and improves the convergence speed while keeping the precision. The accurate registration of multimodal image with different resolutions is achieved.     

Automated registration of sequential breath-hold dynamic contrast-enhanced MR images: a comparison of three techniques

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly in use as an investigational biomarker of response in cancer clinical studies. Proper registration of images acquired at different time points is essential for deriving diagnostic information from quantitative pharmacokinetic analysis of these data. Motion artifacts in the presence of time-varying intensity due to contrast enhancement make this registration problem challenging. DCE-MRI of chest and abdominal lesions is typically performed during sequential breath-holds, which introduces misregistration due to inconsistent diaphragm positions and also places constraints on temporal resolution vis-à-vis free-breathing. In this work, we have employed a computer-generated DCE-MRI phantom to compare the performance of two published methods, Progressive Principal Component Registration and Pharmacokinetic Model-Driven Registration, with Sequential Elastic Registration (SER) to register adjacent time-sample images using a published general-purpose elastic registration algorithm. In all three methods, a 3D rigid-body registration scheme with a mutual information similarity measure was used as a preprocessing step. The DCE-MRI phantom images were mathematically deformed to simulate misregistration, which was corrected using the three schemes. All three schemes were comparably successful in registering large regions of interest (ROIs) such as muscle, liver, and spleen. SER was superior in retaining tumor volume and shape, and in registering smaller but important ROIs such as tumor core and tumor rim. The performance of SER on clinical DCE-MRI data sets is also presented.     

针对图像序列的快速低存储开销配准算法

针对序列图像配准问题，提出一种快速低存储开销配准算法。首先，生成一系列与具体图像内容无关的特征点。而后，使用正向-反向跟踪来获取稳定的特征点对,其中，正向跟踪用于获得所有可能的特征点对，反向跟踪用来得到正向-反向误差，并且利用此误差来获取最终稳定的特征点对。最后，在稳定特征点对的基础上通过归一化直接线性变换计算得到可用于图像配准的单应矩阵。实验表明该算法能够提供与优秀的传统算法相当的配准性能。由于该算法对序列中图像之间的连续性进行了充分利用，不仅降低了存储开销，还提高了运算速度。对480360的序列而言，该算法需要的存储开销仅为421 kB，且运算速度达到32 帧/s。     

基于特征点的对数极坐标变换图像配准算法

介绍了一种新的图像配准算法,可以很好地解决图像配准中的平移、旋转和缩放问题。算法的实现是首先使用SUSAN算子提取两幅图像的特征角点,剔除虚假的特征点(噪声点),然后使用改进对数极坐标变换和投影相关匹配算法实现特征点匹配;结合亚像素定位技术,可以进一步提高算法的精度。     

针对图像序列的快速低存储开销配准算法

针对序列图像配准问题,提出一种快速低存储开销配准算法。首先,生成一系列与具体图像内容无关的特征点。而后,使用正向-反向跟踪来获取稳定的特征点对,其中,正向跟踪用于获得所有可能的特征点对,反向跟踪用来得到正向-反向误差,并且利用此误差来获取最终稳定的特征点对。最后,在稳定特征点对的基础上通过归一化直接线性变换计算得到可用于图像配准的单应矩阵。实验表明该算法能够提供与优秀的传统算法相当的配准性能。由于该算法对序列中图像之间的连续性进行了充分利用,不仅降低了存储开销,还提高了运算速度。对480360的序列而言,该算法需要的存储开销仅为421 kB,且运算速度达到32 帧/s。     

Aligning 3D time-of-flight MRA datasets for quantitative longitudinal studies: evaluation of rigid registration techniques

Objective

3D Time-of-flight (TOF) magnetic resonance angiography is commonly used for vascular analyses. A quantification of longitudinal morphological changes usually requires the registration of TOF image sequences acquired at different time points. The aim of this study was to evaluate the precision of different 3D rigid registration setups such that an optimal quantification of morphological changes can be achieved.

Methods

Eight different rigid registration techniques were implemented and evaluated in this study using the target registration error (TRE) calculated based on 554 landmarks defined in twenty TOF datasets. The registration techniques differed in integration of brain and vessel segmentation masks and usage of a multi-resolution framework. Furthermore, the benefit of a prior volume-of-interest definition for registration accuracy was evaluated.

Results

The results revealed that the highest registration accuracies can be achieved using a multi-resolution framework and a cerebrovascular segmentation as mask. Numerically, a mean TRE of 1.1 mm was calculated. If applicable, a prior definition of a volume-of-interest allows a reduction of the TRE to only 0.6 mm.

Conclusion

TOF datasets should be registered using vessel segmentations as mask, multi-resolution framework and previous volume-of-interest definition if possible to obtain the highest registration precision. This is especially the case for longitudinal datasets that are separated by several months while the registration technique seems less important for datasets that are only separated by a few days.     

图像配准中几种特征点提取方法的分析与实验

研究了图像配准中常用的几种特征点提取方法。基于图像配准对特征提取方法的特殊要求,提出了一组量化的特征提取方法评价因子,能用于合理评价各种方法的性能、优点与缺点,为这些方法的改进提供指导性意见和比较依据。通过大量的实验,利用评价因子比较和分析了上述的几种常用特征提取方法的优缺点、适用环境,并提出改进建议。     

Thermal feature extraction of servers in a datacenter using thermal image registration

Thermal cameras provide fine-grained thermal information that enhances monitoring and enables automatic thermal management in large datacenters. Recent approaches employing mobile robots or thermal camera networks can already identify the physical locations of hot spots. Other distribution information used to optimize datacenter management can also be obtained automatically using pattern recognition technology. However, most of the features extracted from thermal images, such as shape and gradient, may be affected by changes in the position and direction of the thermal camera. This paper presents a method for extracting the thermal features of a hot spot or a server in a container datacenter. First, thermal and visual images are registered based on textural characteristics extracted from images acquired in datacenters. Then, the thermal distribution of each server is standardized. The features of a hot spot or server extracted from the standard distribution can reduce the impact of camera position and direction. The results of experiments show that image registration is efficient for aligning the corresponding visual and thermal images in the datacenter, and the standardization procedure reduces the impacts of camera position and direction on hot spot or server features.     

Accuracy of image registration between MRI and light microscopy in the ex vivo brain

A multistep procedure was developed to register magnetic resonance imaging (MRI) and histological data from the same sample in the light microscopy image space, with the ultimate goal of allowing quantitative comparisons of the two datasets. The fixed brain of an owl monkey was used to develop and test the procedure. In addition to the MRI and histological data, photographic images of the brain tissue block acquired during sectioning were assembled into a blockface volume to provide an intermediate step for the overall registration process. The MR volume was first registered to the blockface volume using a combination of linear and nonlinear registration, and two dimensional (2D) blockface sections were registered to corresponding myelin-stained sections using a combination of linear and nonlinear registration. Before this 2D registration, two major types of tissue distortions were corrected: tissue tearing and independent movement of different parts of the brain, both introduced during histological processing of the sections. The correction procedure utilized a 2D method to close tissue tears and a multiple iterative closest point (ICP) algorithm to reposition separate pieces of tissue in the image. The accuracy of the overall MR to micrograph registration procedure was assessed by measuring the distance between registered landmarks chosen in the MR image space and the corresponding landmarks chosen in the micrograph space. The average error distance of the MR data registered to micrograph data was 0.324±0.277 mm, only 8% larger than the width of the MRI voxel (0.3 mm).     

A variational approach to image registration in dynamic contrast-enhanced MRI of the human kidney

Kidney function can be accessed by dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) measurements which yield spatially resolved maps of physiological parameters like perfusion or filtration. The motion of the kidneys during the scan is a dominant limitation of the measurement quality, and image registration is necessary for accurate quantification. We analyzed the feasibility of applying an algorithm, originally developed for multimodal registration, to kidney perfusion time series. The algorithm uses a variational calculation scheme to align the images. In four out of five data sets, kidney motion could be reduced to below the spatial resolution of the images of 1.6 mm while preserving the enhancement pattern of kidney perfusion. Fitting a pharmacokinetic model to the data showed an average reduction of the Akaike fit error of 10% for the registered data, suggesting more stable parameters. We conclude that this image registration algorithm is feasible for correcting kidney motion in renal DCE-MRI.     

A nonrigid registration algorithm for longitudinal breast MR images and the analysis of breast tumor response

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) can estimate parameters relating to blood flow and tissue volume fractions and therefore may be used to characterize the response of breast tumors to treatment. To assess treatment response, values of these DCE-MRI parameters are observed at different time points during the course of treatment. We propose a method whereby DCE-MRI data sets obtained in separate imaging sessions can be co-registered to a common image space, thereby retaining spatial information so that serial DCE-MRI parameter maps can be compared on a voxel-by-voxel basis. In performing inter-session breast registration, one must account for patient repositioning and breast deformation, as well as changes in tumor shape and volume relative to other imaging sessions. One challenge is to optimally register the normal tissues while simultaneously preventing tumor distortion. We accomplish this by extending the adaptive bases algorithm through adding a tumor-volume preserving constraint in the cost function. We also propose a novel method to generate the simulated breast magnetic resonance (MR) images, which can be used to evaluate the proposed registration algorithm quantitatively. The proposed nonrigid registration algorithm is applied to both simulated and real longitudinal 3D high resolution MR images and the obtained transformations are then applied to lower resolution physiological parameter maps obtained via DCE-MRI. The registration results demonstrate the proposed algorithm can successfully register breast MR images acquired at different time points and allow for analysis of the registered parameter maps.     

Application of image enhancement method for digital images based on Retinex theory

The image enhancement and implementation of the methods for the digital image enhancement were studied. The characteristics of different image enhancement methods, including contrast enhancement, linear transformation, piecewise linear transformation, grayscale slice transformation and Retinex clearing algorithms were analyzed in detail. Retinex enhancement algorithms were studied and the implementation process for the Retinex algorithm is given. Finally, an example of image enhancement using the multi scale Retinex algorithm (MSR) is achieved. It is shown that MSR can realize the image color constancy, local dynamic range compression, color enhancement and the overall dynamic range compression under certain circumstances.     

Wavelet subspace decomposition of thermal infrared images for defect detection in artworks

Health of ancient artworks must be routinely monitored for their adequate preservation. Faults in these artworks may develop over time and must be identified as precisely as possible. The classical acoustic testing techniques, being invasive, risk causing permanent damage during periodic inspections. Infrared thermometry offers a promising solution to map faults in artworks. It involves heating the artwork and recording its thermal response using infrared camera. A novel strategy based on pseudo-random binary excitation principle is used in this work to suppress the risks associated with prolonged heating. The objective of this work is to develop an automatic scheme for detecting faults in the captured images. An efficient scheme based on wavelet based subspace decomposition is developed which favors identification of, the otherwise invisible, weaker faults. Two major problems addressed in this work are the selection of the optimal wavelet basis and the subspace level selection. A novel criterion based on regional mutual information is proposed for the latter. The approach is successfully tested on a laboratory based sample as well as real artworks. A new contrast enhancement metric is developed to demonstrate the quantitative efficiency of the algorithm. The algorithm is successfully deployed for both laboratory based and real artworks.     

神经网络在棱镜摄谱仪定量分析光谱中的应用

给出了采用BP神经网络拟合标准光源在棱镜摄谱仪的谱平面位置和相应波长的非线性函数,省去了和标准铁谱比对测量未知谱线波长,简化了光谱的定量分析,提高了仪器的自动化和智能化水平.     

分数傅里叶域中二维复图像相位恢复的混合输入输出算法

通过推广经典傅里叶域内的混合输入输出算法,研究分数傅里叶域内二维复图像的相位恢复问题。给出算法的具体实施过程,并进行了数值模拟。结果表明：对于级次在0与2之间的分数傅里叶变换,当级次在1/2与3/2之间时,该算法较好;对于其余的级次,该算法的效果不能令人满意。     

Variables selection for quantitative determination of cotton content in textile blends by near infrared spectroscopy

Investigations were initiated to develop near infrared (NIR) techniques coupled with variables selection method to rapidly measure cotton content in blend fabrics of cotton and polyester. Multiplicative scatter correction (MSC), smooth, first derivative (1Der), second derivative (2Der) and their combination were employed to preprocess the spectra. Monte Carlo uninformative variables elimination (MCUVE), successive projections algorithm (SPA), and genetic algorithm (GA) were performed comparatively to choose characteristic variables associated with cotton content distributions. One hundred and thirty-five and fifty-nine samples were used to calibrate models and assess the performance of the models, respectively. Through comparing the performance of partial least squares (PLS) regression models with new samples, the optimal model of cotton content was obtained with spectral pretreatment method of 2 Der-Smooth-MSC and variables selection method of MCUVE-SPA-PLS. The correlation coefficient of prediction (r_p) and root mean square errors of prediction (RMSEP) were 0.988% and 2.100%, respectively. The results suggest that NIR technique combining with variables selection method of MCUVE-SPA has significant potential to quantitatively analyze cotton content in blend fabrics of cotton and polyester; moreover, it could indicate the related spectral contributions.