Sorting algorithms for single‐particle imaging experiments at X‐ray free‐electron lasers

Modern X‐ray free‐electron lasers (XFELs) operating at high repetition rates produce a tremendous amount of data. It is a great challenge to classify this information and reduce the initial data set to a manageable size for further analysis. Here an approach for classification of diffraction patterns measured in prototypical diffract‐and‐destroy single‐particle imaging experiments at XFELs is presented. It is proposed that the data are classified on the basis of a set of parameters that take into account the underlying diffraction physics and specific relations between the real‐space structure of a particle and its reciprocal‐space intensity distribution. The approach is demonstrated by applying principal component analysis and support vector machine algorithms to the simulated and measured X‐ray data sets.     

基于PCA和SVM的高光谱遥感图像分类研究

支持向量机(SVM)是根据统计学习理论提出的新的研究方法,它在解决小样本、非线性及高维模式识别问题中表现出了许多特有的优势,在模式识别、函数逼近和概率密度估计等方面取得了良好的效果。由于高光谱图像波段数目多,各波段间具有较强的相关性,因此通过主成分分析(PCA)方法对高光谱数据进行预处理,达到了降维的目的,同时也去除了噪声波段。用支持向量机方法对高光谱遥感图像进行分类,可实现图像的分类识别。     

Near-Infrared spectroscopy and hyperspectral imaging for non-destructive quality assessment of cereal grains

Hyperspectral imaging (HSI) combines spectroscopy and imaging, providing information about the chemical properties of a material and their spatial distribution. It represents an advance of traditional Near-Infrared (NIR) spectroscopy. The present work reviews the most recent applications of NIR spectroscopy for cereal grain evaluation, then focuses on the use of HSI in this field. The progress of research from ground material to whole grains and single kernels is detailed. The potential of NIR-based methods to predict protein content, sprout damage and α-amylase activity in wheat and barley is shown, in addition to assessment of quality parameters in other cereals such as rice, maize and oats, and the estimation of fungal infection. This analytical technique also offers the possibility to rapidly classify grains based on properties such as variety, geographical origin, kernel hardness, etc. Further applications of HSI are expected in the near future, for its potential for rapid single-kernel analysis.     

Detection of ochratoxin A contamination in stored wheat using near-infrared hyperspectral imaging

Near-infrared (NIR) hyperspectral imaging system was used to detect five concentration levels of ochratoxin A (OTA) in contaminated wheat kernels. The wheat kernels artificially inoculated with two different OTA producing Penicillium verrucosum strains, two different non-toxigenic P. verrucosum strains, and sterile control wheat kernels were subjected to NIR hyperspectral imaging. The acquired three-dimensional data were reshaped into readable two-dimensional data. Principal Component Analysis (PCA) was applied to the two dimensional data to identify the key wavelengths which had greater significance in detecting OTA contamination in wheat. Statistical and histogram features extracted at the key wavelengths were used in the linear, quadratic and Mahalanobis statistical discriminant models to differentiate between sterile control, five concentration levels of OTA contamination in wheat kernels, and five infection levels of non-OTA producing P. verrucosum inoculated wheat kernels. The classification models differentiated sterile control samples from OTA contaminated wheat kernels and non-OTA producing P. verrucosum inoculated wheat kernels with a 100% accuracy. The classification models also differentiated between five concentration levels of OTA contaminated wheat kernels and between five infection levels of non-OTA producing P. verrucosum inoculated wheat kernels with a correct classification of more than 98%. The non-OTA producing P. verrucosum inoculated wheat kernels and OTA contaminated wheat kernels subjected to hyperspectral imaging provided different spectral patterns.     

高光谱成像的柑橘病虫害叶片识别方法

为监测柑橘生长状况,实现病虫害无损识别,利用高光谱成像技术和机器学习方法进行柑橘病叶分类研究。使用高光谱成像仪采集46片柑橘正常叶、46片溃疡病叶、80片除草剂危害叶、51片红蜘蛛叶和98片煤烟病叶的高光谱图像,在478～900 nm光谱范围内对每个叶片一个或多个发病区提取5×5的感兴趣区域（ROI）,将ROI内每个像素的反射率值作为光谱信息,则一个ROI得到25个光谱信息样本,最终五类叶片共得到13250个光谱样本。利用随机法将全部样本划分为9 938个训练集和3 312个测试集。分别采用一阶求导（1stDer）、多元散射校正（MSC）和标准正态变换（SNV）三种方法对原始光谱信息进行预处理,对不同预处理方法后的数据采用主成分分析法（PCA）提取特征波长。1st Der预处理后得到7个特征波长,分别是520.2,689.0,704.8,715.4,731.2,741.8和757.6 nm;MSC和SNV预处理后得到7个相同的特征波长,分别是551.9,678.5,704.8,710.1,725.9,731.2和757.6 nm;原始光谱得到7个特征波长,分别是525.5,678.5,710.1,720.7,725.9,757.6和762.9 nm。分析PCA后的样本分布散点图可知,正常叶片、溃疡病叶片和红蜘蛛叶片样本有一定程度聚类,除草剂叶片和煤烟病叶片样本有大量重叠,仅依据PCA不能完成病虫害叶片的识别。对全波段（FS）和PCA特征波长数据在不同预处理方法下进行支持向量机（SVM）和随机森林（RF）建模,结果表明：数据在1stDer预处理方法下识别效果最佳,1st Der-FS-SVM模型总分类精度（OA）为95.98%,Kappa系数为0.948 2,1st Der-FS-RF模型OA为91.42%,Kappa系数为0.889 2,1stDer-PCA-SVM模型OA为90.82%,Kappa系数为0.881 6,1stDer-PCA-RF模型的OA为91.79%,Kappa系数为0.894;对PCA选择的特征波长数据建模,SVM和RF模型下识别率均达到84%,全波段下模型识别率在88%以上,FS数据建模效果优于PCA特征波长。研究结果表明,高光谱成像技术结合机器学习方法进行柑橘叶片分类是可行且有效的,为柑橘病虫害的无损准确识别提供理论根据。     

Simultaneous species and sex identification of silkworm pupae using hyperspectral imaging technology

To obtain high-quality raw silk and improve the economic values of sericulture industry, sex needs to be discriminated first before cross-breeding. Much work has been reported about sex identification. However, to realize automatic separation of silkworm pupae, the species also needs to be classified, which no research has ever explored. Hence, this paper studied the feasibility of visible and near-infrared hyperspectral imaging technology to identify the species and sex of silkworm pupae. 288 hyperspectral images of silkworm pupae were collected and the average spectra were extracted from the region of interest, around the tail region of silkworm pupae. Successive projection algorithm was served as a variable selection method to choose the optimal wavelengths from the full spectra. At the same time, principal component analysis was used to choose the characteristic images. Then, the gray-level co-occurrence matrix was implemented on the first three principal component images (accounted for 99.05% of the total variances) to extract 48 textural features. Partial least squares discriminant analysis and support vector machine models were built, respectively, based on the spectral data, textural data and fusion data that included spectral and textural data, in which the support vector machine model based on the fusion data, gave the best species and sex identification result with an accuracy of 95.83%. It demonstrated that the hyperspectral imaging technology could be a new and nondestructive method to replace the manual work.     

基于高光谱的大麦籽粒蛋白质含量遥感预测

利用高光谱信息检测作物籽粒蛋白质含量具有无损、快速的特点,而当前国内外开展大麦籽粒蛋白质含量高光谱遥感预测的研究并不多见。以内蒙古自治区海拉尔农垦大麦为研究对象,利用地面高光谱数据寻找大麦植株氮素含量的特征波段,分析了多种典型光谱植被指数与大麦植株氮素含量的相关关系;然后根据氮素运转规律,利用植株氮含量与大麦籽粒蛋白质含量之间的相关关系,构建了基于高光谱数据的大麦籽粒蛋白质含量遥感预测模型。结果表明:(1)550～590nm与670～710nm是大麦植株氮含量的敏感波段区域;(2)植被指数(green-red vegetation index,GRVI)与大麦植株含氮量的相关性最好,R2达到0.665 1。(3)大麦籽粒蛋白质含量与植株氮含量相关性高,建立了基于GRVI的大麦籽粒蛋白质含量的预测模型,R2达到0.658 1。最后,对构建的预测模型进行了验证,其精度达到了一定要求。该研究表明运用高光谱信息来预测大麦籽粒蛋白质含量是可行的,这将为大面积"按质论价"的大麦订单收购提供科学支撑。     

Study on the optimal algorithm prediction of corn leaf component information based on hyperspectral imaging

Genetic algorithm (GA) has a significant effect in the band optimization selection of Partial Least Squares (PLS) correction model. Application of genetic algorithm in selection of characteristic bands can achieve the optimal solution more rapidly, effectively improve measurement accuracy and reduce variables used for modeling. In this study, genetic algorithm as a module conducted band selection for the application of hyperspectral imaging in nondestructive testing of corn seedling leaves, and GA-PLS model was established. In addition, PLS quantitative model of full spectrum and experienced-spectrum region were established in order to suggest the feasibility of genetic algorithm optimizing wave bands, and model robustness was evaluated. There were 12 characteristic bands selected by genetic algorithm. With reflectance values of corn seedling component information at spectral characteristic wavelengths corresponding to 12 characteristic bands as variables, a model about SPAD values of corn leaves acquired was established by PLS, and modeling results showed r = 0.7825. The model results were better than those of PLS model established in full spectrum and experience-based selected bands. The results suggested that genetic algorithm can be used for data optimization and screening before establishing the corn seedling component information model by PLS method and effectively increase measurement accuracy and greatly reduce variables used for modeling.     

基于红边位置提取验证成像与非成像高光谱数据的一致性

定量遥感是当前遥感发展的前沿,作物组分信息解析是农业定量遥感的研究热点,而成像高光谱技术为解决微观尺度的作物组分信息探测研究提供了强有力的手段.利用成像光谱仪( pushbroom imaging spectrometer,PIS)与地物光谱仪(FieldSpec ProFR2500,ASD)同步收集冬小麦、玉米不同生...     

基于高光谱成像技术的番茄叶片灰霉病早期检测研究

提出了独立软模式法(SIMCA)的番茄叶片灰霉病特征波段图像的提取,并通过多元线性回归法(MLR)提取波段融合图像,通过最小距离法获取番茄灰霉病患病信息的技术路线。利用680～740 nm波段的方差图像和建模能力参数提取的特征波段,并作为输入变量进行MLR分析,在0.5准确率阈值下,准确率均大于99%,说明特征波段可以实现番茄叶片灰霉病的检测,并利用MLR回归系数提取波段融合图像,通过最小距离法获取番茄灰霉病患病信息,结果表明所提出的方法具有很好的预测能力,为番茄灰霉病的早期检测提供了一种新方法,且大大降低了高光谱图像的数据处理时间。     

基于可见光-近红外光谱的煤岩识别方法实验研究

以淮南矿区谢桥矿和潘二矿的煤和岩石样本为研究对象,通过地物光谱仪采集样本反射率光谱曲线,同时检测样本氧化物含量、水分、灰分及挥发分含量,将样本的反射率光谱曲线和样本成分含量分别作为自变量,样本类别“煤”和“岩石”两种矿物类型作为因变量,建立煤和岩石识别模型对煤和岩石进行二分类。该研究主要采用三种模型,分别为主成分分析结合支持向量机(PCA-SVM)、主成分分析结合BP神经网络(PCA-BP)模型和核主成分分析结合支持向量机(KPCA-SVM)模型。结果表明,基于可见光近红外光谱的三个模型中,核主成分分析结合支持向量机模型的识别精度最高,建模平均精度为95.5%,验证平均精度约为90.56%;基于样本成分的三个模型中,核主成分分析结合支持向量机模型的识别精度最高,建模平均精度为98.5%,验证平均精度约为95%。     

基于DPCA与LSSVM的飞机发动机异常状态识别

针对飞机发动机异常状态识别精度差、效率低和易误诊漏诊等问题,提出了一种基于动态主元分析 (Dynamic Principal Component Analysis, DPCA)和最小二乘支持向量机(Least Square Support Vector Machine, LSSVM)的飞机发动机润滑系统异常状态识别方法。首先对发动机润滑系统参数进行DPCA处理以及在线检测是否有故障发生,如果有故障发生,再采用LSSVM方法进行异常状态识别。以某型飞机发动机润滑系统为例,对文中所提方法的准确性进行试验验证,由试验结果得出文中方法能有效提高飞机发动机异常状态识别准确率。     

Application of hyperspectral imaging for characterization of intramuscular fat distribution in beef

In this study, a hyperspectral imaging system in the spectral region of 400–1000 nm was used for visualization and determination of intramuscular fat concentration in beef samples. Hyperspectral images were acquired for beef samples, and spectral information was then extracted from each single sample from the fat and non-fat regions. The intramuscular fat content was chemically extracted and quantified for the same samples. Chemometrics including analysis of variance (ANOVA) and spectral similarity measures involving spectral angle measure (SAM), and Euclidian distance measure (EDM) were then used to analyze the data. An ANOVA analysis indicates that the two selected spectral variables (e.g., 650.4–736.4 nm) are effective to generate ratio image for visualization of the intramuscular fat distribution in beef. The spectral similarity analysis methods, which is based on the quantifying the spectral similarities by using predetermined endmember spectrum vector, provided comparable results for characterization and detection of intramuscular fat in beef. In term of overall classification accuracy, spectral similarity measure methods outperformed the ratio image of selected bands based on the result of ANOVA analysis. The results demonstrate that proposed technique has a potential for fast and nondestructive determination of intramuscular fat in beef.     

高光谱成像的纸币真伪鉴别研究

人民币是中华人民共和国的法定货币,人民币的真假直接关系到我国社会的和谐与稳定。百元钞票作为我国最大面额钞票,其真假的鉴定显得更为重要。以2005版的百元钞票为例,利用可见/近红外高光谱成像仪获取一张真钞与两张假钞正、背面高光谱影像数据,然后分别在百元钞票的正、背面选取4个特征点,以分析百元真假钞票在正、背面的光谱反射率差异。从真假钞正面四个特征位置的光谱反射率曲线可知,不同特征点处,真钞与假钞之间的有些图案的光谱反射率差异较大,有些图案的光谱反射率则差异并不显著。而不同批次的假钞,其不同位置的光谱反射率也存在较大的差异。对于真假钞背面的分析可知,不同特征点,在不同的波段,真钞与假钞以及假钞之间的光谱反射率同样有一定的差异。根据真钞与假钞正、背面8个特征点的光谱反射率曲线变化特征,选取500, 660和870 nm三个波长的灰度图,观察到真钞与假钞在不同特征点的灰度图均表现出明显的差异。真钞在500 nm处的图像轮廓清晰,在660和870 nm两个波长,无论是正面或背面,真钞均有多处特征位置有异于假钞,因此可用660或870 nm区别百元真假钞。为了突出真钞与假钞之间的图像差异,利用基于...     

最小二乘支持向量机方法对冬小麦叶面积指数反演的普适性研究

冬小麦叶面积指数(leaf area index, LAI)是进行作物长势判断和产量估测的重要农学指标之一,高光谱遥感技术为大面积、快速监测植被LAI提供了有效途径。在探讨利用最小二乘支持向量机(least squares support vector machines, LS-SVM)方法和高光谱数据对不同条件下冬小麦LAI的估算能力。在用主成分分析法(principal component analysis, PCA)对PHI航空数据降维的基础上,利用实测LAI数据和高光谱反射率数据,构建LS-SVM模型,采用独立变量法,分别估算不同株型品种、不同生育时期、不同氮素和水分处理条件下的冬小麦LAI,并与传统NDVI模型反演结果对比。结果显示,每种条件下的LS-SVM 模型都具有比NDVI模型更高的决定系数和更低的均方根误差值, 即反演精度高于相应的NDVI模型。NDVI模型对不同株型品种、不同氮素和水分条件下冬小麦LAI估算精度不稳定,LS-SVM则表现出较好的稳定性。表明LS-SVM 方法利用高光谱反射率数据对于不同条件下的冬小麦LAI反演具有良好的学习能力和普适性。     

三维荧光光谱结合稀疏主成分分析和支持向量机的油类识别方法研究

石油污染的出现,导致生态环境遭到破坏。因此,油类识别方法的研究对于环境的保护具有重要意义。采用荧光光谱法获得石油光谱数据,并对其进行预处理,再通过降维方法来提取特征信息,最后利用模式识别算法进行分类,从而可以实现对油类的定性分析,因此研究一种更高效的数据降维方法以及识别分类算法极其重要。基于三维荧光光谱技术,利用稀疏主成分分析（SPCA）对FS920光谱仪测得的荧光光谱数据进行特征提取,再利用支持向量机（SVM）算法对提取的特征数据进行分类识别,获得了一种更加高效的油类识别方法。首先,利用海水和十二烷基硫酸钠（SDS）配制成浓度为0.1 mol·L-1的胶束溶液,将其作为溶剂配制柴油、航空煤油、汽油以及润滑油各20种不同浓度的溶液;然后,利用FS920光谱仪测得样本溶液的三维荧光光谱数据,对得到的光谱数据进行预处理;最后,对预处理后的数据分别利用SPCA和主成分分析（PCA）进行特征提取,再利用SVM和K最近邻（KNN）两种模式识别算法对特征向量进行分类,最终得到四种模型PCA-KNN,SPCA-KNN,PCA-SVM以及SPCA-SVM的分类结果。研究结果表明,由四种模型得到的分类准确率分别为85%,90%,90%和95%,其中,在同种分类算法中,利用SPCA进行特征提取得到的分类准确率均比PCA的准确率高5%,因此可知,SPCA的稀疏性具有突出主要成分的作用,在提取光谱特征时能够减小非必要成分的影响,并且载荷矩阵的稀疏化可以去除变量之间的冗余信息,优化降维特征信息,为后续分类提供更有效的数据特征信息;在同种特征提取算法下,利用SVM算法进行分类得到的分类准确率均比KNN算法得到的准确率高5%,表明SVM算法在分类中更具有优势。因此,本文利用三维荧光光谱技术结合SPCA和SVM算法,实现了对石油的准确识别与分类,为今后对石油污染物的高效检测提供了新思路。     

分子超光谱成像系统及其生物医学应用

设计出一种基于AOTF(acousto-optic tunable filters)的分子超光谱成像系统(MHSI).整个系统由显微镜、分光计、CCD镜头、数据采集卡和计算机等几部分组成.系统的光谱范围为550～1 000 nm,可采集225个波段,光谱分辨率优于2nm,空间分辨率达到0.3μm.由于系统的光源对样本的...     

基于支持向量机的非线性荧光光谱的识别

提出将支持向量机网络应用于含不同浓度杂质气体的非线性荧光光谱的识别。由于原始光谱数据的光谱通道数目很大,首先用小波变换去噪压缩,然后采用主成分分析方法对光谱信息进行连续两次的特征提取。在保持原光谱数据主要信息基本不变的情况下,将数据维数由3979压缩到514(小波变换)并提取9个主成分。这样,不仅减少了网络的输入维数,而且加快了网络的训练速度。实验结果表明,无论对训练样本还是未学习过的测试样本,其正确识别率均可达到100%。网络的训练和测试速度较快,可以更有效地应用于大气杂质气体的实时监测。     

应用高光谱图像光谱和纹理特征的番茄早疫病早期检测研究

提出了应用光谱和纹理特征的高光谱成像技术早期检测番茄叶片早疫病的方法。利用高光谱图像采集系统获取380～1 030 nm范围内71个染病和88个健康番茄叶片的高光谱图像,同时采用主成分分析法(PCA)对高光谱图像进行处理。选取染病和健康叶片感兴趣区域(region of interest, ROI)的光谱反射率值,同时分别从前8个主成分的每幅主成分图像的ROI中提取对比度(Contrast)、 相关性(Correlation)、 熵(Entropy)和同质性(Homogeneity)4个灰度共生矩阵的纹理特征值,再通过PCA和连续投影算法(SPA)结合最小二乘支持向量机(LS-SVM)构建番茄叶片早疫病的早期鉴别模型。建立的6个模型中,采用光谱反射率值的LS-SVM模型对番茄叶片早疫病的识别率最高,达到100%。结果表明,应用高光谱成像技术检测番茄叶片早疫病是可行的。     

基于相似性分类的高光谱主成分融合方法比较

为了提高复杂场景弱小目标高光谱融合图像的质量,提出了基于相似性分类的主成分融合方法。光谱数据像素向量的相似性测度分类产生类矩阵,通过由类矩阵主成分变换的降维投影矩阵来投影变换原有光谱数据,获得降维数据矩阵。对比了传统PCA与基于欧式距离分类的PCA(ED_PCA)、基于光谱角分类的PCA(SA_PCA)、基于光谱信息散度分类的PCA(SID_PCA)和基于正交投影散度分类的PCA(OPD_PCA)四种改进方法的融合性能。实验结果表明:SA_PCA和SID_PCA方法兼具了ED_PCA和OPD_PCA的优点,对比度提升较好,阈值参数不敏感,运行时间较短。