Quantitative analysis of routine chemical constituents in tobacco by near-infrared spectroscopy and support vector machine

It is important to monitor quality of tobacco during the production of cigarette. Therefore, in order to scientifically control the tobacco raw material and guarantee the cigarette quality, fast and accurate determination routine chemical of constituents of tobacco, including the total sugar, reducing sugar, Nicotine, the total nitrogen and so on, is needed. In this study, 50 samples of tobacco from different cultivation areas were surveyed by near-infrared (NIR) spectroscopy, and the spectral differences provided enough quantitative analysis information for the tobacco. Partial least squares regression (PLSR), artificial neural network (ANN), and support vector machine (SVM), were applied. The quantitative analysis models of 50 tobacco samples were studied comparatively in this experiment using PLSR, ANN, radial basis function (RBF) SVM regression, and the parameters of the models were also discussed. The spectrum variables of 50 samples had been compressed through the wavelet transformation technology before the models were established. The best experimental results were obtained using the (RBF) SVM regression with gamma=1.5, 1.3, 0.9, and 0.1, separately corresponds to total sugar, reducing sugar, Nicotine, and total nitrogen, respectively. Finally, compared with the back propagation (BP-ANN) and PLSR approach, SVM algorithm showed its excellent generalization for quantitative analysis results, while the number of samples for establishing the model is smaller. The overall results show that NIR spectroscopy combined with SVM can be efficiently utilized for rapid and accurate analysis of routine chemical compositions in tobacco. Simultaneously, the research can serve as the technical support and the foundation of quantitative analysis of other NIR applications.     

最小角回归结合核极限学习机的近红外光谱对柑橘黄龙病的鉴别

传统的柑橘黄龙病检测方法存在准确度低、稳定性差等问题,该文提出了一种基于最小角回归结合核极限学习机(Least angle regression combined with kernel extreme learning machine,LAR-KELM_((RBF)))的近红外柑橘黄龙病鉴别方法。该方法将光谱数据通过小波变换进行预处理,然后用最小角回归(LAR)算法进行光谱波长的筛选,最后通过核极限学习机(KELM_((RBF)))实现样本的分类。实验采用柑橘叶片的近红外光谱数据,验证了LAR-KELM_((RBF))算法的性能,其分类准确度最高为99.91%,标准偏差为0.11。不同规模训练集的实验结果表明,LAR-KELM_((RBF))模型较极限学习机(ELM)、波形叠加极限学习机(SWELM)、反向传播神经网络(BP_((2层)))、KELM_((RBF))和支持向量机(SVM)模型分类准确度高、稳定性强,能够广泛应用于柑橘黄龙病的检测鉴别。     

Feasibility study on qualitative and quantitative analysis in tea by near infrared spectroscopy with multivariate calibration

This study attempted the feasibility to use near infrared (NIR) spectroscopy as a rapid analysis method to qualitative and quantitative assessment of the tea quality. NIR spectroscopy with soft independent modeling of class analogy (SIMCA) method was proposed to identify rapidly tea varieties in this paper. In the experiment, four tea varieties from Longjing, Biluochun, Qihong and Tieguanyin were studied. The better results were achieved following as: the identification rate equals to 90% only for Longjing in training set; 80% only for Biluochun in test set; while, the remaining equal to 100%. A partial least squares (PLS) algorithm is used to predict the content of caffeine and total polyphenols in tea. The models are calibrated by cross-validation and the best number of PLS factors was achieved according to the lowest root mean square error of cross-validation (RMSECV). The correlation coefficients and the root mean square error of prediction (RMSEP) in the test set were used as the evaluation parameters for the models as follows: R = 0.9688, RMSEP = 0.0836% for the caffeine; R = 0.9299, RMSEP = 1.1138% for total polyphenols. The overall results demonstrate that NIR spectroscopy with multivariate calibration could be successfully applied as a rapid method not only to identify the tea varieties but also to determine simultaneously some chemical compositions contents in tea.     

基于近红外光谱技术与化学计量学的绿茶无损鉴别方法研究

该文利用近红外光谱技术结合化学计量学方法开发了不同品种绿茶的无损鉴别方法。通过近红外光谱技术得到了8个品种绿茶样品的近红外光谱,比较了单一以及优化组合光谱预处理方法对光谱的影响,利用无监督的主成分分析(PCA)与有监督的线性判别分析方法(LDA)分别构建了茶叶品种鉴别模型。结果表明：对比单一预处理方法,优化组合预处理具有更优的鉴别准确性。标准正态变量变换预处理消除了茶叶样品大小不均造成的光谱散射影响,一阶导数预处理实现了变动背景的消除,减少了基线漂移的影响,突出了图谱中的有效信息,采用二者相结合的预处理方式并结合无监督的主成分分析法可实现较为准确的绿茶样品种类鉴别分析,准确率达75.0%。此外,采用有监督的线性判别分析方法处理原始光谱数据,可达到100%的鉴别准确率,但该方法需提供类别的先验知识。因此,采用近红外光谱技术和化学计量学相结合的手段可实现不同品种绿茶的快速无损鉴别。     

Discrimination of Ganoderma lucidum according to geographical origin with near infrared diffuse reflectance spectroscopy and pattern recognition techniques

A rapid and nondestructive near infrared (NIR) method combined with chemometrics was used to discriminate Ganoderma lucidum according to cultivation area. Raw, first, and second derivative NIR spectra were compared to develop a robust classification rule. The chemical properties of G. lucidum samples were also investigated to find out the difference between samples from six varied origins. It could be found that the amount of polysaccharides and triterpenoid saponins in G. lucidum samples was considerably different based on cultivation area. These differences make NIR spectroscopic method viable. Principal component analysis (PCA), discriminant partial least-squares (DPLS) and discriminant analysis (DA) were applied to classify the geographical origins of those samples. The results showed that excellent classification could be obtained after optimizing spectral pre-treatment. For the discriminating of samples from three different provinces, DPLS provided 100% correct classifications. Moreover, for samples from six different locations, the correct classifications of the calibration as well as the validation data set were 96.6% using the DA method after the SNV first derivative spectral pre-treatment. Overall, NIR diffuse reflectance spectroscopy using pattern recognition was shown to have significant potential as a rapid and accurate method for the identification of herbal medicines.     

Raman spectroscopy in combination with background near-infrared autofluorescence enhances the in vivo assessment of malignant tissues

The diagnostic ability of optical spectroscopy techniques, including near-infrared (NIR) Raman spectroscopy, NIR autofluorescence spectroscopy and the composite Raman and NIR autofluorescence spectroscopy, for in vivo detection of malignant tumors was evaluated in this study. A murine tumor model, in which BALB/c mice were implanted with Meth-A fibrosarcoma cells into the subcutaneous region of the lower back, was used for this purpose. A rapid-acquisition dispersive-type NIR Raman system was employed for tissue Raman and NIR autofluorescence spectroscopic measurements at 785-nm laser excitation. High-quality in vivo NIR Raman spectra associated with an autofluorescence background from mouse skin and tumor tissue were acquired in 5 s. Multivariate statistical techniques, including principal component analysis (PCA) and linear discriminant analysis (LDA), were used to develop diagnostic algorithms for differentiating tumors from normal tissue based on their spectral features. Spectral classification of tumor tissue was tested using a leave-one-out, cross-validation method, and the receiver operating characteristic (ROC) curves were used to further evaluate the performance of diagnostic algorithms derived. Thirty-two in vivo Raman, NIR fluorescence and composite Raman and NIR fluorescence spectra were analyzed (16 normal, 16 tumors). Classification results obtained from cross-validation of the LDA model based on the three spectral data sets showed diagnostic sensitivities of 81.3%, 93.8% and 93.8%; specificities of 100%, 87.5% and 100%; and overall diagnostic accuracies of 90.6%, 90.6% and 96.9% respectively, for tumor identification. ROC curves showed that the most effective diagnostic algorithms were from the composite Raman and NIR autofluorescence techniques.     

基于近红外光谱分析技术的栽培香菇产地快速鉴别

建立了一种基于近红外光谱分析技术的香菇产地鉴别方法。利用近红外光谱仪扫描不同主产地的香菇干样,获得样品的近红外漫反射光谱。利用偏最小二乘判别分析(PLSDA)分别建立了吉林、湖北、福建3个省份栽培香菇的产地判别模型,同时使用光谱预处理和波长筛选技术对判别模型进行优化,最后使用预测样品对模型进行验证。结果表明,使用原始光谱建立的模型能够初步实现对产地的判别,使用光谱预处理技术扣除光谱中的背景信息,同时利用波长筛选技术选择特定波长对模型进行优化后,可进一步提高预测正确率。该方法为香菇产地真实性溯源提供了一种新方法,对香菇产业发展具有重要的实际意义。     

基于多阶导数拉曼光谱组合技术的矿物油模式分类

为了实现对法庭科学领域重质矿物油物证的快速、准确、无损的鉴定,该文基于光谱分析技术提出了一种多阶导数光谱数据组合分析的方法。收集了80种不同型号、不同厂家的重质矿物油样本,利用傅里叶变换拉曼光谱分析法采集样本的原始光谱数据和导数光谱数据,并通过结合化学计量学构建分类模型。在构建的主成分分析(PCA)结合径向基函数神经网络(RBF)分类模型中,对单独的原始光谱、一阶导数谱和二阶导数谱数据的训练集准确率分别为80.0%、86.7%和86.2%,测试集准确率分别为73.3%、80.0%和72.7%;对组合后的原始光谱+一阶导数谱、原始光谱+二阶导数谱和一阶导数谱+二阶导数谱数据的分类中,训练集准确率分别为97.0%、96.7%和100%,测试集准确率分别为85.7%、90.0%和100%。结果表明,对组合后的导数光谱与原始光谱构建分类模型,准确率更高。其中,基于一阶导数谱+二阶导数谱数据构建的PCA结合RBF分类模型的结果最为理想,准确率达100%。而K最近邻算法模型由于受到样本不均匀的影响,整体分类准确率均较低。利用组合的导数光谱与原始光谱数据构建分类模型能够实现对重质矿物油样本的快速、准确、无损鉴别,可为光谱组合技术在法庭科学及其他分析测试领域的应用提供一定的借鉴和参考。     

偏最小二乘法在红外光谱识别茶叶中的应用

采用漫反射傅立叶变换红外光谱(FTIR)法结合主成分分析(PCA)、偏最小二乘法(PLS)、簇类的独立软模式(SIMCA)识别法对十三种茶叶进行了分类判别研究。研究结果表明,通过多元散射校正(MSC)对原始光谱进行预处理,可以提高模式识别技术的分类判别效果。在此基础上,选取1 900~900 cm-1波长范围内的茶叶红外光谱建立识别模型,三种方法都得到了满意的分类判别效果。在对检验集中全部130个样本的判别中,PCA仅有两类样本无法判别,SIMCA的识别率和拒绝率都在90%以上,而PLS的识别效果最佳,全部样本都得到了正确的归类。这一研究结果表明傅立叶变换红外光谱法与化学计量学方法相结合可以实现茶叶品种的快速鉴别,这为茶叶的客观评审提供了一种新思路。     

Feasibility of Rapid Diagnosis of Colorectal Cancer by Near-Infrared Spectroscopy and Support Vector Machine

The feasibility of diagnosing colorectal cancers based on the combination of near-infrared (NIR) spectroscopy and supervised pattern recognition methods was investigated. A total of fifty-eight colorectal tissues were collected and prepared. The spectra were first preprocessed by standard normalize variate (SNV) and first derivatives of Savitzky-Golay polynomial filter for removing unwanted background variances. The information of CH-stretching overtones and combination regions proved to be the most valuable. Four pattern recognition methods including K-nearest neighbor classifier (KNN), perceptron, Fisher discriminant analysis (FDA), and support vector machine (SVM) were used for constructing classifiers. In terms of the total accuracy, sensitivity and specificity, the SVM classifier achieved the best performance; the sensitivity and specificity were 92.8% and 86.7%, respectively. These findings suggest that NIR spectroscopy offers the possibility of constructing a simple, feasible and sensitive method for diagnosing colorectal cancer, avoiding the need of laborious visual inspection from experts.     

一种基于最小二乘支持向量机算法的近红外光谱判别分析方法

将最小二乘支持向量机(LSSVM)用于近红外(NIR)光谱分析,建立一种新型的NIR光谱快速鉴别方法。以丹参药材道地性鉴别为例,对其NIR漫反射光谱进行主成分分析后,运用LSSVM法建立NIR光谱非线性分类模型,对丹参药材道地性进行快速鉴别。将本方法与经典SVM和BP神经网络法相比较,结果表明,本法判别准确率高,计算时间少,可推广应用于中药等天然产物质量快速鉴别。     

Feasibility of monitoring acetic acid process using near-infrared spectroscopy

Near-infrared (NIR) spectroscopy has been utilized to demonstrate its feasibility for the measurement of major components in the acetic acid process. In order to simulate the acetic acid process, synthetic mixtures were prepared from five different components: acetic acid, methyl acetate, methyl iodide, water, and potassium iodide. Partial least squares (PLS) regression was utilized to differentiate the spectral characteristics as well as to quantify each component for the mixtures. The spectral features of acetic acid, methyl acetate, methyl iodide, and water are noticeably different with each other over the entire NIR region. The quantity of iodide ion, which does not absorb NIR radiation, was determined using the wavelength shift and intensity change of water absorption band caused by the change of iodide ion concentration. The PLS calibration results of the five components show good correlation with reference data. They also demonstrate the technical feasibility of NIR spectroscopy for monitoring important components in the acetic acid process.     

Chemometric Techniques Applied for Classification and Quantification of Binary Biodiesel/Diesel Blends

In this paper, three different types of biodiesel, which were synthesized from peanut, corn, and canola oils, were characterized by positive-ion electrospray ionization (ESI) and Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR MS). Different biodiesel/diesel blends containing 2–90% (V/V) of each biodiesel type were prepared and analyzed by near infrared spectroscopy (NIR). In the next step, the chemometric methods of hierarchical clusters analysis (HCA), principal component analysis (PCA), and support vector machines (SVM) were used for exploratory analysis of the different biodiesel samples, and the SVM was able to give the best classification results (correct classification of 50 peanut and 50 corn samples, and only one misclassification out of 49 canola samples). Then, partial least squares (PLS) and multivariate adaptive regression splines (MARS) models were evaluated for biodiesel quantification. Both methods were considered equivalent for quantification purposes based on the values smaller than 5% for the root mean square error of calibration (RMSEC) and root mean square of validation (RMSEP), as well as Pearson correlation coefficients of at least 0.969. The combination of NIR to the chemometric techniques of SVM and PLS/MARS was proven to be appropriate to classify and quantify biodiesel from different origins.     

Near-infrared (NIR) spectroscopy for motor oil classification: From discriminant analysis to support vector machines

Near-infrared (NIR) spectroscopy is a non-destructive measurement technique for many chemical compounds that has proved its efficiency for laboratory and industrial applications (including petroleum industry). Motor oil classification is an important task for quality control and identification of oil adulteration. Type of motor oil base stock is a key factor in product price formation. In this paper we have tried to evaluate the efficiency of different methods for motor oils classification by base stock (synthetic, semi-synthetic and mineral) and kinematic viscosity at low and high temperature. We have compared the abilities of seven (7) different classification methods: regularized discriminant analysis (RDA), soft independent modelling of class analogy (SIMCA), partial least squares classification (PLS), K-nearest neighbour (KNN), artificial neural network - multilayer perceptron (ANN-MLP), support vector machine (SVM), and probabilistic neural network (PNN) - for classification of motor oils. Three (3) sets of near-infrared spectra (1125, 1010, and 1050 items) were used for classification of motor oils into three or four classes. In all cases NIR spectroscopy was found to be effective for motor oil classification when combined with an effective multivariate data analysis (MDA) technique. SVM and PNN chemometric techniques were found to be the most effective ones for classification of motor oil based on its NIR spectrum.     

差分拉曼光谱结合SVM对便签纸的鉴别分析

基于差分拉曼光谱技术与支持向量机(SVM)模型,提出了一种对便签纸类检材的快速可视化鉴别方法。实验获取了40组不同品牌便签纸样本的差分拉曼光谱数据,利用BP神经网络和差分技术完成谱图的除噪与基线校正后,借助F检验与主成分分析提取谱段信息,构建出SVM分类模型。实验结果表明,当设置Linear为SVM模型的核函数时,可以实现对样本测试集的完全准确划分,K折交叉验证的结果理想。相比于传统聚类分析手段,本方法可以在原始高维光谱数据中筛选出有效特征矩阵,且SVM模型兼具高效性和准确性,为公安实践中纸张类物证的区分鉴别提供一种新思路。     

应用小波特征提取肺癌组织FTIR的支持向量机分类方法研究

提出了一种新的基于傅里叶变换红外光谱(Fourier Transform Infrared Spectroscopy, FTIR)的小波特征提取与支持向量机(SVM)分类方法以提高FTIR对早期肺癌的诊断准确率. 对肺正常组织、早期肺癌及进展期肺癌组织的FTIR, 利用连续小波(CW)多分辨率分析法提取9个特征量, 支持向量机把其分为正常组与非正常组(包括早期肺癌和进展期肺癌), 对正常组织、早期肺癌和进展期肺癌的识别, 多项式核函数和径向基函数的识别准确率最高. 多项式核函数对正常组织、早期肺癌和进展期肺癌的识别准确率分别为100%, 95%及100%; 径向基函数分别为100%, 95%和100%. 实验结果表明FTIR-CW-SVM模式分类方法对正常肺癌组织、早期肺癌及进展肺癌的识别具有较好的可行性.     

Identification of Colorectal Cancer Using Near-Infrared Spectroscopy and Adaboost with Decision Stump

Rapid and objective detection of cancer is crucial for successful treatment. Near-infrared (NIR) spectroscopy is a vibrational technique capable of optically probing molecular changes associated with disease. The purpose of this study was to explore NIR spectroscopy for discriminating cancer from normal colorectal tissues. A total of 110 tissue samples from patients who underwent operations were characterized in this study. The popular ensemble technique AdaBoost was used to construct the diagnostic model. A decision stump was used as the weak learning algorithm. Adaboost with decision stump, an ensemble of weak classifiers, was compared with the most suitable single model, a strong classifier. Only the 20 most significant variables were selected as inputs for the model based on measured defined variable importance. Using an independent test set, the single strong classifier provided diagnostic accuracy of 89.1%, sensitivity of 100%, and specificity of 78.6%, whereas the ensemble of weak stumps provided accuracy of 96.3%, sensitivity of 96.3%, and specificity of 96.3% for distinguishing cancer from normal colorectal tissues. Therefore, NIR spectroscopy in combination with AdaBoost with decision stumps has demonstrated potential for rapid and objective diagnosis of colorectal cancer.     

Rapid and label-free classification of pathogens based on light scattering,reduced power spectral features and support vector machine

The rapid identification of pathogens is crucial in controlling the food quality and safety. The proposed system for the rapid and label-free identification of pathogens is based on the principle of laser scattering from the bacterial microbes. The clinical prototype consists of three parts: the laser beam, photodetectors, and the data acquisition system. The bacterial testing sample was mixed with 10 mL distilled water and placed inside the machine chamber. When the bacterial microbes pass by the laser beam, the scattering of light occurs due to variation in size, shape, and morphology. Due to this reason, different types of pathogens show their unique light scattering patterns. The photo-detectors were arranged at the surroundings of the sample at different angles to collect the scattered light. The photodetectors convert the scattered light intensity into a voltage waveform. The waveform features were acquired by using the power spectral characteristics, and the dimensionality of extracted features was reduced by applying minimal-redundancy-maximal-relevance criterion (mRMR). A support vector machine (SVM) classifier was developed by training the selected power spectral features for the classification of three different bacterial microbes. The resulting average identification accuracies of E. faecalis,E. coli and S. aureus were 99%, 87%, and 94%, respectively. The overall experimental results yield a higher accuracy of 93.6%, indicating that the proposed device has the potential for label-free identification of pathogens with simplicity, rapidity, and cost-effectiveness.     

Untargeted Identification of Black Rice by Near-Infrared Spectroscopy and One-Class Models

Black rice is one of the famous rare rice varieties in China. It is common to sell inferior black rice intentionally declared as famous brands due to economical motivation. There is an urgent need to develop an analytical method for untargeted identification of black rice. The present work focuses on exploring the feasibility of the untargeted identification of black rice by the combination of near-infrared (NIR) spectroscopy and data driven-based class modeling and variable selection. A total of 142 samples of three brands were collected and used for measurements. The samples of a specific class were used as the target class. Principal component analysis was applied for the preliminary analysis. The model-independent variable selection method, i.e., joint mutual information, was used for spectral compression. Only the 10 most informative variables were picked from original variables based on which an optimal class-model for the target class was constructed and validated by means of an external test set. As a result, the model achieved 100% of sensitivity and specificity. It can be concluded that NIR spectroscopy combined with one-class modeling is a feasible tool for the untargeted identification of black rice.     

Passive Airborne Fourier Transform Infrared Remote Detection of Methanol by Use of Wavelet Analysis as A Feature Extraction Method

Wavelet analysis was evaluated as a data preprocessing tool in the construction of automated classifiers for the detection of volatile organic compounds from passive Fourier transform infrared remote sensing data collected in a downward-looking mode from an aircraft platform. The discrete wavelet transform was applied to single-beam spectra and patterns were formed with either the wavelet coefficients directly or with spectra reconstructed with selected resolution levels of the wavelet decomposition. Automated classifiers were constructed with support vector machines (SVM) and used to detect releases of methanol from an industrial site. A key issue in this work was the desire to use data collected during controlled experiments on the ground to train the SVM classifiers. Spectral backgrounds in these ground-collected data are different than those encountered as the aircraft flies, however, and the development of successful classification models requires spectral preprocessing to suppress background signatures. Biorthogonal wavelets were used to generate patterns and resulted in SVM models that produced no missed methanol detections and false detection rates of less than 0.1% when applied to prediction data not used in the development of the model. The SVM classifiers constructed with wavelet processing were compared to one based on unprocessed spectra and also to one computed with spectra preprocessed with Butterworth high-pass digital filters.