基于多模型共识的偏最小二乘法用于近红外光谱定量分析

建立了多模型共识偏最小二乘(cPLS)建模方法, 并应用于烟草样品近红外(NIR)光谱与常规成分氯含量之间的建模研究, 探讨了建模参数对预测结果的影响. 结果表明, cPLS方法与传统的偏最小二乘算法(PLS)相比, 所建模型更稳定可靠, 预测结果也可得到了明显改善.     

LapRLSR for NIR spectral modeling and its application to online monitoring of the column separation of Salvianolate

A novel near infrared (NIR) modeling method—Laplacian regularized least squares regression (LapRLSR) was presented, which can take the advantage of many unlabeled spectra to promote the prediction performance of the model even if there are only few calibration samples. Using LapRLSR modeling, NIR spectral analysis was applied to the online monitoring of the concentration of salvia acid B in the column separation of Salvianolate. The results demonstrated that LapRLSR outperformed partial least squares (PLS) significantly, and NIR online analysis was applicable.     

A strategy for enhancing the reliability of near-infrared spectral analysis

Near-infrared (NIR) spectroscopy will present a more promising tool for quantitative measurement if the reliability of the calibration model is further improved. To achieve this purpose, a new partial least squares (PLSs) technique based on Monte Carlo (MC) resampling is proposed, which is named as MCPLS. In this method, the outliers are firstly removed based on probability statistics. Then, the models without outliers are averaged and combined into a single prediction model as done in a consensus modeling, which can greatly enhance the reliability of PLS calibration. To validate the effectiveness and universality of the proposed method, it was applied to two different sets of NIR spectra. It was found that MCPLS could effectively avoid the swamping and masking effects caused by multiple outliers. The results show that the method is of value to enhance the reliability of PLS model involving complex NIR matrices with a small number of outliers.     

Characterization of a Stable Adaptive Calibration Model Using Near-Infrared Spectroscopy and Partial Least Squares with a Kalman Filter

The calibration model of near-infrared (NIR) spectra established using the Kalman filter-partial least square (partial least squares combined with a Kalman filter) method can be adapted to outdated equipment, environmental changes, external samples, and other applications. However, the variance of the measurement noise estimation for NIR spectrum measurements cannot be easily obtained using Kalman filter-partial least squares; therefore, the variance in the measurement noise is often assumed to be zero for the Kalman filter-partial least square calibration model, which affects the stability of the model. In this study, the measured input and output data were used effectively, and the gamma test method for estimating the measurement noise variance was used to improve the stability of the Kalman filter-partial least square calibration model. First, an accurate estimation of the measurement noise variance was obtained, and accurate modeling was then performed using Kalman filter-partial least squares. Finally, 600 abandoned drilling fluid samples were used to confirm the validity of the proposed method. The Kalman filter-partial least square and gamma test-Kalman filter-partial least square methods are compared. Testing of external samples 401–600 demonstrated that the stability of the Kalman filter-partial least square model decreased. The root mean square error of the prediction of the Kalman filter-partial least square model was 27.135, which was worse than that of the gamma test-Kalman filter-partial least square model (20.307). The validation results show that the proposed method has better stability in tracking the evolution of the NIR spectrometer’s measurement state.     

组合偏最小二乘回归方法在近红外光谱定量分析中的应用

针对近红外光谱数据局部效应显著,变量个数多,彼此间常存在严重的复共线性,并多与样品组分含量呈非线性关系,构建一种组合非线性偏最小二乘回归(E-S-QPLSR)方法。它采用无重复采样技术(subag-ging),从训练样本中生成若干子样,然后每个子样通过二次多项式偏最小二乘回归(QPLSR),建立其子模型,并实现对训练样本因变量的定量预测,再将它们交由线性PLS算法用于计算各子模型的组合权系数。将该法应用于80个玉米样品的水组分含量与其近红外光谱的定量关系建模,效果良好,显示出很强的学习能力,所建模型的预报性能也优于其它方法。     

废旧涤/棉混纺织物近红外定量分析模型的建立及预测

将中红外光谱筛选出的598个纯涤、纯棉及涤/棉混纺样本采用GB/T 2910.11-2009法测定其涤、棉准确含量,其中校正集样本252个,验证集样本346个。使用便携式近红外光谱仪获取样本的原始近红外光谱(NIRS)。校正集样本依据回归系数的分布趋势和范围选取最佳建模谱区,并采用差分一阶导、S-G平滑和均值中心化相结合的方法对原始光谱进行预处理,利用偏最小二乘法(PLS)建立涤/棉混纺织物中涤含量的近红外(NIR)定量分析模型。同时分析了样本颜色对NIRS的影响,探讨了斜线光谱样本、奇异样本和不同组织结构织物对模型预测效果的影响。结果表明:利用PLS法建立的涤/棉混纺织物定量分析模型最优组合包含1个光谱区间和9个主成分因子,校正集相关系数(RC)为0.998,标准偏差(SEC)为0.908。为验证所建模型的有效性和实用性,对346个未参与建模的涤棉样本进行了预测,并将预测结果与国标法测定值进行方差分析,两种方法结果无显著差异,预测正确率达97%以上。模型的建立为废旧涤/棉混纺织物快速、无损分拣提供了基础数据库。     

粒子群算法结合支持向量机回归法用于近红外光谱建模

研究了最小二乘法支持向量机(LSSVM)应用于烟丝样品和小麦样品的近红外光谱建模,采用粒子群优化算法(PSO)优化LSSVM的参数。通过对烟草样品和小麦样品的近红外光谱建模和预测,并与常规的偏最小二乘法(PLS)比较发现,PSO-LSSVM法具有更好的预测效果和稳健性。     

Standardization of near infrared spectra measured on multi-instrument

Calibration model transfer is essential for practical applications of near infrared (NIR) spectroscopy because the measurements of the spectra may be performed on different instruments and the difference between the instruments must be corrected. An approach for calibration transfer based on alternating trilinear decomposition (ATLD) algorithm is proposed in this work. From the three-way spectral matrix measured on different instruments, the relative intensity of concentration, spectrum and instrument is obtained using trilinear decomposition. Because the relative intensity of instrument is a reflection of the spectral difference between instruments, the spectra measured on different instruments can be standardized by a correction of the coefficients in the relative intensity. Two NIR datasets of corn and tobacco leaf samples measured with three instruments are used to test the performance of the method. The results show that, for both the datasets, the spectra measured on one instrument can be correctly predicted using the partial least squares (PLS) models built with the spectra measured on the other instruments.     

A consensus successive projections algorithm – multiple linear regression method for analyzing near infrared spectra

The successive projections algorithm (SPA) is widely used to select variables for multiple linear regression (MLR) modeling. However, SPA used only once may not obtain all the useful information of the full spectra, because the number of selected variables cannot exceed the number of calibration samples in the SPA algorithm. Therefore, the SPA-MLR method risks the loss of useful information. To make a full use of the useful information in the spectra, a new method named “consensus SPA-MLR” (C-SPA-MLR) is proposed herein. This method is the combination of consensus strategy and SPA-MLR method. In the C-SPA-MLR method, SPA-MLR is used to construct member models with different subsets of variables, which are selected from the remaining variables iteratively. A consensus prediction is obtained by combining the predictions of the member models. The proposed method is evaluated by analyzing the near infrared (NIR) spectra of corn and diesel. The results of C-SPA-MLR method showed a better prediction performance compared with the SPA-MLR and full-spectra PLS methods. Moreover, these results could serve as a reference for combination the consensus strategy and other variable selection methods when analyzing NIR spectra and other spectroscopic techniques.     

Partial least squares density modeling (PLS-DM) – A new class-modeling strategy applied to the authentication of olives in brine by near-infrared spectroscopy

A new class-modeling method, referred to as partial least squares density modeling (PLS-DM), is presented. The method is based on partial least squares (PLS), using a distance-based sample density measurement as the response variable. Potential function probability density is subsequently calculated on PLS scores and used, jointly with residual Q statistics, to develop efficient class models. The influence of adjustable model parameters on the resulting performances has been critically studied by means of cross-validation and application of the Pareto optimality criterion. The method has been applied to verify the authenticity of olives in brine from cultivar Taggiasca, based on near-infrared (NIR) spectra recorded on homogenized solid samples. Two independent test sets were used for model validation. The final optimal model was characterized by high efficiency and equilibrate balance between sensitivity and specificity values, if compared with those obtained by application of well-established class-modeling methods, such as soft independent modeling of class analogy (SIMCA) and unequal dispersed classes (UNEQ).     

Selective removal of interference signals for near-infrared spectra of biomedical samples by using region orthogonal signal correction

New approach for chemometrics algorithm named region orthogonal signal correction (ROSC) has been introduced to improve the predictive ability of PLS models for biomedical components in blood serum developed from their NIR spectra in the 1280-1849 nm region. Firstly, a moving window partial least squares regression (MWPLSR) method was employed to locate the region due to water as a region of interference signals and to find the informative regions of glucose, albumin, cholesterol and triglyceride from NIR spectra of bovine serum samples. Next, a novel chemometrics method named searching combination moving window partial least squares (SCMWPLS) was used to optimize those informative regions. Then, the specific regions that contained the information of water, glucose, albumin, cholesterol and triglyceride were obtained. When an interested component in the bovine serum solution, such as glucose, albumin, cholesterol or triglyceride is being an analyte, the other three interests and water are considered as the interference factors. Thus, new approach for ROSC has employed for each specific region of interference signal to calculate the orthogonal components to the concentrations of analyte that were removed specifically from the NIR spectra of bovine serum in the region of 1280-1849 nm and the highest interference signal for model of analyte will be revealed. The comparison of PLS results for glucose, albumin, cholesterol and triglyceride built by using the whole region of original spectra and those developed by using the optimized regions suggested by SCMWPLS of original spectra, spectra treated OSC for orthogonal components of 1-3 and spectra treated ROSC using selected removing the highest interference signals from the spectra for orthogonal components of 1-3 are reported. It has been found that new approach of ROSC to remove the highest interference signal located by SCMWPLS improves of the performance of PLS modeling, yielding the lower RMSECV and smaller number of PLS factors.     

近红外光谱法快速测定涂料固化剂中游离甲苯二异氰酸酯含量

用气相色谱分析值为参照,采用近红外透射光谱（NIR）技术采集相应样品的NIR光谱,研究了涂料固化剂中游离甲苯二异氰酸酯（TDI）含量的快速测定分析方法。 并从120个固化剂样品中挑选出109个代表性的样品建模,选择7320~7250 cm-1和8485~8370 cm-1波段区间,用偏最小二乘法(PLS)和完全交互验证方式建立TDI含量的预测模型。 结果表明,固化剂中游离甲苯二异氰酸酯含量和近红外光谱之间存在较好的相关性,其预测模型的校正集均方差（RMSEC）为0.0815,验证集均方差（RMSEP）为0.0715,模型性能良好。 近红外光谱法可快速准确测定游离甲苯二异氰酸酯（TDI）含量,用于固化剂样品快速分析。     

段式正交信号校正方法及在小麦近红外光谱数据分析中的应用

针对光谱数据峰宽、局部效应显著、含有噪音、变量个数多及彼此间常存在严重的复共线性等问题,改进和设计一种光谱数据局部校正方法:基于窗口平滑的段式正交信号校正方法,并将之结合偏最小二乘回归,以实现光谱数据的预处理及定量分析。通过NIPALS算法初始化将滤去的正交成分,以近邻分段方式进行逐个波长点的正交信号校正。而后将去噪后的光谱矩阵作为新的自变量阵,通过偏最小二乘回归构建其与性质参变量间的校正模型。通过小麦近红外漫反射光谱数据的应用实验结果表明,本方法正交成分估计稳定,去噪明显,模型的预报性能优于其它方法,PLS成分数减少,模型更加简洁。     

Rapid quality assessment of Gentianae Macrophyllae Radix based on near-infrared spectroscopy and capillary electrophoresis

The aim of this study was to establish a rapid quality assessment method for Gentianae Macrophyllae Radix (RGM) using near-infrared (NIR) spectra combined with chemometric analysis. The NIR spectra were acquired using an integrating sphere diffuse reflectance module, using air as the reference. Capillary electrophoresis (CE) analyses were performed on a model P/ACE MDQ Plus system. Partial least squares-discriminant analysis qualitative model was developed to distinguish different species of RGM samples, and the prediction accuracy for all samples was 91%. The CE response values at each retention time were predicted by building a partial least squares regression (PLSR) calibration model with the CE data set as the Y matrix and the NIR spectra data set as the X matrix. The converted CE fingerprints basically match the real ones, and the six main peaks can be accurately predicted. Transforming NIR spectra fingerprints into the form of CE fingerprints increases its interpretability and more intuitively demonstrates the components that cause diversity among samples of different species and origins. Loganic acid, gentiopicroside, and roburic acid were considered quality indicators of RGM and calibration models were built using PLSR algorithm. The developed models gave root mean square error of prediction of 0.2592% for loganic acid, 0.5341% for gentiopicroside, and 0.0846% for roburic acid. The overall results demonstrate that the rapid quality assessment system can be used for quality control of RGM.     

基于导数光谱融合建模的红外光谱定量分析方法

设计了基于奇摄动技术的导数光谱估计器并提出基于不同阶次导数光谱空间的融合建模定量分析方法。方法充分利用导数光谱信息空间、区间最小二乘法和融合建模的优点,挖掘光谱深层次信息进行融合建模。分别利用麦汁浓度范围4.23~18.76° P (柏拉图度)的啤酒红外光谱公共数据集和配制的浓度为0.04%~5%范围的葡萄糖溶液实测光谱数据集进行定量分析方法的对比实验。实验结果表明,融合建模定量分析方法能获得最小的预测均方根误差(RMSEP),其值分别为0.121和0.087,能够准确地进行定量分析。与其它建模方法相比较,基于导数光谱的融合建模方法所建立的预测模型具有明显优越的性能。     

Determination of triglycerides in human serum by near-infrared diffuse reflectance spectroscopy using silver mirror as a substrate

Quantitative determination of serum triglycerides was achieved in diffuse reflectance mode using silver mirror as the substrate to enhance the spectral features.     

Nondestructive determination of compound amoxicillin powder by NIR spectroscopy with the aid of chemometrics

Near-infrared (NIR) spectroscopy, in combination with chemometrics, enables nondestructive analysis of solid samples without time-consuming sample preparation methods. A new method for the nondestructive determination of compound amoxicillin powder drug via NIR spectroscopy combined with an improved neural network model based on principal component analysis (PCA) and radial basis function (RBF) neural networks is investigated. The PCA technique is applied to extraction relevant features from lots of spectra data in order to reduce the input variables of the RBF neural networks. Various optimum principal component analysis-radial basis function (PCA-RBF) network models based on conventional spectra and preprocessing spectra (standard normal variate (SNV) and multiplicative scatter correction (MSC)) have been established and compared. Principal component regression (PCR) and partial least squares (PLS) multivariate calibrations are also used, which are compared with PCA-RBF neural networks. Experiment results show that the proposed PCA-RBF method is more efficient than PCR and PLS multivariate calibrations. And the PCA-RBF approach with SNV preprocessing spectra is found to provide the best performance.     

复杂样品近红外光谱定量分析模型的构建方法

针对复杂样品近红外光谱分析中校正集的设计问题, 探讨了标准样品参与复杂样品建模的可行性. 通过标准样品和复杂基质样品共同构建的偏最小二乘(PLS)模型, 考察了波段筛选和建模参数对预测结果的影响. 结果表明, 采用PLS方法建立定量模型时, 校正集样品性质应该尽量与预测集样品相似, 当样品的性质相差较大时, 适当增加校正集样品的差异性可使模型具有更强的预测能力. 同时, 波段优选对提高预测结果的准确性具有重要的意义.     

Treating NIR data with orthogonal discrete wavelet transform: Predicting concentrations of a multi-component system through a small-scale calibration set

Through randomly arranging samples of a calibration set, treating their NIR spectra with orthogonal discrete wavelet transform, and selecting suitable variables in terms of correlation coefficient test (r-test), it is possible to extract features of each component in a multi-component system respectively and partial least squares (PLS) models based on these features are capable of predicting the concentration of every component. What is perhaps more important, with the proposed strategy, the predictive ability of the model is at least not impaired while the size of the calibration set can be obviously reduced. Therefore, it provides a more economical, rapid, as well as convenient approach of NIR quantitative analysis for multi-component system. In addition, all important factors and parameters related to the proposed strategy are discussed in detail.     

A Partial Least Squares‐Based Consensus Regression Method for the Analysis of Near‐Infrared Complex Spectral Data of Plant Samples

Abstract

A consensus regression approach based on partial least square (PLS) regression, named as cPLS, for calibrating the NIR data was investigated. In this approach, multiple independent PLS models were developed and integrated into a single consensus model. The utility and merits of the cPLS method were demonstrated by comparing its results with those from a regular PLS method in predicting moisture, oil, protein, and starch contents of corn samples using the NIR spectral data. It was found that cPLS was superior to regular PLS with respect to prediction accuracy and robustness.