近红外光谱定量校正模型的建立及应用

介绍了近红外光谱定量校正模型的建立步骤,从样品集的选择,光谱的采集,定量校正模型的建立和验证,到模型适用性判据的建立.在此基础上,剖析了影响近红外光谱分析结果的因素,并讨论了在实际应用过程中应注意的关键性问题.     

PDS用于不同温度下的近红外光谱模型传递研究

采用合适的计算方法可降低测定环境对近红外光谱校正模型稳健性的影响。该文以喷气燃料为研究对象,考察了分段直接校正算法对所建模型预测结果的影响,通过选择转移样品数及窗口宽度,建立了最佳的校正模型和光谱转移参数。结果表明,在20℃下建立近红外光谱校正模型,直接预测30℃下喷气燃料的密度,预测集样品均方根误差（RMSEP）为0.2031,而30℃近红外光谱采用分段直接校正算法模型转移后,预测集样品均方根误差（RMSEP）降低为0.1354,预测结果得到明显改善,有效地解决了样品温度对近红外光谱分析结果的影响。     

烟叶总还原糖近红外光谱稳健模型的建立及其在多台仪器的长期应用

该文使用基于光谱图像特征抽提的尺度不变特征变换（SIFT）的多步波长筛选方法建立了烟叶总还原糖（TRS）的近红外光谱（NIRS）稳健模型，实现了其在多台仪器的直接共享和长期应用。首先采用SIFT方法根据代表性主机样品光谱挑选特征光谱点集合Uc，然后从Uc中剔除样本光谱标准方差（SDSS）过低的点，挑选重要特征光谱点集合Uic，此两步波长筛选法简称为SIFT-SDSS。随后进一步从Uic中挑选对水分不敏感（Moisture-unsensitive,MUS）的波长点，得到重要且稳定的光谱点集合Uisc，此3步波长筛选法简称为SIFT-SDSSMUS。从2011～2013年采集的292个主机烟叶样品中按TRS浓度区间选择80%样品作为建模集，建立不同波长集合下烟叶TRS的偏最小二乘回归（PLSR）校正模型。结果表明，基于SIFT-SDSS两步波长筛选的光谱点建立的TRS模型传递到6台从机预测另外77个2011～2013年样品的TRS时，所有从机样品的平均相对误差绝对值（MARE）均小于6%，满足企业内控要求。该模型对5台近红外仪上2014～2020年各年度样品、1台近红外仪上2014～201...     

基于波数校准下傅里叶红外气体分析仪模型传递的研究

傅里叶变换红外光谱仪具有扫描速度快、分辨率高、波数精度高、灵敏度高和光谱范围宽等优点,因而应用于各个领域.但在实际应用中,由于仪器间的差异、仪器自身随时间的变化或者样品特性等问题,导致在一台仪器上建立的校正模型不能推广至其他仪器长期使用,使得傅里叶变换红外光谱法(FTIR)的应用受到了校正模型的限制,因此如何实现整机的...     

基于光谱比值分析的无标样近红外模型传递方法

测量环境及光谱仪台间差异导致近红外光谱(NIRS)模型传递到从机后,常产生较大误差。该文使用标准正态变量变换(SNV)+微分处理光谱消除光谱散射和基线漂移的影响,提出通过仪器间光谱信号比值分析筛选波长的方法(Screening wavelengths based on spectrum ratio analysis,SWSRA),选出仪器间一致性较好且样本间差异大的光谱特征波长,采用筛选出的波长信号建立待测性质的偏最小二乘近红外光谱定标模型。以80个玉米样品中水分、油、蛋白质含量及72个黄芩样品中黄芩苷含量的NIRS预测对该方法进行了检验。结果表明,SWSRA主机模型预测从机样品的各成分含量的平均相对误差均小于4.3%,明显优于全波长模型直接传递的结果,且其预测均方根残差RMSEP与文献报道的其他模型传递方法的结果相当或更优。SWSRA方法具有模型参数少、稳健、简便易行等优点,可以在同类型近红外光谱仪器之间实现模型的无标样传递。     

鱼粉近红外光谱模型传递应用研究

为探讨光栅型与傅里叶变换型近红外分析仪之间模型传递的应用效果,选取国产鱼粉为近红外光谱样本,DS2500F型近红外分析仪为源仪器,MPA型近红外分析仪为目标仪器,采用分段直接校正(PDS)方法实现近红外光谱传递。分别建立水分、粗蛋白质、粗脂肪、蛋氨酸和赖氨酸等组分的预测模型,通过交互验证决定系数(R2cv)、交互验证标准误差(RMSECV)、马氏距离(MD)、系统偏差(Bias)、预测均方根误差(RMSEP)和相对分析误差(RPD)等参数,多维度评估光谱传递后所建预测模型的效果。结果表明,DS2500F仪器的近红外光谱传递到MPA型仪器时,所建国产鱼粉的水分、粗蛋白质、粗脂肪、蛋氨酸、赖氨酸的预测模型与MPA型仪器原始预测模型各参数对比无显著差异,预测效果基本一致,说明国产鱼粉在DS2500F仪器上的近红外光谱通过传递可以替代MPA型仪器的原始光谱,间接实现了模型传递,且具有良好的适用性和共享性,可提高近红外预测模型的应用效率。     

近红外光谱技术对烟草pH值的快速测定

提出了一种基于近红外漫反射光谱技术快速测定烟草pH值的方法.采集不同烟草粉末样品的近红外漫反射光谱,并对其原始光谱数据进行一阶微分、二阶微分及平滑等预处理,用偏最小二乘法(PLS)方法建立pH值预测模型(建模样品572个).从光谱主成分分布和pH值分布方面考察了81个验证集样品,结果表明验证集样品分布范围较大,分布较合理.利用主仪器模型对验证集样品进行预测,结果表明主仪器一阶微分模型和二阶微分模型对验证集样品的pH值预测与实际测量值的平均绝对偏差分别为0.057、0.065,t检验表明预测值和实测值之间没有显著性差异,达到了较好的结果.考察了主仪器pH值一阶微分、二阶微分模型在同一型号不同仪器间的直接转移效果,一阶微分模型转移给了子仪器A ～F,二阶微分模型转移给了子仪器G,7台子仪器pH值预测的平均绝对偏差为0.049 ～0.070,且都通过了F检验.实验表明,该主仪器模型能够快速预测烟叶中的pH值,并成功转移到同类仪器上进行检测.     

基于一元线性回归的近红外光谱模型传递研究

为解决近红外光谱分析中的模型传递问题,本研究提出了一元线性回归直接标准化算法(Simple linear regression direct standardization,SLRDS)。为验证算法的有效性,采用玉米样品的近红外光谱集进行实验,并与传统的直接标准化算法(Direct standardization,DS)、分段直接标准化算法(Piecewise direct standardization,PDS)进行比较。实验结果表明,SLRDS算法不仅能够有效消除近红外光谱仪之间的差异,很好地实现玉米样品的PLS校正模型在3台仪器之间的共享,而且与DS和PDS算法相比,具有传递性能高、模型简单及所求参数少等优点。     

校正集样品特性对鼠药中毒鼠强近红外光谱分析的影响

根据市售鼠药样品成分各异且相对复杂,建立6种不同成分体系和9个不同样本容量的校正集,运用小波变换压缩鼠药的近红外透射光谱数据,结合BP反向神经网络算法对压缩的数据进行建模,考察校正集样品特性对模型预测能力的影响。试验结果表明:采用BP神经网络算法建立定量模型时,只要校正集样品中包含了与预测样品性质相似的样本,就能准确地对复杂样品进行近红外定量分析。当校正集容量分别为72和84时,模型预测结果趋于平稳。当校正集数量为96时,模型的最大相关系数为0.959 8,预测最小标准差和平均相对误差分别为1.893%和1.92%。     

苯乙烯/丙烯酸正丁酯乳液聚合反应过程中残余单体含量的实时监测

采用近红外光谱分析技术在线测量苯乙烯(St)/丙烯酸正丁酯(BA)乳液聚合体系中残余单体的含量. 共设计9个半连续方式的St/BA乳液共聚反应, 在反应过程中实时取样测量其残余单体含量, 并记录取样时刻对应的聚合体系的近红外光谱. 采用多元散射校正法(MSC)处理光谱, 有效地克服了乳胶粒子散射效应对近红外光谱分析的影响. 采用主成分分析法(PCA)对乳液体系的近红外光谱数据进行了解析. 选取6个聚合反应对应不同反应时间的72个样品, 用于建立校正模型, 另外3个聚合反应共取36个样品用于校正模型的验证, 并在反应设计上体现了乳化剂用量的变化, 从而使校正模型对乳化剂用量的变化具有一定的适应性. 研究结果表明, 所得模型对残余单体St和BA含量的预测结果标准差(SEP)分别为0.08026和0.05305.     

Construction of global and robust near-infrared calibration models based on hybrid calibration sets using Partial Least Squares (PLS) regression

Near-infrared spectroscopy (NIR) models built on a particular instrument are often invalid on other instruments due to spectral inconsistencies between the instruments. In the present work, global and robust NIR calibration models were constructed by partial least square (PLS) regression based on hybrid calibration sets, which are composed of both primary and secondary spectra. Three datasets were used as case studies. The first consisted of 72 radix scutellaria samples measured on two NIR spectrometers with known baicalin content. The second was composed of 80 corn samples measured on two instruments with known moisture, oil, and protein concentrations. The third dataset included 279 primary samples of tobacco with known nicotine content and 78 secondary samples of tobacco with known nicotine concentrations. The effect of the number of secondary spectra in the hybrid calibration sets and the methods for selecting secondary spectra on the PLS model performance were investigated by comparing the results obtained from different calibration sets. This study shows that the global and robust calibration models accurately predicted both primary and secondary samples as long as the ratios of the number of primary spectra to the number of secondary spectra were less than 22. The models performance was not influenced by the selection method of the secondary spectra. The hybrid calibration sets included the primary spectral information and also the secondary spectra; information, rendering the constructed global and robust models applicable to both primary and secondary instruments.     

Improved calibration transfer between near-Infrared (NIR) spectrometers using canonical correlation analysis

The application of mobile near-infrared (NIR) spectrometers in field measurements is growing. Calibration transfer techniques offer simple solutions for enabling models constructed on benchtop instruments for use on mobile spectrometers. Since different types of spectrometers with different components, scanning ranges and resolutions cause great differences in the spectral response, calibration transfer is difficult to apply. In this paper, we focus on calibration transfer among benchtop, portable and handheld spectrometers by a method of calibration transfer based on canonical correlation analysis (CTCCA). Its capability was illustrated by the example of a group of NIR spectra dataset for predicting reducing sugars, total sugar, and nicotine contents in tobacco leaves. The experimental results showed that the transferability of CTCCA was superior to other conventional calibration transfer methods, including piecewise direct standardization, spectral space transformation, calibration transfer based on independent component analysis, and calibration transfer based on the weight matrix. Moreover, the best transfer results were obtained in the three cases by canonical correlation analysis method executing transfer while the spectra were not interpolated, which shows that this approach has the advantage of easy implementation for calibration transfer. Therefore, CTCCA without interpolation calculation offers a new and simple solution for transferring the spectra acquired by mobile spectrometers to the optimized spectral models built on benchtop devices to improve the accuracy of the results. Additionally, the results show that the benchtop spectrometer is more suitable as the master instrument for calibration transfer with more accurate prediction than using a portable device as the master.     

Elimination of interference information by a new hybrid algorithm for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the interference information for multivariate calibration of near-infrared (NIR) spectra that includes noise, background and systemic spectral variation irrelevant to concentration. The method consists of two parts: approximate derivative based on continuous wavelet transform (CWT) and orthogonal signal correction (OSC). After the approximate derivative calculated by CWT, OSC was performed. It was successfully applied to real complex NIR spectral data to eliminate the interference information. Correction for the interference of NIR spectra resulted in a substantial improvement in the predicted precision, and a more concise calibration model was obtained. The proposed procedure also compared favourably with several pretreatment methods, and the new method appears to provide a high-performance pretreatment tool for multivariate calibration of NIR spectra. In addition, the strategy proposed here can be applied to various other spectral data for quantitative purposes as well.     

波长筛选结合直接校正法用于近红外光谱模型传递研究

该文提出了一种新的传递方法模型--波长筛选结合直接校正法(WSDS).首先利用样品的性质信息筛选出最有代表性的波长点信息,然后用直接校正法消除这些信息中包含的仪器间差异,以预测标准偏差(SEP)考察模型传递的效果.利用此算法对航空煤油的近红外光谱分析模型在不同仪器之间进行传递研究.经WSDS校正后,对航空煤油密度预测的...     

Calibration model transfer for near-infrared spectra based on canonical correlation analysis

In order to solve the calibration transformation problem in near-infrared (NIR) spectroscopy, a method based on canonical correlation analysis (CCA) for calibration model transfer is developed in this work. Two real NIR data sets were tested. A comparative study between the proposed method and piecewise direct standardization (PDS) was conducted. It is shown that the transfer results obtained with the proposed method based on CCA were better than those obtained by PDS when the subset had sufficient samples.     

Development of a rapid process monitoring method for dry-coated tableting process by using near-infrared spectroscopy

A nondestructive transmittance near-infrared (NIR) method for detecting off-centered cores in dry-coated (DC) tablets was developed as a monitoring system in the DC tableting process. Caffeine anhydrate was used as a core active pharmaceutical ingredient (API), and DC tablets were made by the direct compression method. NIR spectra were obtained from these intact DC tablets using the transmittance method. The reference assay was performed with HPLC. Calibration models were generated by partial least squares (PLS) regression and principal component regression (PCR) utilizing external validations. Hierarchical cluster analysis (HCA) of the results confirmed that NIR spectroscopy correctly detected off-centered cores in DC tablets. We formulated and used the Centering Index (CI) to evaluate the precision of core alignment and generated an NIR calibration model that could correctly predict this index. The principal component (PC) 1 loading vector of the final calibration model indicated that it could specifically detect the misalignment of tablet cores. The model also had good linearity and accuracy. The CIs of unknown sample tablets predicted by the final calibration model and those calculated through the HPLC analysis were closely parallel with each other. These results demonstrate the validity of the final calibration model and the utility of the transmittance NIR spectroscopic method developed in this study as a monitoring system in DC tableting process.     

废旧涤/棉混纺织物近红外定量分析模型的建立及预测

将中红外光谱筛选出的598个纯涤、纯棉及涤/棉混纺样本采用GB/T 2910.11-2009法测定其涤、棉准确含量,其中校正集样本252个,验证集样本346个。使用便携式近红外光谱仪获取样本的原始近红外光谱(NIRS)。校正集样本依据回归系数的分布趋势和范围选取最佳建模谱区,并采用差分一阶导、S-G平滑和均值中心化相结合的方法对原始光谱进行预处理,利用偏最小二乘法(PLS)建立涤/棉混纺织物中涤含量的近红外(NIR)定量分析模型。同时分析了样本颜色对NIRS的影响,探讨了斜线光谱样本、奇异样本和不同组织结构织物对模型预测效果的影响。结果表明:利用PLS法建立的涤/棉混纺织物定量分析模型最优组合包含1个光谱区间和9个主成分因子,校正集相关系数(RC)为0.998,标准偏差(SEC)为0.908。为验证所建模型的有效性和实用性,对346个未参与建模的涤棉样本进行了预测,并将预测结果与国标法测定值进行方差分析,两种方法结果无显著差异,预测正确率达97%以上。模型的建立为废旧涤/棉混纺织物快速、无损分拣提供了基础数据库。     

A new hybrid strategy for constructing a robust calibration model for near-infrared spectral analysis

A new hybrid algorithm is proposed for construction of a high-quality calibration model for near-infrared (NIR) spectra that is robust against both spectral interference (including background and noise) and multiple outliers. The algorithm is a combination of continuous wavelet transform (CWT) and a modified iterative reweighted PLS (mIRPLS) procedure. In the proposed algorithm the spectral interference is filtered by CWT at the first stage then mIRPLS is proposed to detect the multiple outliers in the CWT domain. Compared with the original IRPLS method, mIRPLS does not need to adjust variable parameters to achieve optimum calibration results, which makes it very convenient to perform in practice. The final PLS model is constructed robustly because both the spectral interference and multiple outliers are eliminated. In order to validate the effectiveness and universality of the algorithm, it was applied to two different sets of NIR spectra. The results indicate that the proposed strategy can greatly enhance the robustness and predictive ability of NIR spectral analysis.     

An adaptive strategy for selecting representative calibration samples in the continuous wavelet domain for near-infrared spectral analysis

Sample selection is often used to improve the cost-effectiveness of near-infrared (NIR) spectral analysis. When raw NIR spectra are used, however, it is not easy to select appropriate samples, because of background interference and noise. In this paper, a novel adaptive strategy based on selection of representative NIR spectra in the continuous wavelet transform (CWT) domain is described. After pretreatment with the CWT, an extension of the Kennard–Stone (EKS) algorithm was used to adaptively select the most representative NIR spectra, which were then submitted to expensive chemical measurement and multivariate calibration. With the samples selected, a PLS model was finally built for prediction. It is of great interest to find that selection of representative samples in the CWT domain, rather than raw spectra, not only effectively eliminates background interference and noise but also further reduces the number of samples required for a good calibration, resulting in a high-quality regression model that is similar to the model obtained by use of all the samples. The results indicate that the proposed method can effectively enhance the cost-effectiveness of NIR spectral analysis. The strategy proposed here can also be applied to different analytical data for multivariate calibration.     

近红外光谱法测定端羟基环氧乙烷-四氢呋喃共聚醚的羟值

提出了用近红外光谱测定端羟基环氧乙烷-四氢呋喃共聚醚(PET)的羟值,结合主成分回归和偏最小二乘法建立了PET羟值与其近红外光谱之间的关联模型。结果表明,近红外光谱法与化学分析法的测定结果一致;近红外光谱法测定PET羟值的相对误差在5%以内;利用遗传算法选择部分波长建立校正可以降低模型的预测误差。