小波多尺度分段直接校正法用于近红外光谱模型传递的研究

分段直接校正(PDS)算法是目前最常用的近红外光谱模型传递方法,但它在对整个谱区进行校正时,始终依赖大小不变的传递窗口.为了提高传递效果,本研究在PDS基础上提出了一种新的算法--小波多尺度分段直接校正法(WMPDS),用于混胺的近红外光谱模型传递,并详细讨论了模型的传递参数和传递结果.本算法首先对混胺的近红外光谱进行...     

Calibration model transfer for near-infrared spectra based on canonical correlation analysis

In order to solve the calibration transformation problem in near-infrared (NIR) spectroscopy, a method based on canonical correlation analysis (CCA) for calibration model transfer is developed in this work. Two real NIR data sets were tested. A comparative study between the proposed method and piecewise direct standardization (PDS) was conducted. It is shown that the transfer results obtained with the proposed method based on CCA were better than those obtained by PDS when the subset had sufficient samples.     

一种消除在线多通道近红外分析仪各通道光谱差异的方法

针对在线多通道近红外分析仪因光纤耦合器件加工精度和装配过程存在细微差异而引起通道间光谱不一致的问题,在对光谱差异进行解析的基础上,提出了一种运算简捷、且在实际应用中易于实现的平均光谱差值校正(MSSC)方法,并与常用的模型传递算法如斜率／偏差(S／B)算法、分段直接校正(PDS)算法,以及通过偏最小二乘-人工神经网络(PLS-ANN)建立多通道混合校正模型进行了对比。结果表明,该方法可有效消除各通道所测光谱之间存在的差异,实现了多通道分析模型的通用性。     

Development of variance‐filtered instrumental transfer methods for high‐resolution NMR spectroscopy

The introduction of a variance‐filter to both direct standardization (DS) and piece‐wise direct standardization (PDS) instrumental transfer methods for the analysis of NMR spectral data is described. The variance‐filter modification allows for the identification of regions in the NMR spectra that are not adequately represented by the limited number of transfer calibration samples used during the calculation of the instrument‐to‐instrument transfer matrix. For these spectral frequencies, the corresponding portion of the transfer matrix is replaced by identity (or scaled identity) prior to the secondary instrumental data sets being transferred to the target instrument response. The spectral matching performance of the variance‐filtered instrumental transfer method as applied to high‐resolution ¹H NMR spectra is presented along with possible uses and limitations. Copyright © 2010 John Wiley & Sons, Ltd.     

Data fusion in multivariate calibration transfer

We report the use of stacked partial least-squares regression and stacked dual-domain regression analysis with four commonly used techniques for calibration transfer to improve predictive performance from transferred multivariate calibration models. The predictive performance from three conventional calibration transfer methods, piecewise direct standardization (PDS), orthogonal signal correction (OSC) and model updating (MUP), requiring standards measured on both instruments, was significantly improved from data fusion either by stacking of wavelet scales or by stacking of spectral intervals, as demonstrated by transfer of calibrations developed on near-infrared spectra of synthetic gasoline. Stacking did not produce as significant an improvement for calibration transfer using a finite impulse response (FIR) filter, but application of SPLS regression to FIR-transferred spectra improves predictive performance of the transferred model.     

小波变换-分段直接校正法用于近红外光谱模型传递研究

提出了一种新的传递算法(WT-PDS)———小波变换-分段直接校正法,并详细讨论了模型传递参数和传递结果。首先利用小波变换对光谱进行压缩处理,采用PDS算法消除不同仪器之间压缩数据的差异,最后利用经校正的压缩数据进行分析,实现模型传递。本方法能够扣除不同仪器之间的大部分差异,大幅度改善分析精度。传递后模型分析精度与源机模型稳健性紧密相关。如果源机模型稳健性强,则能够实现不同仪器之间的共享。本方法能够实现源机的0#轻柴十六烷值、凝点、馏出温度;-10#轻柴十六烷值、凝点以及-10#军柴凝点和馏出温度共10个模型在5台仪器之间共享,简化了建模的成本。与传统的PDS相比,WT-PDS方法具有传递和建模变量少、速度快、光谱校正性能高等优点,而其模型分析精度与传统PDS基本一致。     

Transfer of multivariate regression models between high‐resolution NMR instruments: application to authenticity control of sunflower lecithin

In recent years the number of spectroscopic studies utilizing multivariate techniques and involving different laboratories has been dramatically increased. In this paper the protocol for calibration transfer of partial least square regression model between high‐resolution nuclear magnetic resonance (NMR) spectrometers of different frequencies and equipped with different probes was established. As the test system previously published quantitative model to predict the concentration of blended soy species in sunflower lecithin was used. For multivariate modelling piecewise direct standardization (PDS), direct standardization, and hybrid calibration were employed. PDS showed the best performance for estimating lecithin falsification regarding its vegetable origin resulting in a significant decrease in root mean square error of prediction from 5.0 to 7.3% without standardization to 2.9–3.2% for PDS. Acceptable calibration transfer model was obtained by direct standardization, but this standardization approach introduces unfavourable noise to the spectral data. Hybrid calibration is least recommended for high‐resolution NMR data. The sensitivity of instrument transfer methods with respect to the type of spectrometer, the number of samples and the subset selection was also discussed. The study showed the necessity of applying a proper standardization procedure in cases when multivariate model has to be applied to the spectra recorded on a secondary NMR spectrometer even with the same magnetic field strength. Copyright © 2016 John Wiley & Sons, Ltd.     

Calibration transfer employing univariate correction and robust regression

This paper proposes a new method for calibration transfer, which was specifically designed to work with isolated variables, rather than the full spectrum or spectral windows. For this purpose, a univariate procedure is initially employed to correct the spectral measurements of the secondary instrument, given a set of transfer samples. A robust regression technique is then used to obtain a model with low sensitivity with respect to the univariate correction residuals. The proposed method is employed in two case studies involving near infrared spectrometric determination of specific mass, research octane number and naphthenes in gasoline, and moisture and oil in corn. In both cases, better calibration transfer results were obtained in comparison with piecewise direct standardization (PDS). The proposed method should be of a particular value for use with application-targeted instruments that monitor only a small set of spectral variables.     

Elimination of interference information by a new hybrid algorithm for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the interference information for multivariate calibration of near-infrared (NIR) spectra that includes noise, background and systemic spectral variation irrelevant to concentration. The method consists of two parts: approximate derivative based on continuous wavelet transform (CWT) and orthogonal signal correction (OSC). After the approximate derivative calculated by CWT, OSC was performed. It was successfully applied to real complex NIR spectral data to eliminate the interference information. Correction for the interference of NIR spectra resulted in a substantial improvement in the predicted precision, and a more concise calibration model was obtained. The proposed procedure also compared favourably with several pretreatment methods, and the new method appears to provide a high-performance pretreatment tool for multivariate calibration of NIR spectra. In addition, the strategy proposed here can be applied to various other spectral data for quantitative purposes as well.     

Calibration transfer between two near-infrared spectrometers based on a wavelet packet transform.

A standardization algorithm, called WPTS, which is based on a wavelet packet transform (WPT) and entropy criteria, is proposed to transfer spectra between two near-infrared spectrometers. First, the spectra of the standardization samples measured on both spectrometers are collected and the difference mean spectrum is calculated; then, a wavelet packet transform is performed and a best WPT-tree is generated, of which a node is selected to establish a transfer matrix. Once the transfer matrix has been built, spectra measured on one spectrometer can be successfully transferred to another spectrometer as if they have been measured directly on the latter. By comparison, the proposed WPTS can reach a transfer performance comparable to WTS1, which is the best existing method, and better than WTS2 and classical PDS by a simpler technique of variable selection and lower computational cost of calibration transfer.     

Maintaining the predictive abilities of multivariate calibration models by spectral space transformation

In quantitative on-line/in-line monitoring of chemical and bio-chemical processes using spectroscopic instruments, multivariate calibration models are indispensable for the extraction of chemical information from complex spectroscopic measurements. The development of reliable multivariate calibration models is generally time-consuming and costly. Therefore, once a reliable multivariate calibration model is established, it is expected to be used for an extended period. However, any change in the instrumental response or variations in the measurement conditions can render a multivariate calibration model invalid. In this contribution, a new method, spectral space transformation (SST), has been developed to maintain the predictive abilities of multivariate calibration models when the spectrometer or measurement conditions are altered. SST tries to eliminate the spectral differences induced by the changes in instruments or measurement conditions through the transformation between two spectral spaces spanned by the corresponding spectra of a subset of standardization samples measured on two instruments or under two sets of experimental conditions. The performance of the method has been tested on two data sets comprising NIR and MIR spectra. The experimental results show that SST can achieve satisfactory analyte predictions from spectroscopic measurements subject to spectrometer/probe alteration, when only a few standardization samples are used. Compared with the existing popular methods designed for the same purpose, i.e. global PLS, univariate slope and bias correction (SBC) and piecewise direct standardization (PDS), SST has the advantages of implementation simplicity, wider applicability and better performance in terms of predictive accuracy.     

基于尺度不变特征变换筛选稳定特征波长的近红外光谱模型传递方法

该研究利用一维尺度不变特征变换(SIFT)算法寻找烟叶近红外光谱(Near infrared spectroscopy,NIRS)的稳定特征波长,根据样品精密度测试光谱筛选的波长计算重现率和重现度,采用L_9(3~3)正交表优化SIFT算法中的相关参数,使重现率和重现度尽可能高。基于优化的参数和主机上10个代表性样品的光谱,筛选出10个稳定特征波长集合,以这些波长集合并集的光谱响应为自变量,采用偏最小二乘(PLS)方法构建烟叶总植物碱NIRS模型(简称SIFT-PLS)。该模型直接传递到3台从机后,对3台从机样品总植物碱的平均相对预测误差(MRE)均满足小于6%的企业内控要求,而全光谱模型(WW-PLS)直接转移后仅1台从机的MRE满足要求,经分段直接校正(PDS)方法校正从机光谱后,WW-PLS模型也仅对1台从机的MRE小于6%。采用SIFT算法筛选稳定特征波长建立的NIRS模型可在3台从机直接共享,无需转移集,不需对从机光谱或光谱模型进行校正,实现了真正意义的无标样NIRS模型的直接转移。     

鱼粉近红外光谱模型传递应用研究

为探讨光栅型与傅里叶变换型近红外分析仪之间模型传递的应用效果,选取国产鱼粉为近红外光谱样本,DS2500F型近红外分析仪为源仪器,MPA型近红外分析仪为目标仪器,采用分段直接校正(PDS)方法实现近红外光谱传递。分别建立水分、粗蛋白质、粗脂肪、蛋氨酸和赖氨酸等组分的预测模型,通过交互验证决定系数(R2cv)、交互验证标准误差(RMSECV)、马氏距离(MD)、系统偏差(Bias)、预测均方根误差(RMSEP)和相对分析误差(RPD)等参数,多维度评估光谱传递后所建预测模型的效果。结果表明,DS2500F仪器的近红外光谱传递到MPA型仪器时,所建国产鱼粉的水分、粗蛋白质、粗脂肪、蛋氨酸、赖氨酸的预测模型与MPA型仪器原始预测模型各参数对比无显著差异,预测效果基本一致,说明国产鱼粉在DS2500F仪器上的近红外光谱通过传递可以替代MPA型仪器的原始光谱,间接实现了模型传递,且具有良好的适用性和共享性,可提高近红外预测模型的应用效率。     

Content uniformity determination of pharmaceutical tablets using five near-infrared reflectance spectrometers: a process analytical technology (PAT) approach using robust multivariate calibration transfer algorithms

Near-infrared calibration models were developed for the determination of content uniformity of pharmaceutical tablets containing 29.4% drug load for two dosage strengths (X and Y). Both dosage strengths have a circular geometry and the only difference is the size and weight. Strength X samples weigh approximately 425 mg with a diameter of 12 mm while strength Y samples, weigh approximately 1700 mg with a diameter of 20 mm. Data used in this study were acquired from five NIR instruments manufactured by two different vendors. One of these spectrometers is a dispersive-based NIR system while the other four were Fourier transform (FT) based. The transferability of the optimized partial least-squares (PLS) calibration models developed on the primary instrument (A) located in a research facility was evaluated using spectral data acquired from secondary instruments B, C, D and E. Instruments B and E were located in the same research facility as spectrometer A while instruments C and D were located in a production facility 35 miles away. The same set of tablet samples were used to acquire spectral data from all instruments. This scenario mimics the conventional pharmaceutical technology transfer from research and development to production. Direct cross-instrument prediction without standardization was performed between the primary and each secondary instrument to evaluate the robustness of the primary instrument calibration model. For the strength Y samples, this approach was successful for data acquired on instruments B, C, and D producing root mean square error of prediction (RMSEP) of 1.05, 1.05, and 1.22%, respectively. However for instrument E data, this approach was not successful producing an RMSEP value of 3.40%. A similar deterioration was observed for the strength X samples, with RMSEP values of 2.78, 5.54, 3.40, and 5.78% corresponding to spectral data acquired on instruments B, C, D, and E, respectively. To minimize the effect of instrument variability, calibration transfer techniques such as piecewise direct standardization (PDS) and wavelet hybrid direct standardization (WHDS) were used. The PDS approach, the RMSEP values for strength X samples were lowered to 1.22, 1.12, 1.19, and 1.08% for instruments B, C, D, and E, respectively. Similar improvements were obtained using the WHDS approach with RMSEP values of 1.36, 1.42, 1.36, and 0.98% corresponding to instruments B, C, D, and E, respectively.     

An adaptive strategy for selecting representative calibration samples in the continuous wavelet domain for near-infrared spectral analysis

Sample selection is often used to improve the cost-effectiveness of near-infrared (NIR) spectral analysis. When raw NIR spectra are used, however, it is not easy to select appropriate samples, because of background interference and noise. In this paper, a novel adaptive strategy based on selection of representative NIR spectra in the continuous wavelet transform (CWT) domain is described. After pretreatment with the CWT, an extension of the Kennard–Stone (EKS) algorithm was used to adaptively select the most representative NIR spectra, which were then submitted to expensive chemical measurement and multivariate calibration. With the samples selected, a PLS model was finally built for prediction. It is of great interest to find that selection of representative samples in the CWT domain, rather than raw spectra, not only effectively eliminates background interference and noise but also further reduces the number of samples required for a good calibration, resulting in a high-quality regression model that is similar to the model obtained by use of all the samples. The results indicate that the proposed method can effectively enhance the cost-effectiveness of NIR spectral analysis. The strategy proposed here can also be applied to different analytical data for multivariate calibration.     

Application of orthogonal space regression to calibration transfer without standards

To transfer a calibration model in cases where the standardization samples are rare or unstable, a method based on orthogonal space regression (OSR) is proposed. It uses virtual standardization spectra to account for response changes between instruments or batches. A comparative study of the proposed OSR, piecewise direct standardization, finite impulse response, orthogonal signal correction, and model updating (MU) was conducted on both pharmaceutical tablet data and chlorogenic acid data. The results of these studies suggest that both the OSR and the MU are superior to the other transfer techniques in terms of root‐mean‐squared error of prediction and ratio of performance to interquartile distance. Moreover, OSR requires no identical standard samples, and it avoids re‐optimizing the transfer models. In conclusion, both the differences among spectra measured on different spectrometers and the differences between different batches can be corrected successfully using the OSR method. Copyright © 2013 John Wiley & Sons, Ltd.     

中药口服固体制剂原辅料近红外光谱数据库的构建及应用

建立了中药口服固体制剂原辅料近红外(NIR)光谱数据库,采用模式识别方法研究了NIR光谱数据在物料分类和物性预测中的应用。使用便携式近红外光谱仪快速测量149批原辅料粉末的NIR漫反射光谱数据,并录入iTCM数据库。利用主成分分析(PCA)法探究NIR光谱数据对已知结构物料的分类能力,采用偏最小二乘(PLS)法研究了NIR光谱对原辅料物性参数和直接压片片剂性能的预测能力。经标准正态变量变换(SNV)+Savitzky-Golay(SG)平滑+一阶导数处理后的NIR光谱数据对微晶纤维素、乳糖、乙基纤维素、交联聚维酮和羟丙基甲基纤维素这5类辅料的区分能力较好。NIR光谱数据与原辅料粉末粒径、密度和吸湿性的相关性较强。NIR光谱信息作为物料物理性质的补充,可提高粉末直接压片片剂性能预测模型的性能。NIR光谱数据是iTCM数据库物性参数数据的补充,物性参数与NIR光谱数据的结合能更全面地表征原辅料的性质。     

Improved calibration transfer between near-Infrared (NIR) spectrometers using canonical correlation analysis

The application of mobile near-infrared (NIR) spectrometers in field measurements is growing. Calibration transfer techniques offer simple solutions for enabling models constructed on benchtop instruments for use on mobile spectrometers. Since different types of spectrometers with different components, scanning ranges and resolutions cause great differences in the spectral response, calibration transfer is difficult to apply. In this paper, we focus on calibration transfer among benchtop, portable and handheld spectrometers by a method of calibration transfer based on canonical correlation analysis (CTCCA). Its capability was illustrated by the example of a group of NIR spectra dataset for predicting reducing sugars, total sugar, and nicotine contents in tobacco leaves. The experimental results showed that the transferability of CTCCA was superior to other conventional calibration transfer methods, including piecewise direct standardization, spectral space transformation, calibration transfer based on independent component analysis, and calibration transfer based on the weight matrix. Moreover, the best transfer results were obtained in the three cases by canonical correlation analysis method executing transfer while the spectra were not interpolated, which shows that this approach has the advantage of easy implementation for calibration transfer. Therefore, CTCCA without interpolation calculation offers a new and simple solution for transferring the spectra acquired by mobile spectrometers to the optimized spectral models built on benchtop devices to improve the accuracy of the results. Additionally, the results show that the benchtop spectrometer is more suitable as the master instrument for calibration transfer with more accurate prediction than using a portable device as the master.     

Standardization of near infrared spectra measured on multi-instrument

Calibration model transfer is essential for practical applications of near infrared (NIR) spectroscopy because the measurements of the spectra may be performed on different instruments and the difference between the instruments must be corrected. An approach for calibration transfer based on alternating trilinear decomposition (ATLD) algorithm is proposed in this work. From the three-way spectral matrix measured on different instruments, the relative intensity of concentration, spectrum and instrument is obtained using trilinear decomposition. Because the relative intensity of instrument is a reflection of the spectral difference between instruments, the spectra measured on different instruments can be standardized by a correction of the coefficients in the relative intensity. Two NIR datasets of corn and tobacco leaf samples measured with three instruments are used to test the performance of the method. The results show that, for both the datasets, the spectra measured on one instrument can be correctly predicted using the partial least squares (PLS) models built with the spectra measured on the other instruments.