复烤片烟常规化学成分的傅里叶变换近红外光谱法的模型转移

为实现复烤片烟常规化学成分的模型在不同品牌傅里叶变换近红外仪器上的使用与共享,以贵州产区复烤片烟样品为研究对象,利用Kennard-Stone算法选择标准样品,将偏移量校正(BC)、截距斜率校正(SBC)和光谱空间转换(SST)等3种模型转移算法应用于不同品牌傅里叶变换近红外仪器的模型转移,并对3种模型转移算法的转移结果进行分析。结果表明:将复烤片烟常规化学成分的主机模型直接应用于从机预测时,主机和从机的预测值之间存在显著性差异;采用BC、SBC和SST可以实现不同品牌傅里叶变换近红外仪器的模型转移,其中SST转移结果最优。     

小波多尺度分段直接校正法用于近红外光谱模型传递的研究

分段直接校正(PDS)算法是目前最常用的近红外光谱模型传递方法,但它在对整个谱区进行校正时,始终依赖大小不变的传递窗口.为了提高传递效果,本研究在PDS基础上提出了一种新的算法--小波多尺度分段直接校正法(WMPDS),用于混胺的近红外光谱模型传递,并详细讨论了模型的传递参数和传递结果.本算法首先对混胺的近红外光谱进行...     

基于尺度不变特征变换筛选稳定特征波长的近红外光谱模型传递方法

该研究利用一维尺度不变特征变换(SIFT)算法寻找烟叶近红外光谱(Near infrared spectroscopy,NIRS)的稳定特征波长,根据样品精密度测试光谱筛选的波长计算重现率和重现度,采用L_9(3~3)正交表优化SIFT算法中的相关参数,使重现率和重现度尽可能高。基于优化的参数和主机上10个代表性样品的光谱,筛选出10个稳定特征波长集合,以这些波长集合并集的光谱响应为自变量,采用偏最小二乘(PLS)方法构建烟叶总植物碱NIRS模型(简称SIFT-PLS)。该模型直接传递到3台从机后,对3台从机样品总植物碱的平均相对预测误差(MRE)均满足小于6%的企业内控要求,而全光谱模型(WW-PLS)直接转移后仅1台从机的MRE满足要求,经分段直接校正(PDS)方法校正从机光谱后,WW-PLS模型也仅对1台从机的MRE小于6%。采用SIFT算法筛选稳定特征波长建立的NIRS模型可在3台从机直接共享,无需转移集,不需对从机光谱或光谱模型进行校正,实现了真正意义的无标样NIRS模型的直接转移。     

基于一元线性回归的近红外光谱模型传递研究

为解决近红外光谱分析中的模型传递问题,本研究提出了一元线性回归直接标准化算法(Simple linear regression direct standardization,SLRDS)。为验证算法的有效性,采用玉米样品的近红外光谱集进行实验,并与传统的直接标准化算法(Direct standardization,DS)、分段直接标准化算法(Piecewise direct standardization,PDS)进行比较。实验结果表明,SLRDS算法不仅能够有效消除近红外光谱仪之间的差异,很好地实现玉米样品的PLS校正模型在3台仪器之间的共享,而且与DS和PDS算法相比,具有传递性能高、模型简单及所求参数少等优点。     

小波变换-分段直接校正法用于近红外光谱模型传递研究

提出了一种新的传递算法(WT-PDS)———小波变换-分段直接校正法,并详细讨论了模型传递参数和传递结果。首先利用小波变换对光谱进行压缩处理,采用PDS算法消除不同仪器之间压缩数据的差异,最后利用经校正的压缩数据进行分析,实现模型传递。本方法能够扣除不同仪器之间的大部分差异,大幅度改善分析精度。传递后模型分析精度与源机模型稳健性紧密相关。如果源机模型稳健性强,则能够实现不同仪器之间的共享。本方法能够实现源机的0#轻柴十六烷值、凝点、馏出温度;-10#轻柴十六烷值、凝点以及-10#军柴凝点和馏出温度共10个模型在5台仪器之间共享,简化了建模的成本。与传统的PDS相比,WT-PDS方法具有传递和建模变量少、速度快、光谱校正性能高等优点,而其模型分析精度与传统PDS基本一致。     

分段直接校正模型转移结合近红外光谱技术的甲醇汽油中甲醇定量分析方法研究

发展了一种基于分段直接校正(PDS)算法结合偏最小二乘法(PLS)的近红外光谱(NIR)定量分析模型转移方法,用于甲醇汽油中甲醇的准确定量分析。首先,制备了20个不同甲醇含量的甲醇汽油样品,并采集其NIR光谱;其次,考察了不同输入变量(800～2000 nm、1100～1900 nm、1100～1700 nm、1390～1700 nm)和光谱预处理方法对PLS校正模型预测性能的影响。在最优化的输入变量(1390～1700 nm)和光谱预处理方法(归一化(Nor)结合多元散射校正(MSC))条件下,分别构建了PLS校正模型和PDS-PLS转移模型。为了进一步验证PDS-PLS模型的预测性能,采用优化后的光谱分别构建了基于域自适应(DA)结合PLS的DA-PLS模型以及核域自适应(KDA)结合PLS的KDA-PLS模型。结果表明,相比其它PLS模型,采用PDS-PLS算法校正转移后构建的模型显著提升了子机预测集的预测性能,决定系数(R_P²)为0.9984,均方根误差(RMSE_P)为0.0056,平均相对误差(MRE_...     

基于GPU计算的并行PLS算法研究与实现

偏最小二乘算法(PLS)是与红外、近红外光谱分析结合使用最为广泛的化学计量学算法,然而当前PLS算法通常采用单线程方式实现,当校正模型数量多或样本数量大、波长点数和主成分数较多,模型需对光谱预处理和波长选择方法反复优化时,计算十分缓慢。为大幅提高建模速度,该文提出了一种基于图形处理器(GPU)的并行计算策略,利用具有大规模并行计算特性的GPU作为计算设备,结合CUBLAS库函数实现了基于GPU并行的PLS建模算法(CUPLS)。利用近红外光谱数据集进行性能对比实验,结果表明CUPLS建模算法较传统单线程实现的PLS算法,加速比可达近42倍,极大地提升了化学计量学算法的建模效率。该方法亦可用于其它化学计量学算法的加速。     

叠加多元校正分析

基于多模型(模型融合)建模的思想,开发了两种新的叠加多元校正分析算法:叠加PCR(PLS)多元校正分析和叠加移动窗口PCR(PLS)多元校正分析。与一般的多模型建模方法不同的是其通过赋予光谱数据中的不同部分不同权重叠加子多元校正模型。因此,其可以通过权重调节或选择变量。在消除光谱数据中常见的冗余信息的同时,避免信息遗漏的缺点,并最终提高模型的稳健性,简化了模型。对于这两个新的算法,尽管其具体步骤不同,但仍取得了相似的预测结果。本文通过两套近红外光谱文献数据计算验证了这两个新方法的优越性。     

人工神经网络方法用于PC/ABS材料定量分析

采用人工神经网络(ANN)算法建立了不同共混比的ABS/PC样品的近红外光谱数据与共混比的定量校正模型,并对校正模型的准确性进行了验证。实验分析结果表明,该方法适合于高分子材料共混比的测定。     

段式正交信号校正方法及在小麦近红外光谱数据分析中的应用

针对光谱数据峰宽、局部效应显著、含有噪音、变量个数多及彼此间常存在严重的复共线性等问题,改进和设计一种光谱数据局部校正方法:基于窗口平滑的段式正交信号校正方法,并将之结合偏最小二乘回归,以实现光谱数据的预处理及定量分析。通过NIPALS算法初始化将滤去的正交成分,以近邻分段方式进行逐个波长点的正交信号校正。而后将去噪后的光谱矩阵作为新的自变量阵,通过偏最小二乘回归构建其与性质参变量间的校正模型。通过小麦近红外漫反射光谱数据的应用实验结果表明,本方法正交成分估计稳定,去噪明显,模型的预报性能优于其它方法,PLS成分数减少,模型更加简洁。     

Elimination of interference information by a new hybrid algorithm for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the interference information for multivariate calibration of near-infrared (NIR) spectra that includes noise, background and systemic spectral variation irrelevant to concentration. The method consists of two parts: approximate derivative based on continuous wavelet transform (CWT) and orthogonal signal correction (OSC). After the approximate derivative calculated by CWT, OSC was performed. It was successfully applied to real complex NIR spectral data to eliminate the interference information. Correction for the interference of NIR spectra resulted in a substantial improvement in the predicted precision, and a more concise calibration model was obtained. The proposed procedure also compared favourably with several pretreatment methods, and the new method appears to provide a high-performance pretreatment tool for multivariate calibration of NIR spectra. In addition, the strategy proposed here can be applied to various other spectral data for quantitative purposes as well.     

Comparison of near-infrared and mid-infrared spectroscopy for the determination of distillation property of kerosene

Near-infrared (NIR) and mid-infrared (MIR) spectroscopy have been compared and evaluated for the determination of the distillation property of kerosene with the use of partial least squares (PLS) regression. Since kerosene is a complex mixture of similar hydrocarbons, both spectroscopic methods will be best evaluated with this complex sample matrix. PLS calibration models for each percent recovery temperature have been developed by using both NIR and MIR spectra without spectral pretreatment. Both methods have shown good correlation with the corresponding reference method, however NIR provided better calibration performance over MIR. To rationalize the improved calibration performance of NIR, spectra of the same kerosene sample were continuously collected and the corresponding spectral reproducibility was evaluated. The greater spectral reproducibility including signal-to-noise ratio of NIR led to the improved calibration performance, even though MIR spectroscopy provided more qualitative spectral information. The reproducibility of measurement, signal-to-noise ratio, and richness of qualitative information should be simultaneously considered for proper selection of a spectroscopic method for quantitative analysis.     

Evaluating the validity of spectral calibration models for quantitative analysis following signal preprocessing

When paired with high-powered chemometric analysis, spectrometric methods offer great promise for the high-throughput analysis of complex systems. Effective classification or quantification often relies on signal preprocessing to reduce spectral interference and optimize the apparent performance of a calibration model. However, less frequently addressed by systematic research is the affect of preprocessing on the statistical accuracy of a calibration result. The present work demonstrates the effectiveness of two criteria for validating the performance of signal preprocessing in multivariate models in the important dimensions of bias and precision. To assess the extent of bias, we explore the applicability of the elliptic joint confidence region (EJCR) test and devise a new means to evaluate precision by a bias-corrected root mean square error of prediction. We show how these criteria can effectively gauge the success of signal pretreatments in suppressing spectral interference while providing a straightforward means to determine the optimal level of model complexity. This methodology offers a graphical diagnostic by which to visualize the consequences of pretreatment on complex multivariate models, enabling optimization with greater confidence. To demonstrate the application of the EJCR criterion in this context, we evaluate the validity of representative calibration models using standard pretreatment strategies on three spectral data sets. The results indicate that the proposed methodology facilitates the reliable optimization of a well-validated calibration model, thus improving the capability of spectrophotometric analysis.

Isotope pattern vector based tandem mass spectral data calibration for improved peptide and protein identification

Tandem mass spectra contain noisy peaks which make peak picking for peptide identification difficult. Moreover, all spectral peaks can be shifted due to systematic measurement errors. In this paper, a novel use of an isotope pattern vector (IPV) is proposed for denoising and systematic measurement error prediction. By matching the experimental IPVs with the theoretical IPVs of candidate fragment ions, true ionic peaks can be identified. Furthermore, these identified experimental IPVs and their corresponding theoretical IPVs are used in an optimization process to predict the systematic measurement error associated with the target spectrum. In return, the subsequent spectral data calibration based on the predicted systematic measurement error enhances the data quality. We show that such an integrated denoising and calibration process leads to significantly improved peptide and protein identification. Different from the commonly employed chemical calibration methods, our IPV‐based method is a purely computational method for individual spectra analysis and globally optimizes the use of spectral data. Copyright © 2009 John Wiley & Sons, Ltd.     

An adaptive strategy for selecting representative calibration samples in the continuous wavelet domain for near-infrared spectral analysis

Sample selection is often used to improve the cost-effectiveness of near-infrared (NIR) spectral analysis. When raw NIR spectra are used, however, it is not easy to select appropriate samples, because of background interference and noise. In this paper, a novel adaptive strategy based on selection of representative NIR spectra in the continuous wavelet transform (CWT) domain is described. After pretreatment with the CWT, an extension of the Kennard–Stone (EKS) algorithm was used to adaptively select the most representative NIR spectra, which were then submitted to expensive chemical measurement and multivariate calibration. With the samples selected, a PLS model was finally built for prediction. It is of great interest to find that selection of representative samples in the CWT domain, rather than raw spectra, not only effectively eliminates background interference and noise but also further reduces the number of samples required for a good calibration, resulting in a high-quality regression model that is similar to the model obtained by use of all the samples. The results indicate that the proposed method can effectively enhance the cost-effectiveness of NIR spectral analysis. The strategy proposed here can also be applied to different analytical data for multivariate calibration.     

Content uniformity of pharmaceutical solid dosage forms by near infrared hyperspectral imaging: A feasibility study

Near-infrared imaging systems simultaneously record spectral and spatial information. Each measurement generates a data cube containing several thousand spectra. Chemometric methods are therefore required to extract qualitative and quantitative information. The aim of this study was to determine the feasibility of quantifying active pharmaceutical ingredient (API) and excipient content in pharmaceutical formulations using hyperspectral imaging.Two kinds of tablets with a range of API content were analysed: a binary mixture of API and cellulose, and a pharmaceutical formulation with seven different compounds. Two pixel sizes, 10 μm/pixel and 40 μm/pixel, were compared, together with two types of spectral pretreatment: standard normal variate (SNV) normalization and Savitzky-Golay smoothing. Two methods of extracting concentrations were compared: the partial least squares 2 (PLS2) algorithm, which predicts the content of several compounds simultaneously, and the multivariate classical least squares (CLS) algorithm based on pure compound reference spectra without calibration.Best content predictions were achieved using 40 μm/pixel resolution and the PLS2 method with SNV normalized spectra. However, the CLS method extracted distribution maps with higher contrast and was less sensitive to noisy spectra and outliers; its API predictions were also highly correlated to real content, indicating the feasibility of predicting API content using hyperspectral imaging without calibration.     

Adaptive multiscale regression for reliable Raman quantitative analysis

This paper presents a novel methodology, adaptive multiscale regression (AMR), to adaptively process Raman spectra for quantitative analysis. The proposed methodology aims to construct an optimal calibration model for a Raman spectrum at hand, regardless of its structural characteristics, thus facilitating the application of Raman spectroscopy as a general tool for analytical chemistry. AMR firstly splits the spectra in a calibration set into frequency components at different scales using adaptive wavelet transform (AWT). Parallel member models constructed at different scales are then fused into a final prediction. The contributions of member models to a fusion model are straightforwardly estimated by a partial least square (PLS) model that emerges from a cross-validation results matrix (X) and reference values (Y). This procedure avoids information leakage by fully utilizing the multiscale nature of the input Raman spectra instead of arbitrarily removing some part of the spectral information by calibrating to selected features. Theoretically, we establish that AMR represents an automatic data-driven strategy that captures the Raman spectral structures adaptively and accurately. Our work tests and refines the AMR method by drawing upon the systematic analysis of spectra formulated to yield challenges representative of those encountered in common Raman analyses. AMR compares favorably with other popular preprocessing methods. Satisfactory calibration results suggest that AMR has the capacity to improve robustness and reliability of Raman spectral analysis, and may well extend to other spectroscopic techniques.     

Noncontact and rapid analysis of the quality of the recording coating on ink jet printing by near-infrared spectroscopy

The preparation and manufacture of the recording coating on ink jet printing (RC-IJP) was proposed. The microstructure of RC-IJP was analyzed by scanning electron microscopy. Fourier transform near infrared (FT-NIR) spectra showed the combination and overtone vibrations information of the hydrogen-containing groups in the RC-IJP structure. FT-NIR spectra combined with partial least squares (PLS) methods were proposed for the analysis of the glossiness degree, smoothness degree and weight per unit area of recording material (Gr) in RC-IJP. 45 samples were selected for the calibration sets of glossiness degree, smoothness degree and Gr respectively. A spectral pretreatment method was used to develop a robust calibration model. After optimizing the spectral pre-treatment, the determination coefficient (R(2)) of the glossiness degree, smoothness degree and Gr was 0.86, 0.94, and 0.98, respectively. Root mean square error of prediction (RMSEP) of the glossiness degree, smoothness degree and Gr was 1.65, 13.86, 0.054, respectively. The analytical results showed that NIR spectra using PLS had significant potential as a rapid and accurate method for the analysis of the glossiness degree, smoothness degree and Gr in the manufacture of RC-IJP.     

Supercritical fluid extraction and quantification of aflatoxins in Zizyphi Fructus by liquid chromatography/atmospheric pressure chemical ionization tandem mass spectrometry

An integrated method combining supercritical fluid extraction (SFE) with liquid chromatography/atmospheric pressure chemical ionization tandem mass spectrometry (LC/APCI-MS/MS) was developed and successfully applied to quantify aflatoxins (AFs) in Zizyphi Fructus (fruits of Zizyphus jujube), a traditional Chinese medicine. To minimize the potential interferences caused by the complex matrix in Zizyphi Fructus, a SFE pretreatment was performed. In addition, electrospray ionization (ESI) and atmospheric pressure chemical ionization (APCI) spectra were also compared. The results showed that the calibration curves of AFB(1), AFB(2), AFG(1), and AFG(2) were all linear over the range of concentration from 1 to 50 ng/g, the squared correlation coefficients (r(2)) were over 0.995, and the detection limits of the method were between 0.17 and 0.32 ng/g. It showed high recovery and good precision in quantitating AFs in Zizyphi Fructus without further clean-up. Further, fragmentation pathways of protonated AFs in APCI-MS/MS were clearly proposed which could predict the existence of AFB or AFG series. To test the empirical validity of the proposed methodology in this paper, eight random samples of Zizyphi Fructus collected from supermarkets and traditional Chinese medicine stores in different geographical areas of Taiwan were analyzed. The results indicated that low levels of AFs were detected in only one of them.     

A new hybrid strategy for constructing a robust calibration model for near-infrared spectral analysis

A new hybrid algorithm is proposed for construction of a high-quality calibration model for near-infrared (NIR) spectra that is robust against both spectral interference (including background and noise) and multiple outliers. The algorithm is a combination of continuous wavelet transform (CWT) and a modified iterative reweighted PLS (mIRPLS) procedure. In the proposed algorithm the spectral interference is filtered by CWT at the first stage then mIRPLS is proposed to detect the multiple outliers in the CWT domain. Compared with the original IRPLS method, mIRPLS does not need to adjust variable parameters to achieve optimum calibration results, which makes it very convenient to perform in practice. The final PLS model is constructed robustly because both the spectral interference and multiple outliers are eliminated. In order to validate the effectiveness and universality of the algorithm, it was applied to two different sets of NIR spectra. The results indicate that the proposed strategy can greatly enhance the robustness and predictive ability of NIR spectral analysis.