主成分分析-支持向量回归建模方法及应用研究

将主成分分析(PCA)用于近红外光谱的特征提取,并与支持向量回归(SVR)相结合,实现了主成分分析-支持向量回归(PCA-SVR)用于近红外光谱定量分析的建模方法。与单纯的SVR方法相比,不仅提高了运算速度,而且提高了模型的预测准确度。将PCA-SVR方法用于烟草样品中总糖和总挥发碱含量的测定,所得结果的预测均方根误差分别为1.323和0.0477;回收率分别为91.8%~112.6%和88.9%~120.2%。     

Independent component analysis and its applications in signal processing for analytical chemistry

Independent component analysis (ICA) is a statistical method the goal of which is to find a linear representation of non-Gaussian data so that the components are statistically independent, or as independent as possible. In an ICA procedure, the estimated independent components (ICs) are identical to or highly correlated to the spectral profiles of the chemical components in mixtures under certain circumstances, so the latent variables obtained are chemically interpretable and useful for qualitative analysis of mixtures without prior information about the sources or reference materials, and the calculated demixing matrix is useful for simultaneous determination of polycomponents in mixtures. We review commonly used ICA algorithms and recent ICA applications in signal processing for qualitative and quantitative analysis. Furthermore, we also review the preprocessing method for ICA applications and the robustness of different ICA algorithms, and we give the empirical criterion for selection of ICA algorithms in signal processing for analytical chemistry.     

连续小波变换-独立成分回归算法及其在多组分分析中的应用

采用连续小波变换（CWT）对光谱数据进行处理，用独立成分分析（ICA）进行特征提取，再用回归分析方法对被测组分进行测定，建立了连续小波变换一独立成分回归（CWT-ICR）方法。方法用于肉样品中水分、脂肪和蛋白质多组分的同时测定，所得结果与化学法测得结果相符。     

ICA方法与NIR技术用于药片中活性成分含量的测定

用独立分量分析(ICA)方法提取药片近红外光谱数据矩阵的独立成分和相应的混合矩阵, 再用BP神经网络对混合矩阵和药片中活性成分的浓度矩阵进行建模, 提出了新的药片活性成分含量测定的基于独立分量分析-神经网络回归(ICA-NNR)的近红外光谱分析方法. 通过分析独立分量数和网络中间隐层的神经元数对模型性能的影响, 分别建立三类药片定量分析的最优模型. 该方法用于实测的三类药片中活性成分含量的测定, 测试样品集的化学检测值与近红外预测值的相关系数分别达到0.962, 0.980及0.979. 结果表明, 基于ICA-NNR的近红外光谱分析方法对制药业的药片进行定量分析是可行的.     

基于独立分量和神经网络的近红外多组分分析方法

采用小波变换对光谱数据进行压缩,用独立分量分析(ICA)方法提取近红外光谱数据矩阵的独立成分和相应的混合矩阵,再用BP神经网络对混合矩阵和实测浓度矩阵进行建模,提出了基于独立分量分析-神经网络回归(ICA-NNR)的近红外分析建模方法。进一步研究了独立分量数和网络中间隐层的神经元数对模型性能的影响,经优化后的ICA-NNR模型在相关系数与均方根误差两个指标上均优于直接用光谱矩阵作为输入所建立的模型。本方法用于玉米中水分、淀粉、蛋白质3种主要成分含量的同时测定,检验样品集的化学检测值与近红外预测值的相关系数分别达到:淀粉r=0.971,蛋白质r=0.976,水分r=0.975。     

Cross validation and uncertainty estimates in independent component analysis

A data analysis tool, known as independent component analysis (ICA), is the main focus of this paper. The theory of ICA is briefly reviewed, and the underlying statistical assumptions and a practical algorithm are described. This paper introduces cross validation/jack-knifing and significance tests to ICA. Jack-knifing is applied to estimate uncertainties for the ICA loadings, which also serve as a basis for significance tests. These tests are shown to improve ICA performance, indicating how many components are mixed in the observed data, and also which parts of the extracted sources that contain significant information. We address the issue of stability for the ICA model through uncertainty plots. The ICA performance is compared to principal component analysis (PCA) for two selected applications, a simulated experiment and a real world application.     

A new approach to near-infrared spectral data analysis using independent component analysis

This paper presents a new approach to near-infrared spectral (NIR) data analysis that is based on independent component analysis (ICA). The main advantage of the new method is that it is able to separate the spectra of the constituent components from the spectra of their mixtures. The separation is a blind operation, since the constituent components of mixtures can be unknown. The ICA based method is therefore particularly useful in identifying the unknown components in a mixture as well as in estimating their concentrations. The approach is introduced by reference to case studies and compared to other techniques for NIR analysis including principal component regression (PCR), multiple linear regression (MLR), and partial least squares (PLS) as well as Fourier and wavelet transforms.     

独立分量分析预处理法提高苹果糖度模型预测精度研究

为了提高苹果近红外光谱糖度预测模型精度,利用独立分量分析方法(ICA)对苹果近红外光谱进行了预处理,并且建立了糖度的偏最小二乘(PLS)预测模型。结果表明,独立分量分析不但能分离出噪声信号,而且所分离出来的光谱信号也比原始光谱信号光滑。在预处理后的最佳PLS糖度模型校正时的相关系数rc和标准偏差SEC分别为0.9549和0.3361,用于预测时的相关系数rp和标准偏差SEP分别为0.9071和0.4355。与普通的平均处理法的PLS模型相比,其精度有所提高,且模型更加简洁。     

Standardless multicomponent qNMR analysis of compounds with overlapped resonances based on the combination of ICA and PULCON

A fast and reliable nuclear magnetic resonance (NMR) method for quantitative analysis of targeted compounds with overlapped signals in complex mixtures has been established. The method is based on the combination of chemometric treatment for spectra deconvolution and the PULCON principle (pulse length based concentration determination) for quantification. Independent component analysis (ICA) (mutual information least dependent component analysis (MILCA) algorithm) was applied for spectra deconvolution in up to six component mixtures with known composition. The resolved matrices (independent components, ICs and ICA scores) were used for identification of analytes, calculating their relative concentrations and absolute integral intensity of selected resonances. The absolute analyte concentrations in multicomponent mixtures and authentic samples were then calculated using the PULCON principle. Instead of conventional application of absolute integral intensity in case of undisturbed signals, the multiplication of resolved IC absolute integral and its relative concentration in the mixture for each component was used. Correction factors that are required for quantification and are unique for each analyte were also estimated. The proposed method was applied for analysis of up to five components in lemon and orange juice samples with recoveries between 90% and 111%. The total duration of analysis is approximately 45 min including measurements, spectra decomposition and quantification. The results demonstrated that the proposed method is a promising tool for rapid simultaneous quantification of up to six components in case of spectral overlap and the absence of reference materials. Copyright © 2015 John Wiley & Sons, Ltd.     

Determination of rice type by 1H NMR spectroscopy in combination with different chemometric tools

A 400‐MHz ¹H nuclear magnetic resonance (NMR) spectroscopy and multivariate data analysis were used in the context of food surveillance to discriminate 46 authentic rice samples according to type. It was found that the optimal sample preparation consists of preparing aqueous rice extracts at pH 1.9. For the first time, the chemometric method independent component analysis (ICA) was applied to differentiate clusters of rice from the same type (Basmati, non‐Basmati long‐grain rice, and round‐grain rice) and, to a certain extent, their geographical origin. ICA was found to be superior to classical principal component analysis (PCA) regarding the verification of rice authenticity. The chemical shifts of the principal saccharides and acetic acid were found to be mostly responsible for the observed clustering. Among classification methods (linear discriminant analysis, factorial discriminant analysis, partial least squares discriminant analysis (PLS‐DA), soft independent modeling of class analogy, and ICA), PLS‐DA and ICA gave the best values of specificity (0.96 for both methods) and sensitivity (0.94 for PLS‐DA and 1.0 for ICA). Hence, NMR spectroscopy combined with chemometrics could be used as a screening method in the official control of rice samples. Copyright © 2013 John Wiley & Sons, Ltd.     

Discrimination of Scrophulariae Radix according to geographical origin and determination of active constituents by near infrared spectroscopy (NIRS)

The potential of near infrared reflectance spectroscopy (NIR) was investigated for its ability to non-destructively discriminate the geographic origins of Scrophularia spp., Andong, Uisung and China. Application of principal component analysis to NIR spectra leads to a clear separation of Andong sample from the others. Moreover, the contents of two neuroprotective constituents of Scrophularia spp., 8-O-(E-p-methoxycinnamoyl)-harpagide (HG), and E-p-methoxycinnamic acid (MCA), were determined by HPLC-DAD. Partial least squares (PLS) regression of NIR spectra combined with these analytical reference data yield the development of calibration models for the contents of the two constituents. The correlation coefficients of prediction models for HG and MCA were > 0.87. These outcomes indicated that the NIRS could be useful for the discrimination of Scrophularia spp.     

主成分回归用于分光光度法同时测定6种食品添加剂

山梨酸、苯甲酸钠、香兰素、NaNO2、NaNO3和糖精钠的紫外吸收光谱严重重叠,不经预先分离很难进行单一组分的直接测定.报道了一种同时测定上述6种食品添加剂的分光光度法,这种方法是基于在pH 2.85的Britton-Robinson(B-R)缓冲溶液中对该6种食品添加剂混合溶液进行光度测定,所得的重叠光谱数据用主成分回归(PCR)进行建模,并用该模型对未知样品浓度进行预报.该方法可以不经分离同时测定食品样品中的多种添加剂.     

Characterization of radix rehmanniae processing procedure using FT-IR spectroscopy through nonnegative independent component analysis

A method is proposed for monitoring the radix rehmanniae proparate processing procedure and determining the endpoint of the process using attenuated total reflectance (ATR) FT-IR through nonnegative independent component analysis (ICA). In the proposed method, ATR FT-IR spectra of the samples were firstly measured at different steaming periods. Then, nonnegative ICA was used for direct estimation of the feature spectra of the pure components in the mixture without pre-separation and other prior information. The estimated independent components (ICs) and their variation of the relative concentrations were used to characterize the processing procedure and determine the endpoint. The results show that the estimated three ICs are consistent with that of the chemical components in the mixtures, i.e. catalpol/rehmaionoside, glucose, and other compounds that nearly keep invariant during the processing procedure. The endpoint determined by the IR-ICA method is 15 h, which was located in the range obtained by expert sensory analysis, whereas the endpoint determined by the traditional sensory analysis is 14 ∼ 17 h and even 14 ∼ 20 h, which showed the significant deviation of the endpoints determined by different operators. Figure Characterisation of radix rehmanniae processing procedure using FT-IR spectroscopy through nonnegative independent component analysis     

基于地统计学与支持向量回归的QSAR建模

基于主成分分析(PCA)、地统计学(GS)和支持向量回归(SVR), 提出了一种新的定量构效关系(QSAR)个体化预测方法——Weight-PCA-GS-SVR. 其基本思路是: 先以PCA降维并消除自变量间的信息冗余, 继以SVR经非线性主成分筛选去除与因变量无关的主成分, 再以保留主成分计算样本间的加权距离, 然后以高维GS确定公用变程; 每一个待测样本都以自身为中心从训练集中找出加权距离小于公用变程的私有k个近邻, 以SVR训练建模完成个体化预测. Weight-PCA-GS-SVR从行、列两个方向对模型进行了优化, 为自变量提供了一种新的加权方法, 为解决最优k近邻选择难题提供了新的思路, 并具有SVR原来的优点. 经3个化合物活性实例数据集验证, 新方法在所有参比模型中预测精度最高, 且明显优于文献报道结果, Weight-PCA-GS-SVR在QSAR等回归预测领域有较广泛的应用前景.     

Nondestructive determination of compound amoxicillin powder by NIR spectroscopy with the aid of chemometrics

Near-infrared (NIR) spectroscopy, in combination with chemometrics, enables nondestructive analysis of solid samples without time-consuming sample preparation methods. A new method for the nondestructive determination of compound amoxicillin powder drug via NIR spectroscopy combined with an improved neural network model based on principal component analysis (PCA) and radial basis function (RBF) neural networks is investigated. The PCA technique is applied to extraction relevant features from lots of spectra data in order to reduce the input variables of the RBF neural networks. Various optimum principal component analysis-radial basis function (PCA-RBF) network models based on conventional spectra and preprocessing spectra (standard normal variate (SNV) and multiplicative scatter correction (MSC)) have been established and compared. Principal component regression (PCR) and partial least squares (PLS) multivariate calibrations are also used, which are compared with PCA-RBF neural networks. Experiment results show that the proposed PCA-RBF method is more efficient than PCR and PLS multivariate calibrations. And the PCA-RBF approach with SNV preprocessing spectra is found to provide the best performance.     

用四种离散变换主组分回归方法分辨重叠吸收光谱

将离散小波变换、小波包变换、傅里叶变换和离散余弦变换与主组分回归方法结合构成4种离散变换主组分回归方法,编制了离散变换主组分回归方法的计算程序。将离散变换主组分回归方法用于处理对硝基甲苯、对硝基酚和对硝基苯胺混合物的重叠紫外吸收光谱数据。结果表明,离散变换主组分回归方法优于主组分回归方法,试样质量浓度的预测值与实际值的相对预测标准误差由3.81%降至约1.11%。     

Estimation of source spectra profiles and simultaneous determination of polycomponent in mixtures from ultraviolet spectra data using kernel independent component analysis and support vector regression

A method that use kernel independent component analysis (KICA) and support vector regression (SVR) was proposed for estimation of source ultraviolet (UV) spectra profiles and simultaneous determination of polycomponents in mixtures. In KICA-SVR procedure, the UV source spectra profiles were estimated using KICA, then the mixing matrix of the components were calculated using the estimated sources, and the calibration model was build using SVR based on the calculated mixing matrix. A simulated UV dataset of three-component mixtures was used to test the ability of KICA for estimating source spectra profiles from spectra data of mixtures. It was found that KICA has the potential power to estimate pure UV spectra profiles, and correlation coefficient of estimated sources correspond to the real adopted ones are better compared with that by FastICA and Infomax ICA. An UV dataset of polycomponent vitamin B was processed using the proposed KICA-SVR method. The results show that the estimated source spectra profiles are correlative with the real UV spectra of the components and chemically interpretable, and accurate results were obtained.     

Identifying constituents in commercial gasoline using Fourier transform-infrared spectroscopy and independent component analysis

A new method is proposed that enables the identification of five refinery fractions present in commercial gasoline mixtures using infrared spectroscopic analysis. The data analysis and interpretation was carried out based on independent component analysis (ICA) and spectral similarity techniques. The FT-IR spectra of the gasoline constituents were determined using the ICA method, exclusively based on the spectra of their mixtures as a blind separation procedure, i.e. assuming unknown the spectra of the constituents. The identity of the constituents was subsequently determined using similarity measures commonly employed in spectra library searches against the spectra of the constituent components. The high correlation scores that were obtained in the identification of the constituents indicates that the developed method can be employed as a rapid and effective tool in quality control, fingerprinting or forensic applications, where gasoline constituents are suspected.     

基于小波系数的近红外光谱局部建模方法与应用研究

局部建模方法使用与预测样本相似的样本建立模型,可解决光谱响应与浓度之间的非线性问题,扩大模型的适用范围,提高预测准确度。采用小波变换进行数据压缩并利用小波系数之间的欧氏距离作为光谱相似性的判据,实现了近红外光谱定量分析的局部建模方法,避免了样本之间的依赖性。将所建立的方法用于烟草样品中氯含量的测定,100次重复计算得到的预测集均方根误差(RMSEP)平均值为0.0665,标准偏差(σ)为0.0045,优于全局建模和基于主成分的局部建模方法。     

主成分分光光度法中主成分的选择

主成分分析是全光谱分析度分析中常用的校正方法。本文提出第一主成分并不是与因最线性相关的主成分。为此，我们利用扫描算法众多主成分中选择与因变量（浓度）最相关的主成分，从而使计算结果更准确可信。本文还对单因变量和多因变量两种情况下主成分选择的统计量进行了讨论。