Discrimination of Rhizoma Corydalis from two sources by near-infrared spectroscopy supported by the wavelet transform and least-squares support vector machine methods

Near-infrared spectroscopy (NIRS) was applied for direct and rapid collection of characteristic spectra from Rhizoma Corydalis, a common traditional Chinese medicine (TCM), with the aim of developing a method for the classification of such substances according to their geographical origin. The powdered form of the TCM was collected from two such different sources, and their NIR spectra were pretreated by the wavelet transform (WT) method. A training set of such Rhizoma Corydalis spectral objects was modeled with the use of the least-squares support vector machines (LS-SVM), radial basis function artificial neural networks (RBF-ANN), partial least-squares discriminant analysis (PLS-DA) and K-nearest neighbors (KNN) methods. All the four chemometrics models performed reasonably on the basis of spectral recognition and prediction criteria, and the LS-SVM method performed best with over 95% success on both criteria. Generally, there are no statistically significant differences in all these four methods. Thus, the NIR spectroscopic method supported by all the four chemometrics models, especially the LS-SVM, are recommended for application to classify TCM, Rhizoma Corydalis, samples according to their geographical origin.     

Improvement of prediction ability of PLS models employing the wavelet packet transform: A case study concerning FT-IR determination of gasoline parameters

The wavelet packet transform (WPT) is a variant of the standard wavelet transform that offers greater flexibility in the decomposition of instrumental signals. Although encouraging results have been published concerning the use of WPT for signal compression and denoising, its application in multivariate calibration problems has received comparatively little attention, with very few contributions reported in the literature. This paper presents an investigation concerning the use of WPT as a feature extraction tool to improve the prediction ability of PLS models. The optimization of the wavelet packet tree is accomplished by using the classic dynamic programming algorithm and an entropy cost function modified to take into account the variance explained by the WPT coefficients. The selection of WPT coefficients for inclusion in the PLS model is carried out on the basis of correlation with the dependent variable, in order to exploit the joint statistics of the instrumental response and the parameter of interest. This WPT-PLS strategy is applied in a case study involving FT-IR spectrometric determination of four gasoline parameters, namely specific mass (SM) and the distillation temperatures at which 10%, 50%, 90% of the sample has evaporated. The dataset comprises 103 gasoline samples collected from gas stations and 6144 wavelengths in the range 2500-15000 nm. By applying WPT to the FT-IR spectra, considerable compression with respect to the original wavelength domain is achieved. The effect of varying the wavelet and the threshold level on the prediction ability of the resulting models is investigated. The results show that WPT-PLS outperforms standard PLS in most wavelet-threshold combinations for all determined parameters.     

A Background and noise elimination method for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the varying background and noise simultaneously for multivariate calibration of near infrared (NIR) spectral signals. The method is based on the use of multi-resolution, which is one of the main advantages provided by wavelet transform. The signals are firstly split into different frequency components, which keep the same data points of the original signals. In conjunction with a modified uninformative variable elimination (mUVE) criterion, the new method can be used to remove the low-frequency varying background and the high-frequency noise simultaneously. The method is successfully applied to simulated spectral data set and experimental NIR spectral data, resulting in more parsimonious multivariate models with higher precision. In addition, the proposed strategy can be applied to other spectral signals as well.     

A method for near-infrared spectral calibration of complex plant samples with wavelet transform and elimination of uninformative variables

An algorithm is proposed for extracting relevant information from near-infrared (NIR) spectra for multivariate calibration of routine components in complex plant samples. The algorithm is a combination of wavelet transform (WT) data compression and a procedure for uninformative variable elimination (UVE). After compression of the NIR spectra by WT, the UVE approach is used to eliminate the irrelevant wavelet coefficients. Finally, a calibration model is built from the retained wavelet coefficients to enable prediction. Because irrelevant information can be removed from the spectra used for multivariate calibration, the model based on the extracted relevant features is better than those obtained with full-spectrum data. Both prediction precision and calculation speed are improved.     

Extraction of multiple pure component H and C NMR spectra from two mixtures: Novel solution obtained by sparse component analysis-based blind decomposition

Sparse component analysis (SCA) is demonstrated for blind extraction of three pure component spectra from only two measured mixed spectra in ¹³C and ¹H nuclear magnetic resonance (NMR) spectroscopy. This appears to be the first time to report such results and that is the first novelty of the paper. Presented concept is general and directly applicable to experimental scenarios that possibly would require use of more than two mixtures. However, it is important to emphasize that number of required mixtures is always less than number of components present in these mixtures. The second novelty is formulation of blind NMR spectra decomposition exploiting sparseness of the pure components in the wavelet basis defined by either Morlet or Mexican hat wavelet. This enabled accurate estimation of the concentration matrix and number of pure components by means of data clustering algorithm and pure components spectra by means of linear programming with constraints from both ¹H and ¹³C NMR experimental data. The third novelty is capability of proposed method to estimate number of pure components in demanding underdetermined blind source separation (uBSS) scenario. This is in contrast to majority of the BSS algorithms that assume this information to be known in advance. Presented results are important for the NMR spectroscopy-associated data analysis in pharmaceutical industry, medicine diagnostics and natural products research.     

Comparison of multivariate calibration models for glucose,urea, and lactate from near-infrared and Raman spectra

Partial least-squares (PLS) calibration models have been generated from a series of near-infrared (near-IR) and Raman spectra acquired separately from sixty different mixed solutions of glucose, lactate, and urea in aqueous phosphate buffer. Independent PLS models were prepared and compared for glucose, lactate, and urea. Near-IR and Raman spectral features differed substantially for these solutes, with Raman spectra enabling greater distinction with less spectral overlap than features in the near-IR spectra. Despite this, PLS models derived from near-IR spectra outperformed those from Raman spectra. Standard errors of prediction were 0.24, 0.11, and 0.14 mmol L⁻¹ for glucose, lactate, and urea, respectively, from near-IR spectra and 0.40, 0.42, and 0.36 mmol L⁻¹ for glucose, lactate, and urea, respectively, from Raman spectra. Differences between instrumental signal-to-noise ratios were responsible for the better performance of the near-IR models. The chemical basis of model selectivity was examined for each model by using a pure component selectivity analysis combined with analysis of the net analyte signal for each solute. This selectivity analysis showed that models based on either near-IR or Raman spectra had excellent selectivity for the targeted analyte. The net analyte signal analysis also revealed that analytical sensitivity was higher for the models generated from near-IR spectra. This is consistent with the lower standard errors of prediction.     

Data fusion in the wavelet domain by means of fuzzy aggregation connectives

Dual-domain classification analysis is proposed to identify pigments used in works of art studied by Raman spectroscopy and X-ray fluorescence spectrometry. By means of this methodology, Raman and X-ray fluorescence data are jointly processed by a high-level fusion approach. The system proposed aims to avoid the pre-processing stage and directly process raw data obtained from the instrument. The system is tested with spectra contaminated with background components of different shapes and intensities and with those with the background removed by line segment correction. The benefits of the approach were well demonstrated in a study of an ochre pigment classification.The approach is based on the main advantage of wavelet transform, which is multiresolution. Each spectrum is split into blocks, according to a specific frequency, to form a wavelet prism. Partial least squares-discriminant analysis (PLS-DA) is then applied to those blocks which contain the deterministic part of the signal and are not influenced by noise and background signal components. At the end, to obtain the final classification assignment, high-level data fusion of the classifications results (decision levels) obtained from PLS-DA analysis is done by means of fuzzy aggregation connective operators. Our study showed that fuzzy aggregation may be suitable for performing high-level data fusion on dual-domain data. This method can be automated so that classification can be rapid. It can handle classifications with different levels of difficulty and requires no prior knowledge of sample composition.     

小波包变换潜变量回归同时测定三组分混合物

采用小波包变换潜变量回归 (WPLVR)方法 ,同时测定水杨酸甲酯(MSA)、邻苯二甲酸二丁酯 (DBP)和邻苯二甲酸氢钾 (PHP)。该法结合小波包变换和潜变量回归改进除噪质量。通过最佳化 ,选择了小波函数及小波包分解水平 (L)。编制了两个程序 (PWPLVR)和 (PFTLVR)进行WPLVR和付立叶变换潜变量回归 (FTLVR)法计算。实验结果表明WPLVR法是成功的且优于FTLVR法。     

Quantitative analysis of the hydration of lithium salts in water using multivariate curve resolution of near-infrared spectra

The hydration process of lithium iodide, lithium bromide, lithium chloride and lithium nitrate in water was analyzed quantitatively by applying multivariate curve resolution alternating least squares (MCR-ALS) to their near infrared spectra recorded between 850 nm and 1100 nm. The experiments were carried out using solutions with a salt mass fraction between 0% and 72% for lithium bromide, between 0% and 67% for lithium nitrate and between 0% and 62% for lithium chloride and lithium iodide at 323.15 K, 333.15 K, 343.15 K and 353.15 K, respectively. Three factors were determined for lithium bromide and lithium iodide and two factors for the lithium chloride and lithium nitrate by singular value decomposition (SVD) of their spectral data matrices. These factors are associated with various chemical environments in which there are aqueous clusters containing the ions of the salts and non-coordinated water molecules. Spectra and concentration profiles of non-coordinated water and cluster aqueous were retrieved by MCR-ALS. The amount of water involved in the process of hydration of the various salts was quantified. The results show that the water absorption capacity increases in the following order LiI < LiBr < LiNO₃ < LiCl. The salt concentration at which there is no free water in the medium was calculated at each one of the temperatures considered. The values ranged between 62.6 and 65.1% for LiBr, 45.5–48.3% for LiCl, 60.4–61.2% for LiI and 60.3–63.7% for LiNO₃. These values are an initial approach to determining the concentration as from which crystal formation is favored.     

Combining orthogonal signal correction and wavelet packet transform with partial least squares to analyze overlapping spectra of three kinds of metal ions

A novel method named OSC-WPT-PLS approach based on partial least squares (PLS) regression with orthogonal signal correction (OSC) and wavelet packet transform (WPT) as pre-processed tools was proposed for the simultaneous spectrophotometric determination of Al(III), Mn(II) and Co(II). This method combines the ideas of OSC and WPT with PLS regression for enhancing the ability of extracting characteristic information and the quality of regression. OSC is used to remove information in the response matrix D by subtracting the structured noise that is orthogonal to the concentration matrix C. Wavelet packet transform was applied to perform data compression, to extract relevant information, and to eliminate noise and collinearity. PLS was applied for multivariate calibration and noise reduction by eliminating the less important latent variables. In this case, using trials, the kind of wavelet function, the decomposition level, the number of OSC components and the number of PLS factors for the OSC-WPT-PLS method were selected as Daubechies 4, 3, 2 and 3, respectively. A program (POSCWPTPLS) was designed to perform the simultaneous spectrophotometric determination of Al(III), Mn(II) and Co(II). The relative standard errors of prediction (RSEP) obtained for total elements using OSC-WPT-PLS, WPT-PLS and PLS were compared. Experimental results demonstrated that the OSC-WPT-PLS method had the best performance among the three methods and was successful even when there was severe overlap of spectra.     

A method for determination of COD in a domestic wastewater treatment plant by using near-infrared reflectance spectrometry of seston

This paper proposes a method for determination of chemical oxygen demand (COD) in domestic wastewater. The proposed method is based on near-infrared reflectance (NIRR) measurements of seston collected from wastewater samples by filtration. The analysis does not require any special reagent, catalyst or solvent. Inherent baseline and noise features present in NIRR spectra are removed by a Savitzky-Golay derivative procedure followed by wavelet denoising. The resulting wavelet approximation coefficients are used for partial-least-squares modelling and subsequent prediction of COD values in new samples. The model is calibrated by using COD values obtained according to the American Public Health Association (APHA) reference method. The proposed method is applied to effluent samples from the anaerobic ponds of the Mangabeira municipal wastewater treatment plant in the city of João Pessoa (Paraíba, Brazil). By comparing the NIRR prediction results with the APHA reference values, a root-mean-square error of prediction (RMSEP) of 19 mg O₂ L⁻¹ and a correlation of 0.97 were obtained. Such results are deemed adequate in view of the joint estimate of the standard error of the reference method, which was calculated as 21 mg O₂ L⁻¹.     

Selectivity for glucose,glucose-6-phosphate,and pyruvate in ternary mixtures from the multivariate analysis of near-infrared spectra

Near-infrared spectroscopy offers the potential for direct in situ analysis in complex biological systems. Chemical selectivity is a critical issue for such measurements given the extent of spectral overlap of overtone and combination spectra. In this work, the chemical basis of selectivity is investigated for a set of multivariate calibration models designed to quantify glucose, glucose-6-phosphate, and pyruvate independently in ternary mixtures. Near-infrared spectra are collected over the combination region (4,000–5,000 cm⁻¹) for a set of 60 standard solutions maintained at 37 °C. These standard solutions are composed of randomized concentrations (0.5–30 mM) of glucose, glucose-6-phosphate, and pyruvate. Individual calibration models are constructed for each solute by using the partial least-squares (PLS) algorithm with optimized spectral range and number of latent variables. The resulting standard errors are 0.90, 0.72, and 0.32 mM for glucose, glucose-6-phosphate, and pyruvate, respectively. A pure component selectivity analysis (PCSA) demonstrates selectivity for each solute in these ternary samples. The concentration of each solute is also predicted for each sample by using a set of net analyte signal (NAS) calibration models. A comparison of the PLS and NAS calibration vectors demonstrates the chemical basis of selectivity for these multivariate methods. Selectivity of each PLS and NAS calibration model originates from the unique spectral features associated with the targeted analyte. Overall, selectivity is demonstrated for each solute with an order of sensitivity of pyruvate > glucose-6-phosphate > glucose. Figure Combination near-infrared spectroscopy allows selective analytical measurements for glucose, glucose-6-phosphate, and pyruvate in ternary mixtures owing to the uniqueness of the individual absorption spectra for each solute     

A consensus least squares support vector regression (LS-SVR) for analysis of near-infrared spectra of plant samples

Consensus modeling of combining the results of multiple independent models to produce a single prediction avoids the instability of single model. Based on the principle of consensus modeling, a consensus least squares support vector regression (LS-SVR) method for calibrating the near-infrared (NIR) spectra was proposed. In the proposed approach, NIR spectra of plant samples were firstly preprocessed using discrete wavelet transform (DWT) for filtering the spectral background and noise, then, consensus LS-SVR technique was used for building the calibration model. With an optimization of the parameters involved in the modeling, a satisfied model was achieved for predicting the content of reducing sugar in plant samples. The predicted results show that consensus LS-SVR model is more robust and reliable than the conventional partial least squares (PLS) and LS-SVR methods.     

The application of fourier-transformed near-infrared spectra to quantitative analysis by comparison of similarity indices (CARNAC)

A new technique for utilising near-infrared spectroscopic data for quantitative analysis is proposed. The method uses a database of spectra stored in the form of the Fourier transform together with the associated chemical analysis. The spectrum of an unknown sample is compared to each member of the database and a small subset of very similar samples is isolated. The analyte value for the unknown is calculated from the analytical values of the subset. Results are given for the application of the method to the analysis of nicotine in tobacco.     

Development of wavelet transform voltammetric analyzer

An on-line wavelet transform algorithm and development of voltammetric analyzer with the on-line wavelet transform (WT-voltammetric analyzer) are described. Because the on-line wavelet transform decomposes the sampled signal simultaneously with the progress of sampling, the WT-voltammetric analyzer gives all the components contained in the sampled voltammogram. Applications of the WT-voltammetric analyzer in linear sweep voltammetric analysis of mixtures of Pb(II) and Tl(I) and in square wave voltammetric analysis of mixture of Cd(II) and In(III) were investigated. Results showed that the overlapping peaks of Pb(II) and Tl(I) can be separated easily, and the peak position after the on-line wavelet transform does not change. The linearity of the calibration curves for Cd(II) and In(III) in the overlapping square wave voltammetric curves were kept after the on-line wavelet transform. Quantitative determination of Cd(II) and In(III) in mixture samples were investigated. The recoveries are between 92.5 and 107.1%.     

Resolution of overlapping signals in spectrometry using a wavelet packet transform and an Elman recurrent neural network

A novel method named a wavelet packet transform based Elman recurrent neural network (WPTERNN) was proposed for the simultaneous UV–visible spectrometric determination of Cu(II), Cd(II) and Zn(II). This method combined wavelet packet denoising with an Elman recurrent neural network. A wavelet packet transform was applied to perform data compression, to extract relevant information, and to eliminate noise and collinearity. An Elman recurrent network was applied for nonlinear multivariate calibration. In this case, using trials, the kind of wavelet function, the decomposition level, and the number of hidden nodes for the WPTERNN method were selected as Daubechies 14, 3, and 8, respectively. A program (PWPTERNN) was designed that could perform the simultaneous determination of Cu(II), Cd(II) and Zn(II). The relative standard errors of prediction (RSEP) obtained for all components using WPTERNN, a Elman recurrent neural network (ERNN), partial least squares (PLS), principal component regression (PCR), Fourier transform based PCR (FTPCR), and multivariate linear regression (MLR) were compared. Experimental results demonstrated that the WPTERRN method was successful even where there was severe overlap of spectra. The results obtained from an additional test case also demonstrated that the WPTERNN method performed very well. Figure The part of WP coefficients obtained by wavelet packet transforms     

Matching fluorescence spectra of oil spills with spectra from suspect sources

Fluorescence spectroscopy is ideally suited to the analysis of oil spills as it allows chemical information of polycyclic aromatic hydrocarbons to be acquired quickly, sensitively and selectively. Unlike infrared spectra which have detailed peak information, many fluorescence spectra have only a few broad peaks. Nine different samples of crude and diesel oils were used for testing point-to-point matching across the spectral range. Five of them were discriminated by point-to-point matching algorithms and the other four very similar samples were not. Principal components analysis (PCA) did successfully discriminate among all similar samples. PCA could also distinguish the extent of weathering of different samples, an important factor in matching environmental spills.     

Detecting the quality of glycerol monolaurate: A method for using Fourier transform infrared spectroscopy with wavelet transform and modified uninformative variable elimination

Glycerol monolaurate (GML) products contain many impurities, such as lauric acid and glucerol. The GML content is an important quality indicator for GML production. A hybrid variable selection algorithm, which is a combination of wavelet transform (WT) technology and modified uninformative variable eliminate (MUVE) method, was proposed to extract useful information from Fourier transform infrared (FT-IR) transmission spectroscopy for the determination of GML content. FT-IR spectra data were compressed by WT first; the irrelevant variables in the compressed wavelet coefficients were eliminated by MUVE. In the MUVE process, simulated annealing (SA) algorithm was employed to search the optimal cutoff threshold. After the WT-MUVE process, variables for the calibration model were reduced from 7366 to 163. Finally, the retained variables were employed as inputs of partial least squares (PLS) model to build the calibration model. For the prediction set, the correlation coefficient (r) of 0.9910 and root mean square error of prediction (RMSEP) of 4.8617 were obtained. The prediction result was better than the PLS model with full-spectra data. It was indicated that proposed WT-MUVE method could not only make the prediction more accurate, but also make the calibration model more parsimonious. Furthermore, the reconstructed spectra represented the projection of the selected wavelet coefficients into the original domain, affording the chemical interpretation of the predicted results. It is concluded that the FT-IR transmission spectroscopy technique with the proposed method is promising for the fast detection of GML content.     

小波变换用于示波信号中有用信息提取的研究

示波分析是近年来在我国发展起来的一个新的电化学分析研究领域［１～４］．它根据阴极射线示波器荧光屏上示波图及其变化进行分析测试,从原理上可以将其分为示波电位法和示波计时电位法;从测定方式上可以将其分为示波滴定和示波测定．关于示波电位法的一些理论问题（如...