Determination of Total Sugar in Tobacco by Near-Infrared Spectroscopy and Wavelet Transformation-Based Calibration

Based on wavelet transformation (WT) and mutual information (MI), a simple and effective procedure is proposed for multivariate calibration of near-infrared spectroscopy. In such a procedure, the original spectra of the training set are first transformed into a set of wavelet representations by wavelet prism transform. Then, the MI value between each wavelet coefficient variable and the dependent variable is calculated, resulting in a MI spectrum; by retaining a subset set of coefficients with higher MI, an update training set consisting of wavelet coefficients is obtained and reconstructed/converted back to the original domain. Based on this, a partial least square (PLS) model can be constructed and optimized. The optimal wavelet and decomposition level are determined by experiment. A NIR quantitative problem involving the determination of total sugar in tobacco is used to demonstrate the overall performance of the proposed procedure, named RPLS, meaning PLS in reconstructed original domain coupled with MI-induced variable selection in wavelet domain (RPLS). Three kinds of procedures, that is, conventional full-spectrum PLS in original domain (FPLS), PLS in original domain coupled with MI-induced variable selection (OPLS), and direct PLS in MI-based wavelet coefficients (WPLS), are used as reference. The result confirms that it can build more accurate and robust calibration models without increasing the complexity.     

小波变换结合多维偏最小二乘方法用于近红外光谱定量分析

将小波变换和多维偏最小二乘法相结合用于近红外光谱定量校正模型的建立。首先将原始光谱进行小波变换分解，得到系列小波细节系数，通过选取一组受外界因素少、信息强的小波系数组成三维光谱阵，然后再采用多维偏最小二乘法建立校正模型。实验结果表明，该方法所建近红外校正模捌的预测能力更强，并更具稳健性。     

Adaptive wavelet transform suppresses background and noise for quantitative analysis by Raman spectrometry

Discrete wavelet transform (DWT) provides a well-established means for spectral denoising and baseline elimination to enhance resolution and improve the performance of calibration and classification models. However, the limitation of a fixed filter bank can prevent the optimal application of conventional DWT for the multiresolution analysis of spectra of arbitrarily varying noise and background. This paper presents a novel methodology based on an improved, second-generation adaptive wavelet transform (AWT) algorithm. This AWT methodology uses a spectrally adapted lifting scheme to generate an infinite basis of wavelet filters from a single conventional wavelet, and then finds the optimal one. Such pretreatment combined with a multivariate calibration approach such as partial least squares can greatly enhance the utility of Raman spectroscopy for quantitative analysis. The present work demonstrates this methodology using two dispersive Raman spectral data sets, incorporating lactic acid and melamine in pure water and in milk solutions. The results indicate that AWT can separate spectral background and noise from signals of interest more efficiently than conventional DWT, thus improving the effectiveness of Raman spectroscopy for quantitative analysis and classification.     

Detecting the quality of glycerol monolaurate: A method for using Fourier transform infrared spectroscopy with wavelet transform and modified uninformative variable elimination

Glycerol monolaurate (GML) products contain many impurities, such as lauric acid and glucerol. The GML content is an important quality indicator for GML production. A hybrid variable selection algorithm, which is a combination of wavelet transform (WT) technology and modified uninformative variable eliminate (MUVE) method, was proposed to extract useful information from Fourier transform infrared (FT-IR) transmission spectroscopy for the determination of GML content. FT-IR spectra data were compressed by WT first; the irrelevant variables in the compressed wavelet coefficients were eliminated by MUVE. In the MUVE process, simulated annealing (SA) algorithm was employed to search the optimal cutoff threshold. After the WT-MUVE process, variables for the calibration model were reduced from 7366 to 163. Finally, the retained variables were employed as inputs of partial least squares (PLS) model to build the calibration model. For the prediction set, the correlation coefficient (r) of 0.9910 and root mean square error of prediction (RMSEP) of 4.8617 were obtained. The prediction result was better than the PLS model with full-spectra data. It was indicated that proposed WT-MUVE method could not only make the prediction more accurate, but also make the calibration model more parsimonious. Furthermore, the reconstructed spectra represented the projection of the selected wavelet coefficients into the original domain, affording the chemical interpretation of the predicted results. It is concluded that the FT-IR transmission spectroscopy technique with the proposed method is promising for the fast detection of GML content.     

A Background and noise elimination method for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the varying background and noise simultaneously for multivariate calibration of near infrared (NIR) spectral signals. The method is based on the use of multi-resolution, which is one of the main advantages provided by wavelet transform. The signals are firstly split into different frequency components, which keep the same data points of the original signals. In conjunction with a modified uninformative variable elimination (mUVE) criterion, the new method can be used to remove the low-frequency varying background and the high-frequency noise simultaneously. The method is successfully applied to simulated spectral data set and experimental NIR spectral data, resulting in more parsimonious multivariate models with higher precision. In addition, the proposed strategy can be applied to other spectral signals as well.     

A linear semi-infinite programming strategy for constructing optimal wavelet transforms in multivariate calibration problems

A novel strategy for the optimization of wavelet transforms with respect to the statistics of the data set in multivariate calibration problems is proposed. The optimization follows a linear semi-infinite programming formulation, which does not display local maxima problems and can be reproducibly solved with modest computational effort. After the optimization, a variable selection algorithm is employed to choose a subset of wavelet coefficients with minimal collinearity. The selection allows the building of a calibration model by direct multiple linear regression on the wavelet coefficients. In an illustrative application involving the simultaneous determination of Mn, Mo, Cr, Ni, and Fe in steel samples by ICP-AES, the proposed strategy yielded more accurate predictions than PCR, PLS, and nonoptimized wavelet regression.     

基于小波系数的近红外光谱局部建模方法与应用研究

局部建模方法使用与预测样本相似的样本建立模型,可解决光谱响应与浓度之间的非线性问题,扩大模型的适用范围,提高预测准确度。采用小波变换进行数据压缩并利用小波系数之间的欧氏距离作为光谱相似性的判据,实现了近红外光谱定量分析的局部建模方法,避免了样本之间的依赖性。将所建立的方法用于烟草样品中氯含量的测定,100次重复计算得到的预测集均方根误差(RMSEP)平均值为0.0665,标准偏差(σ)为0.0045,优于全局建模和基于主成分的局部建模方法。     

Characterization of the Release of Urea from Coated Fertilizer by Fourier Transform Infrared Spectroscopy with Attenuated Total Reflectance

The development of a simple and cost-effective method for the determination of the release of coated urea has significant implications. Fourier-transform infrared spectroscopy with attenuated total reflectance was employed to determine the release of urea through univariate and multivariate calibration. The results indicated that univariate calibration did not accurately predict the release of urea, whereas partial least squares based on multivariate calibration performed significantly better. Partial least squares had the highest accuracy when the band located at 1420–1520 per centimeter was employed as the input. Moreover, the accuracy was further improved when segmented partial least squares models were developed at low and high urea concentrations. Unsegmented and segmented partial least squares models were employed, and release values were comparable to those measured by colorimetry. This work demonstrated the use of infrared spectroscopy and partial least squares to characterize the release of coated urea.     

Determination of chlorogenic acid in plant samples by using near-infrared spectrum with wavelet transform preprocessing.

By theoretical analysis, it is found that wavelet transform (WT) with a wavelet function can be regarded as a smoothing and a differentiation process, and that the order of differentiation is determined by the vanishing moment, which is an important property of a wavelet function. Therefore, a method based on the continuous wavelet transform (CWT) for removing the background in the near-infrared (NIR) spectrum is proposed, and it is used in the determination of the chlorogenic acid in plant samples as a preprocessing tool for partial least square (PLS) modeling. It is shown that the benefit of the proposed method lies not only in its performance to improve the quality of PLS model and the prediction precision, but also in its simplicity and practicability. It may become a convenient and efficient tool for preprocessing NIR spectral data sets in multivariate calibration.     

Determining the Kinematic Viscosity of Lubricant Oils for Gear Motors by Using the Near Infrared Spectroscopy (NIRS) and the Wavelength Selection

This paper reports the chemometric predictive models developed for near infrared spectroscopy (NIRS) for the quantitative determination of the kinematic viscosity (37.1–93.1 cSt) of lubricant oils for gear motors. The gear motor is a complete motive force system that consists of an electric motor and a reduction gear train integrated into one easy-to-mount and configure package. The method used for measuring the viscosity of the lubricating oil was ASTM D445, the Standard Test Method for Kinematic Viscosity of Transparent and Opaque Liquids. A comparison was made among several multivariate calibration techniques and algorithms for pre-processing and variable selection of data, including partial least squares, interval partial least squares (iPLS), a genetic algorithm (GA), and a successive projections algorithm. Finally, the results obtained for the root mean square errors of prediction in cSt and relative average error were, respectively, 1.86 and 2.97% (GA) and 2.36 and 2.97% (iPLS). The method proposed in this study is a useful alternative for the determination of the kinematic viscosity in oils for gear motors.     

Determination of apparent reducing sugars, moisture and acidity in honey by attenuated total reflectance-Fourier transform infrared spectrometry

Attenuated total reflectance-Fourier transform infrared spectrometry, in conjunction with multivariate calibration, was used for determination of reducing sugars, humidity and acidity in honey bee samples. Multivariate calibration models were built using partial least squares (PLS) and were refined through variable selection per interval (iPLS) and genetic algorithms. The calibration models show satisfactory results for all parameters with average relative errors of 6% for acidity, 1% for reducing sugars and 2% for humidity. For the acidity and reducing sugars parameters, variable selection was irrelevant, but for humidity it was essential. For the humidity parameter, it was necessary to use two variable selection techniques (by intervals and genetic algorithm) concomitantly in order to obtain a satisfactory calibration model.     

Resolution of overlapping signals in spectrometry using a wavelet packet transform and an Elman recurrent neural network

A novel method named a wavelet packet transform based Elman recurrent neural network (WPTERNN) was proposed for the simultaneous UV–visible spectrometric determination of Cu(II), Cd(II) and Zn(II). This method combined wavelet packet denoising with an Elman recurrent neural network. A wavelet packet transform was applied to perform data compression, to extract relevant information, and to eliminate noise and collinearity. An Elman recurrent network was applied for nonlinear multivariate calibration. In this case, using trials, the kind of wavelet function, the decomposition level, and the number of hidden nodes for the WPTERNN method were selected as Daubechies 14, 3, and 8, respectively. A program (PWPTERNN) was designed that could perform the simultaneous determination of Cu(II), Cd(II) and Zn(II). The relative standard errors of prediction (RSEP) obtained for all components using WPTERNN, a Elman recurrent neural network (ERNN), partial least squares (PLS), principal component regression (PCR), Fourier transform based PCR (FTPCR), and multivariate linear regression (MLR) were compared. Experimental results demonstrated that the WPTERRN method was successful even where there was severe overlap of spectra. The results obtained from an additional test case also demonstrated that the WPTERNN method performed very well. Figure The part of WP coefficients obtained by wavelet packet transforms     

A method for near-infrared spectral calibration of complex plant samples with wavelet transform and elimination of uninformative variables

An algorithm is proposed for extracting relevant information from near-infrared (NIR) spectra for multivariate calibration of routine components in complex plant samples. The algorithm is a combination of wavelet transform (WT) data compression and a procedure for uninformative variable elimination (UVE). After compression of the NIR spectra by WT, the UVE approach is used to eliminate the irrelevant wavelet coefficients. Finally, a calibration model is built from the retained wavelet coefficients to enable prediction. Because irrelevant information can be removed from the spectra used for multivariate calibration, the model based on the extracted relevant features is better than those obtained with full-spectrum data. Both prediction precision and calculation speed are improved.     

Comparison and joint use of near infrared spectroscopy and Fourier transform mid infrared spectroscopy for the determination of wine parameters

A study of the statistic characteristics of the multidetermination of several enological parameters - namely, alcoholic degree, volumic mass, total acidity, glycerol, total polyphenol index, lactic acid and total sulphur dioxide - depending on the spectroscopic zone employed, was carried out. The two techniques used were near infrared spectroscopy (NIRS) and Fourier transform mid infrared spectroscopy (FT-MIRS). The combination of these two regions (sum of their spectra) was also studied. NIRS yielded better results, but the use of both zones improved the determination of glycerol and total sulphur dioxide. The training and validation sets used for developing general equations were built with samples from different apellation d’origine, different wine types, etc. Partial least squares regression was used for multivariate calibration, using systematic cross validation in the calibration stage and external validation in the testing stage. Sample preparation was not required.     

Chemometric determination of arsenic and lead in untreated powdered red paprika by diffuse reflectance near-infrared spectroscopy

It has been evaluated the potential of near-infrared (NIR) diffuse reflectance infrared Fourier transform spectroscopy (DRIFTS) as a way for non-destructive measurement of trace elements at μg kg⁻¹ level in foods, with neither physical nor chemical pre-treatment. Predictive models were developed using partial least-square (PLS) multivariate approaches based on first-order derivative spectra. A critical comparison of two spectral pre-treatments, multiplicative signal correction (MSC) and standard normal variate (SNV) was also made. The PLS models built after using SNV provided the best prediction results for the determination of arsenic and lead in powdered red paprika samples. Relative root-mean-square error of prediction (RRMSEP) of 23% for both metals, arsenic and lead, were found in this study using 20 well characterized samples for calibration and 13 additional samples as validation set. Results derived from this study showed that NIR diffuse reflectance spectroscopy combined with the appropriate chemometric tools could be considered as an useful screening tool for a rapid determination of As and Pb at concentration level of the order of hundred μg kg⁻¹.     

Direct determination of ephedrine intermediate in a biotransformation reaction using infrared spectroscopy and PLS

Fourier transform mid-infrared spectroscopy (FT-MIR) coupled with a homemade attenuated total reflectance (ATR) flow-cell was used for on-line monitoring of a biotransformation reaction. The reaction was also monitored off-line by gas chromatography-mass spectrometry (GC-MS) enabling to establish a multivariate model for the infrared data based on partial least squares (PLS) regression. The method developed allowed the simultaneous determination of the substrate, two intermediates and the final product involved in the reduction reaction of 1-phenyl 1,2-propanedione at an initial concentration of 0.5% (v/v). The reaction was accomplished with a whole-cell suspension of Saccharomyces cerevisiae in a phosphate buffer of pH 3.0 at 32+/-1 degrees C. The ATR infrared monitoring was performed directly on the suspension cell without any separation process or extraction over 3h, totaling 188 spectra. The data were split into two subsets, with 158 times for calibration and 30 times for validation. The results showed that the proposed method may be used for on-line monitoring of the biotransformation reactions when the initial concentration is very low.     

Improvement of prediction ability of PLS models employing the wavelet packet transform: A case study concerning FT-IR determination of gasoline parameters

The wavelet packet transform (WPT) is a variant of the standard wavelet transform that offers greater flexibility in the decomposition of instrumental signals. Although encouraging results have been published concerning the use of WPT for signal compression and denoising, its application in multivariate calibration problems has received comparatively little attention, with very few contributions reported in the literature. This paper presents an investigation concerning the use of WPT as a feature extraction tool to improve the prediction ability of PLS models. The optimization of the wavelet packet tree is accomplished by using the classic dynamic programming algorithm and an entropy cost function modified to take into account the variance explained by the WPT coefficients. The selection of WPT coefficients for inclusion in the PLS model is carried out on the basis of correlation with the dependent variable, in order to exploit the joint statistics of the instrumental response and the parameter of interest. This WPT-PLS strategy is applied in a case study involving FT-IR spectrometric determination of four gasoline parameters, namely specific mass (SM) and the distillation temperatures at which 10%, 50%, 90% of the sample has evaporated. The dataset comprises 103 gasoline samples collected from gas stations and 6144 wavelengths in the range 2500-15000 nm. By applying WPT to the FT-IR spectra, considerable compression with respect to the original wavelength domain is achieved. The effect of varying the wavelet and the threshold level on the prediction ability of the resulting models is investigated. The results show that WPT-PLS outperforms standard PLS in most wavelet-threshold combinations for all determined parameters.     

自适应小波算法用于近红外光谱的多元校正

实现了一种构建自适应小波滤波器的方法,并将其用于近红外光谱数据的多元校正。该方法根据一定的目标函数,针对信号的特性自适应地构造小波滤波器。用该法构建的滤波器对烟草样品的近红外光谱进行压缩,并将压缩后的数据采用偏最小二乘法建模,实现了烟草样品常规组分的定量分析。     

Near infrared reflectance spectroscopy as a tool for the control of sheep leather defatting

The fat content is one of the variables to be controlled by the tanning industry with a view to obtaining leather for various commercial purposes. Ensuring the production of quality leather products frequently entails using some defatting treatment, particularly when the raw skin is rich in natural fat. The official method for determining fat in leather, IUC 4, is rather slow; also, it uses polluting reagents and involves powdering samples for Soxhlet extraction with low-polarity solvents. The combination of NIR diffuse reflectance spectroscopy as implemented with a fibre-optic probe and multivariate calibration is probably the best choice for the direct determination of fat in leather and the monitoring of leather defatting.In this work, a method for the determination of fat in leather and the control of the defatting process in an expeditious manner and with no sample treatment was developed. Defatting tests were conducted on leather specimens from lambs of various breeds and origins in order to span as wide as possible a range of variability in their properties and natural fat content. The NIR spectra used to construct the calibration matrices were recorded directly on the leather samples prior to and after defatting. Fat contents were determined by partial least-squares regression (PLSR), using the values obtained with the official method as references. Notwithstanding the complex nature of leather, the calibration models used provided good external predictions: the largest overall relative error, obtained by using a single calibration matrix for natural and defatted specimens, was 10%. The proposed method is therefore an advantageous alternative to the official method.     

Comparison of two vibrational procedures for the direct determination of mancozeb in agrochemicals

The direct determination of mancozeb in agrochemicals has been made by diamond attenuated total reflectance (ATR) Fourier transform infrared spectroscopy in the middle range (DATR-MIR) and diffuse reflectance infrared Fourier transform spectroscopy in the near range (DR-NIR) methods using in both cases a previous identification of the samples using a dendrographic classification and an appropriate partial least squares (PLS) calibration established from a set of nine external standards and optimized for each type of sample. It was analyzed a heterogeneous population of 11 samples obtained from the Spanish market, containing different co-formulated products, such as fosetyl-Al, copper oxychloride, metalaxyl or cymoxanil. High performance liquid chromatography (HPLC) was used as reference method for validation of both vibrational strategies. The close agreement between values found for both, DATR-MIR and DR-NIR methods, and reference HPLC values indicates the accuracy and reliability of the proposed techniques for the direct determination of mancozeb in commercially available formulations.