An adaptive strategy for selecting representative calibration samples in the continuous wavelet domain for near-infrared spectral analysis

Sample selection is often used to improve the cost-effectiveness of near-infrared (NIR) spectral analysis. When raw NIR spectra are used, however, it is not easy to select appropriate samples, because of background interference and noise. In this paper, a novel adaptive strategy based on selection of representative NIR spectra in the continuous wavelet transform (CWT) domain is described. After pretreatment with the CWT, an extension of the Kennard–Stone (EKS) algorithm was used to adaptively select the most representative NIR spectra, which were then submitted to expensive chemical measurement and multivariate calibration. With the samples selected, a PLS model was finally built for prediction. It is of great interest to find that selection of representative samples in the CWT domain, rather than raw spectra, not only effectively eliminates background interference and noise but also further reduces the number of samples required for a good calibration, resulting in a high-quality regression model that is similar to the model obtained by use of all the samples. The results indicate that the proposed method can effectively enhance the cost-effectiveness of NIR spectral analysis. The strategy proposed here can also be applied to different analytical data for multivariate calibration.     

A method for near-infrared spectral calibration of complex plant samples with wavelet transform and elimination of uninformative variables

An algorithm is proposed for extracting relevant information from near-infrared (NIR) spectra for multivariate calibration of routine components in complex plant samples. The algorithm is a combination of wavelet transform (WT) data compression and a procedure for uninformative variable elimination (UVE). After compression of the NIR spectra by WT, the UVE approach is used to eliminate the irrelevant wavelet coefficients. Finally, a calibration model is built from the retained wavelet coefficients to enable prediction. Because irrelevant information can be removed from the spectra used for multivariate calibration, the model based on the extracted relevant features is better than those obtained with full-spectrum data. Both prediction precision and calculation speed are improved.     

Application of near-infrared spectroscopy in the sugar industry for the detection of betaine

One problem in industrial molasses desugarization is the lack of a fast analytical method for process control. At the moment, control of the chromatographic production process is achieved by detecting refractive index and conductivity. However, since elution of some components takes place only in a narrowly defined time frame, the data gained are insufficient for effective online product quantification. Near-infrared (NIR) spectroscopy was applied to this process by development of a simple method for detection of betaine. Compared to chemometric models currently used, the developed method demonstrates the advantage of requiring only a small calibration set. Additionally, it can easily be transferred to other processes without further re-calibration. Based on the NIR spectrum of betaine, a characteristic peak in the spectrum could be assigned to the molasses compound betaine. A calibration was developed by using dissolved betaine in pure water. Afterwards, the calibration was tested for samples from a molasses desugarization process. The method was than successfully transferred to a complete chromatographic cycle of the industrial molasses desugarization process.     

Systematic prediction error correction: a novel strategy for maintaining the predictive abilities of multivariate calibration models

The development of reliable multivariate calibration models for spectroscopic instruments in on-line/in-line monitoring of chemical and bio-chemical processes is generally difficult, time-consuming and costly. Therefore, it is preferable if calibration models can be used for an extended period, without the need to replace them. However, in many process applications, changes in the instrumental response (e.g. owing to a change of spectrometer) or variations in the measurement conditions (e.g. a change in temperature) can cause a multivariate calibration model to become invalid. In this contribution, a new method, systematic prediction error correction (SPEC), has been developed to maintain the predictive abilities of multivariate calibration models when e.g. the spectrometer or measurement conditions are altered. The performance of the method has been tested on two NIR data sets (one with changes in instrumental responses, the other with variations in experimental conditions) and the outcomes compared with those of some popular methods, i.e. global PLS, univariate slope and bias correction (SBC) and piecewise direct standardization (PDS). The results show that SPEC achieves satisfactory analyte predictions with significantly lower RMSEP values than global PLS and SBC for both data sets, even when only a few standardization samples are used. Furthermore, SPEC is simple to implement and requires less information than PDS, which offers advantages for applications with limited data.     

Multivariate near infrared spectroscopy models for predicting the methyl esters content in biodiesel

Biodiesel is the main alternative to fossil diesel. The key advantages of its use are the fact that it is a non-toxic renewable resource, which leads to lower emissions of polluting gases. European governments are targeting the incorporation of 20% of biofuels in the general fuels until 2020.Chemically, biodiesel is a mixture of fatty acid methyl esters, derived from vegetable oils or animal fats, which is usually produced by a transesterification reaction, where the oils/fats react with an alcohol, in the presence of a catalyst. The European Standard (EN 14214) establishes 25 parameters that have to be analysed to certify biodiesel quality and the analytical methods that should be used to determine those properties.This work reports the use of near infrared (NIR) spectroscopy to determine the esters content in biodiesel as well as the content in linolenic acid methyl esters (C18:3) in industrial and laboratory-scale biodiesel samples. Furthermore, calibration models for myristic (C14:0), palmitic (C16:0), stearic (C18:0), oleic (C18:1), linoleic (C18:2) acid methyl esters were also obtained. Principal component analysis was used for the qualitative analysis of the spectra, while partial least squares regression was used to develop the calibration models between analytical and spectral data. The results confirm that NIR spectroscopy, in combination with multivariate calibration, is a promising technique to assess the biodiesel quality control in both laboratory-scale and industrial scale samples.     

Ensemble Multivariate Calibration Based on Mutual Information for Food Analysis Using Near-Infrared Spectroscopy

An ensemble multivariate calibration algorithm, termed as MISEPLS, is proposed. In MISEPLS, when constructing a member model, the variables that have mutual information (MI) with the response less than a threshold are eliminated; thus, the modeling can be performed in a subset of original variables and some problems arising from multi-collinearity can be avoided. Through experiments on three near-infrared (NIR) spectroscopic datasets from the food industry, MISEPLS proves to be superior to the single-model full-spectrum PLS and MIPLS (PLS combined with MI-induced variable selection). MISEPLS can improve the accuracy and robustness of a calibration model, without increasing its complexity.     

Elimination of interference information by a new hybrid algorithm for quantitative calibration of near infrared spectra

A new hybrid algorithm is proposed to eliminate the interference information for multivariate calibration of near-infrared (NIR) spectra that includes noise, background and systemic spectral variation irrelevant to concentration. The method consists of two parts: approximate derivative based on continuous wavelet transform (CWT) and orthogonal signal correction (OSC). After the approximate derivative calculated by CWT, OSC was performed. It was successfully applied to real complex NIR spectral data to eliminate the interference information. Correction for the interference of NIR spectra resulted in a substantial improvement in the predicted precision, and a more concise calibration model was obtained. The proposed procedure also compared favourably with several pretreatment methods, and the new method appears to provide a high-performance pretreatment tool for multivariate calibration of NIR spectra. In addition, the strategy proposed here can be applied to various other spectral data for quantitative purposes as well.     

Maintaining the predictive abilities of multivariate calibration models by spectral space transformation

In quantitative on-line/in-line monitoring of chemical and bio-chemical processes using spectroscopic instruments, multivariate calibration models are indispensable for the extraction of chemical information from complex spectroscopic measurements. The development of reliable multivariate calibration models is generally time-consuming and costly. Therefore, once a reliable multivariate calibration model is established, it is expected to be used for an extended period. However, any change in the instrumental response or variations in the measurement conditions can render a multivariate calibration model invalid. In this contribution, a new method, spectral space transformation (SST), has been developed to maintain the predictive abilities of multivariate calibration models when the spectrometer or measurement conditions are altered. SST tries to eliminate the spectral differences induced by the changes in instruments or measurement conditions through the transformation between two spectral spaces spanned by the corresponding spectra of a subset of standardization samples measured on two instruments or under two sets of experimental conditions. The performance of the method has been tested on two data sets comprising NIR and MIR spectra. The experimental results show that SST can achieve satisfactory analyte predictions from spectroscopic measurements subject to spectrometer/probe alteration, when only a few standardization samples are used. Compared with the existing popular methods designed for the same purpose, i.e. global PLS, univariate slope and bias correction (SBC) and piecewise direct standardization (PDS), SST has the advantages of implementation simplicity, wider applicability and better performance in terms of predictive accuracy.     

Simultaneous determination of total polyphenols and caffeine contents of green tea by near-infrared reflectance spectroscopy

This paper indicates the possibility to use near infrared (NIR) spectroscopy as a rapid method to predict quantitatively the content of caffeine and total polyphenols in green tea. A partial least squares (PLS) algorithm is used to perform the calibration. To decide upon the number of PLS factors included in the PLS model, the model is chosen according to the lowest root mean square error of cross-validation (RMSECV) in training. The correlation coefficient R between the NIR predicted and the reference results for the test set is used as an evaluation parameter for the models. The result showed that the correlation coefficients of the prediction models were R = 0.9688 for the caffeine and R = 0.9299 for total polyphenols. The study demonstrates that NIR spectroscopy technology with multivariate calibration analysis can be successfully applied as a rapid method to determine the valid ingredients of tea to control industrial processes.     

Using chemometric methods and NIR spectrophotometry in the textile industry

A quantitative and qualitative technique for identification of textiles, moisture measurements, textile coatings and process control was developed, using near infra-red spectroscopy (NIR) in combination with chemometric methods. These applications demonstrate by the use of computer assisted data processing the possibility of identifying textile fibers, not only for quality control but also for online textile recycling processes. In this study, seven various textile fibers (cotton, polyester, viscose, silk, wool, polyacrylonitrile, acetate) were used and all combinations of two factor blends were qualitatively identified using NIR spectroscopy and the chemometric PLS2 method for the calibration.

A quantitative analysis of textile moisture can also be performed with this technique. Water content above 50% does not deliver good results for a calibration set to determine the dampness of fibers. But to measure residual moisture from ≈0.05 up to 50%, the NIR technique is particularly good. Furthermore, the examination shows that the NIR method and chemometric methods can be used in quality- and product-control during the industrial production of upholstery fabrics. With this technique it will be possible to identify nylon flocks and to measure the residual moisture of the flocks and fabric, too.