Regression models based on new local strategies for near infrared spectroscopic data

In this work, a comparative study of two novel algorithms to perform sample selection in local regression based on Partial Least Squares Regression (PLS) is presented. These methodologies were applied for Near Infrared Spectroscopy (NIRS) quantification of five major constituents in corn seeds and are compared and contrasted with global PLS calibrations. Validation results show a significant improvement in the prediction quality when local models implemented by the proposed algorithms are applied to large data bases.     

How to construct a multiple regression model for data with missing elements and outlying objects

The aim of this study is to show the usefulness of robust multiple regression techniques implemented in the expectation maximization framework in order to model successfully data containing missing elements and outlying objects. In particular, results from a comparative study of partial least squares and partial robust M-regression models implemented in the expectation maximization algorithm are presented. The performances of the proposed approaches are illustrated on simulated data with and without outliers, containing different percentages of missing elements and on a real data set. The obtained results suggest that the proposed methodology can be used for constructing satisfactory regression models in terms of their trimmed root mean squared errors.     

A method for near-infrared spectral calibration of complex plant samples with wavelet transform and elimination of uninformative variables

An algorithm is proposed for extracting relevant information from near-infrared (NIR) spectra for multivariate calibration of routine components in complex plant samples. The algorithm is a combination of wavelet transform (WT) data compression and a procedure for uninformative variable elimination (UVE). After compression of the NIR spectra by WT, the UVE approach is used to eliminate the irrelevant wavelet coefficients. Finally, a calibration model is built from the retained wavelet coefficients to enable prediction. Because irrelevant information can be removed from the spectra used for multivariate calibration, the model based on the extracted relevant features is better than those obtained with full-spectrum data. Both prediction precision and calculation speed are improved.     

Near-infrared spectroscopy and multivariate calibration for the quantitative determination of certain properties in the petrochemical industry

Near-infrared (NIR) spectroscopy in conjunction with chemometric techniques allows on-line monitoring in real time, which can be of considerable use in industry. If it is to be correctly used in industrial applications, generally some basic considerations need to be taken into account, although this does not always apply. This study discusses some of the considerations that would help evaluate the possibility of applying multivariate calibration in combination with NIR to properties of industrial interest. Examples of these considerations are whether there is a relation between the NIR spectrum and the property of interest, what the calibration constraints are and how a sample-specific error of prediction can be quantified. Various strategies for maintaining a multivariate model after it has been installed are also presented and discussed.     

A Robust Near-Infrared Calibration Model for the Determination of Chlorophyll Concentration in Tree Leaves with a Calibration Transfer Method

A method based on piecewise direct standardization was developed to directly predict leaf chlorophyll concentrations by correction of near-infrared spectra to construct a robust calibration model. Chinar, camphor, and gingko leaves collected from two growth intervals were evaluated. Spectral pretreatment methods and wavelength selection were investigated. The first derivative combined with stability competitive adaptive reweighted sampling before piecewise direct standardization provided the best performance. Under the optimized parameters, the root mean square error of prediction was significantly reduced by using piecewise direct standardization. This study demonstrates that the calibration model may be used to rapidly characterize chlorophyll concentrations across species and growth intervals.     

Determination of oil and water content in olive pomace using near infrared and Raman spectrometry. A comparative study

Near infrared (NIR) reflectance and Raman spectrometry were compared for determination of the oil and water content of olive pomace, a by-product in olive oil production. To enable comparison of the spectral techniques the same sample sets were used for calibration (1.74–3.93% oil, 48.3–67.0% water) and for validation (1.77–3.74% oil, 50.0–64.5% water). Several partial least squares (PLS) regression models were optimized by cross-validation with cancellation groups, including different spectral pretreatments for each technique. Best models were achieved with first-derivative spectra for both oil and water content. Prediction results for an independent validation set were similar for both techniques. The values of root mean square error of prediction (RMSEP) were 0.19 and 0.20–0.21 for oil content and 2.0 and 1.8 for water content, using Raman and NIR, respectively. The possibility of improving these results by combining the information of both techniques was also tested. The best models constructed using the appended spectra resulted in slightly better performance for oil content (RMSEP 0.17) but no improvement for water content.     

Comparison of near-infrared and mid-infrared spectroscopy for the determination of distillation property of kerosene

Near-infrared (NIR) and mid-infrared (MIR) spectroscopy have been compared and evaluated for the determination of the distillation property of kerosene with the use of partial least squares (PLS) regression. Since kerosene is a complex mixture of similar hydrocarbons, both spectroscopic methods will be best evaluated with this complex sample matrix. PLS calibration models for each percent recovery temperature have been developed by using both NIR and MIR spectra without spectral pretreatment. Both methods have shown good correlation with the corresponding reference method, however NIR provided better calibration performance over MIR. To rationalize the improved calibration performance of NIR, spectra of the same kerosene sample were continuously collected and the corresponding spectral reproducibility was evaluated. The greater spectral reproducibility including signal-to-noise ratio of NIR led to the improved calibration performance, even though MIR spectroscopy provided more qualitative spectral information. The reproducibility of measurement, signal-to-noise ratio, and richness of qualitative information should be simultaneously considered for proper selection of a spectroscopic method for quantitative analysis.     

A practical approach for near infrared spectral quantitative analysis of complex samples using partial least squares modeling

The number of latent variables (LVs) or the factor number is a key parameter in PLS modeling to obtain a correct prediction. Although lots of work have been done on this issue, it is still a difficult task to determine a suitable LV number in practical uses. A method named independent factor diagnostics (IFD) is proposed for investigation of the contribution of each LV to the predicted results on the basis of discussion about the determination of LV number in PLS modeling for near infrared (NIR) spectra of complex samples. The NIR spectra of three data sets of complex samples, including a public data set and two tobacco lamina ones, are investigated. It is shown that several high order LVs constitute main contributions to the predicted results, albeit the contribution of the low order LVs should not be neglected in the PLS models. Therefore, in practical uses of PLS for analysis of complex samples, it may be better to use a slightly large LV number for NIR spectral analysis of complex samples. Supported by the National Natural Science Foundation of China (Grant Nos. 20775036 & 20835002)     

Application of near infrared spectroscopy and multivariate data analysis for the evaluation of glue lines of untreated and copper azole treated laminated timber before and after ageing

The necessity for inspection and assessment of glued laminated timber structures in service has raised interest in the evaluation of the glue lines. Glue line spectra were analysed and are discussed in detail with respect to spectral contributions from the adhesive, the hardener, the wood lamella below the adhesive, the curing temperature as well as ageing-related spectral changes. The combination of near infrared (NIR) spectroscopy and principal component analysis (PCA) allowed distinguishing between aged and non-aged samples and different copper azole preservative treatment levels of phenol-resorcinol-formaldehyde (PRF) glue lines. NIR-based partial least squares (PLS) regression modelling was performed for the glue line shear strength and for the curing temperature. These findings show that NIR spectroscopy is a fast and useful technique to evaluate the degradation on the PRF glue lines of untreated and copper azole treated laminated timber.     

基于灰狼算法的近红外光谱变量选择方法研究

基于群体智能的灰狼优化(GWO)算法具有参数少、结构简单、易于实现的优点,但在光谱领域的应用较少。该研究将GWO算法引入近红外光谱的变量筛选中,以玉米数据为例,考察了GWO算法中狼群性能、迭代次数、狼群数量及运算效率,并建立了偏最小二乘(PLS)模型对玉米样品中蛋白质、脂肪、水分以及淀粉含量的测定。结果显示,GWO算法运算效率很高,经过参数调优后建立PLS模型,其蛋白质、脂肪、水分及淀粉的保留变量数分别为19、19、14、34,预测均方根误差(RMSEP)从全波长PLS建模的0.245 8、0.122 4、0.339 8、1.105 8分别下降到0.147 7、0.080 1、0.176 2、0.739 8,分别下降了40%、35%、48%、33%,相关系数也相应地提高。因此,GWO算法不仅优化速度快,选择变量数少,还可以显著提高PLS模型的预测精度,是一种近红外光谱变量选择的有效方法。     

Determination of sugars in depilatory formulations: a green analytical method employing infrared detection and partial least squares regression

A green analytical method was developed for the analysis of sugar-based depilatories. Three independent partial least squares (PLS) regression models were built for the direct determination of glucose, fructose and maltose without any sample pretreatment based on their attenuated total reflectance - Fourier transform infrared (ATR-FTIR) spectra. The models showed adequate prediction capabilities with root-mean-square-errors of prediction ranging from 7.04 to 12.55 mg sugar g⁻¹ sample. As a reference procedure, gradient liquid chromatography with on-line infrared detection, employing background correction based on cubic smoothing splines, was used. The analysis revealed changes in the sugar concentration due to the formulation process as compared to information on the ingredients provided by the manufacturers. Although fructose, glucose and sucrose were declared to be used for the production of depilatories, in the final products only fructose, glucose and maltose were determined. This fact was attributed to pH and temperature conditions employed during the production process as well as to the use of glucose syrup instead of crystalline glucose. The present ATR-FTIR-PLS method enables an accurate, cheap and fast determination without solvent consumption or toxic waste generation and offers therefore a green screening alternative to methods employing chromatographic techniques.     

Using near-infrared process analysis to study gas-solid adsorption process as well as its data treatment based on artificial neural network and partial least squares

This paper demonstrates the application of near-infrared (NIR) process analysis to study gas-solid adsorption process non-invasively: its experimental setup, data treatment, and potentials as a convenient tool to investigate the gas-solid adsorption process. The experimental setup includes a differential adsorption bed (DAB) monitored by a NIR spectrometer via an optical fiber probe, which makes it convenient and reliable to construct adsorption mass-transfer models. A chemometrics strategy based on back propagation-artificial neural network (BP-ANN) and partial least squares (PLS) has been developed to treat NIR spectra collected during the adsorption process because of the obvious nonlinearity in concentration prediction. This nonlinear problem results from the great concentration variation of the adsorbate adsorbed by the adsorbent during the whole adsorption process, the extraordinarily low concentration of the adsorbed adsorbate at the beginning of the process, and probably NIR distinction between the adsorbate on the first adsorption layer at the beginning of the process and that on the other layers afterward. With the strategy, NIR spectra are pretreated with PLS for data compression and noise reduction, and then a BP-ANN is built as the nonlinear calibration model. As compared with linear calibration algorithm, our strategy has the higher predication ability for the whole adsorption process, even with less calibration samples. Finally, as an example the kinetics of aniline-silica gel adsorption process has been studied through the experimental setup and chemometrics strategy.     

Self-modeling curve resolution method applied for the evaluation of dissolution testing data: A case study of meloxicam-mannitol binary systems

This paper introduces some chemometric methods, i.e., self-modeling curve resolution (SMCR), multivariate curve resolution-alternating least squares (MCR-ALS) and parallel factor analysis (PARAFAC and PARAFAC2), which are used to evaluate in vitro dissolution testing data detected by a UV-vis spectrophotometer on meloxicam-mannitol binary systems. These systems were chosen because of their relative simplicity to apply as part of the validation process illustrating the effectiveness of the developed and applied chemometric method. The paper illustrates the failure of PARAFAC methods used before for pharmaceutical data evaluations as well, and we suggest application of the feasible band form given by SMCR as a more general procedure.Steps to improve the dissolution behavior of drugs have become among the most interesting aspects of pharmaceutical technology, and our results show that a larger particle size of meloxicam is advantageous for dissolution. Instead of the use of only one characteristic wavelength, appropriate chemometric methods can furnish more information from dissolution testing data, i.e., the individual dissolution rate profiles and the individual spectra for all the components can be obtained without resorting to any separation techniques such as HPLC.     

Improving the robustness of a partial least squares (PLS) model based on pure component selectivity analysis and range optimization: case study for the analysis of an etching solution containing hydrogen peroxide

Pure component selectivity analysis (PCSA) was successfully utilized to enhance the robustness of a partial least squares (PLS) model by examining the selectivity of a given component to other components. The samples used in this study were composed of NH₄OH, H₂O₂ and H₂O, a popular etchant solution in the electronic industry. Corresponding near-infrared (NIR) spectra (9000-7500 cm⁻¹) were used to build PLS models. The selective determination of H₂O₂ without influences from NH₄OH and H₂O was a key issue since its molecular structure is similar to that of H₂O and NH₄OH also has a hydroxyl functional group. The best spectral ranges for the determination of NH₄OH and H₂O₂ were found with the use of moving window PLS (MW-PLS) and corresponding selectivity was examined by pure component selectivity analysis. The PLS calibration for NH₄OH was free from interferences from the other components due to the presence of its unique NH absorption bands. Since the spectral variation from H₂O₂ was broadly overlapping and much less distinct than that from NH₄OH, the selectivity and prediction performance for the H₂O₂ calibration were sensitively varied depending on the spectral ranges and number of factors used. PCSA, based on the comparison between regression vectors from PLS and the net analyte signal (NAS), was an effective method to prevent over-fitting of the H₂O₂ calibration. A robust H₂O₂ calibration model with minimal interferences from other components was developed. PCSA should be included as a standard method in PLS calibrations where prediction error only is the usual measure of performance.     

Melamine detection by mid- and near-infrared (MIR/NIR) spectroscopy: a quick and sensitive method for dairy products analysis including liquid milk, infant formula, and milk powder

Melamine (2,4,6-triamino-1,3,5-triazine) is a nitrogen-rich chemical implicated in the pet and human food recalls and in the global food safety scares involving milk products. Due to the serious health concerns associated with melamine consumption and the extensive scope of affected products, rapid and sensitive methods to detect melamine's presence are essential. We propose the use of spectroscopy data-produced by near-infrared (near-IR/NIR) and mid-infrared (mid-IR/MIR) spectroscopies, in particular—for melamine detection in complex dairy matrixes. None of the up-to-date reported IR-based methods for melamine detection has unambiguously shown its wide applicability to different dairy products as well as limit of detection (LOD) below 1 ppm on independent sample set. It was found that infrared spectroscopy is an effective tool to detect melamine in dairy products, such as infant formula, milk powder, or liquid milk. ALOD below 1 ppm (0.76 ± 0.11 ppm) can be reached if a correct spectrum preprocessing (pretreatment) technique and a correct multivariate (MDA) algorithm—partial least squares regression (PLS), polynomial PLS (Poly-PLS), artificial neural network (ANN), support vector regression (SVR), or least squares support vector machine (LS-SVM)—are used for spectrum analysis. The relationship between MIR/NIR spectrum of milk products and melamine content is nonlinear. Thus, nonlinear regression methods are needed to correctly predict the triazine-derivative content of milk products. It can be concluded that mid- and near-infrared spectroscopy can be regarded as a quick, sensitive, robust, and low-cost method for liquid milk, infant formula, and milk powder analysis.     

A novel fusion approach based on induced ordered weighted averaging operators for chemometric data analysis

This paper proposes a novel approach for the estimation of spectroscopic data by combining the predictions of an ensemble of estimators using the induced ordered weighted averaging (IOWA) fusion operators. For ensemble generation, we use Gaussian process regression (GPR) and extreme learning machine (ELM) estimators associated with different kernels. To render the model selection issue of ELM as efficiently as in the GPR Bayesian estimation method, we develop an automatic solution based on the powerful differential evolution (DE) algorithm. During the fusion process, the IOWA operator needs two things: (1) an order‐inducing value; and (2) a way to determine its weights. For the order‐inducing value, we propose to use the residual of each estimated output value. Because we cannot compute the true residual, we explore the idea of estimating the residuals themselves by associating to each estimator of the ensemble a second estimator of the same kind called a residual estimator. To learn the weights associated with these nonlinear operators, the proposed method relies on the concept of prioritized aggregation, where we generate the weights directly from the estimated residuals. Experimental results obtained on three real spectroscopic datasets confirm the interesting capabilities of the proposed IOWA fusion method. Copyright © 2013 John Wiley & Sons, Ltd.     

A simple and efficient method for the synthesis of highly substituted imidazoles using 3-aroylquinoxalin-2(1H)-ones

3-Aroylquinoxalin-2(1H)-ones were found to be hetero analogues of α-diketones for the efficient, one-pot, three component synthesis of 2,4,5-trisubstituted imidazoles and imidazo[1,5-a]quinoxalin-4(5H)-ones in boiling methanol. The key advantages of this process are high yields, ready availability and low cost of 3-aroylquinoxalin-2(1H)-ones and easy work-up and separation of the products by non-chromatographic methods. Furthermore, the presence of an ortho-iminoanilide fragment at position 4 of the imidazoles obtained has made it possible to produce 2-(imidazol-4-yl)benzimidazoles in almost quantitative yields.     

Combining chromatography and chemometrics for the characterization and authentication of fats and oils from triacylglycerol compositional data—A review

The characterization and authentication of fats and oils is a subject of great importance for market and health aspects. Identification and quantification of triacylglycerols in fats and oils can be excellent tools for detecting changes in their composition due to the mixtures of these products. Most of the triacylglycerol species present in either fats or oils could be analyzed and identified by chromatographic methods. However, the natural variability of these samples and the possible presence of adulterants require the application of chemometric pattern recognition methods to facilitate the interpretation of the obtained data. In view of the growing interest in this topic, this paper reviews the literature of the application of exploratory and unsupervised/supervised chemometric methods on chromatographic data, using triacylglycerol composition for the characterization and authentication of several foodstuffs such as olive oil, vegetable oils, animal fats, fish oils, milk and dairy products, cocoa and coffee.