High-pass filters for spectral background suppression in airborne passive Fourier transform infrared spectrometry

High-pass (HP) digital filtering and second-derivative (SD) filtering are evaluated as methods of removing background contributions from spectra collected by passive Fourier transform infrared spectrometry. In measurements performed with a downward-looking spectrometer mounted on an aircraft platform, the effects of non-constant background radiance from the ground make it challenging to build automated classifiers for detecting an analyte of interest. Applying HP digital filtering to the spectra to remove background contributions is evaluated as a strategy to help improve classifier performance. This methodology is tested by building classifiers for detecting heated ethanol plumes released from a portable emission stack. The classifiers are trained with data collected on the ground with the spectrometer viewing the plumes against a synthetic backdrop designed to simulate a terrestrial radiance source. The resulting classifiers are tested with data collected by the same spectrometer mounted on an aircraft flying over the emission stack. Support vector machines are employed as a classification algorithm with HP filtered spectra used as input patterns. Butterworth filters are used to implement HP digital filtering, while Savitzky-Golay filters are used to implement SD filtering. Significant improvement in classification performance is achieved by use of the HP filters. Because of variation in backgrounds between the training and prediction data, the best classifier obtained with unfiltered spectra is unable to detect ethanol in 37% of the test cases. HP filtering of spectra with an optimized Butterworth filter (order 8, cutoff frequency 0.060) improves the prediction results, resulting in no missed ethanol detections and false positive rates of less than 0.4%.     

Evaluation of selectivity and robustness of near-infrared glucose measurements based on short-scan Fourier transform infrared interferograms

The selectivity and robustness of near-infrared (near-IR) calibration models based on short-scan Fourier transform (FT) infrared interferogram data are explored. The calibration methodology used in this work employs bandpass digital filters to reduce the frequency content of the interferogram data, followed by the use of partial least-squares (PLS) regression to build calibration models with the filtered interferogram signals. Combination region near-IR interferogram data are employed corresponding to physiological levels of glucose in an aqueous matrix containing variable levels of alanine, sodium ascorbate, sodium lactate, urea, and triacetin. A randomized design procedure is used to minimize correlations between the component concentrations and between the concentration of glucose and water. Because of the severe spectral overlap of the components, this sample matrix provides an excellent test of the ability of the calibration methodology to extract the glucose signature from the interferogram data. The robustness of the analysis is also studied by applying the calibration models to data collected outside of the time span of the data used to compute the models. A calibration model based on 52 samples collected over 4 days and employing two digital filters produces a standard error of calibration (SEC) of 0.36 mM glucose. The corresponding standard errors of prediction (SEP) for data collected on the 5th (18 samples) and 7th (10 samples) day are 0.42 and 0.48 mM, respectively. The interferogram segment used for the analysis contained only 155 points. These results are compatible with those obtained in a conventional analysis of absorbance spectra and serve to validate the viability of the interferogram-based calibration.     

Determination of ethanol in fuel ethanol and beverages by Fourier transform (FT)-near infrared and FT-Raman spectrometries

Fourier transform-near infrared (FT-NIR) and FT-Raman spectrometries have been used to design partial least squares (PLS) calibration models for the determination of the ethanol content of ethanol fuel and alcoholic beverages. In the FT-NIR measurements the spectra were obtained using air as reference, and the spectral region for PLS modeling were selected based on the spectral distribution of the relative standard deviation in concentration. In the FT-Raman measurements hexachloro-1,3-butadiene (HCBD) has been used as an external standard. In the PLS/FT-NIR modeling for ethanol fuel analysis 50 ethanol fuel standards (84.9-100% (w/w)) were used (25 in the calibration, 25 in the validation). In the PLS/FT-Raman modeling 25 standards were used (13 in the calibration, 12 in the validation). The PLS/FT-NIR and FT-Raman models for beverage analysis made use of 24 standards (0-100% (v/v)). Twelve of them contained sugars (1-5% (w/w)), one-half was used in the calibration and the other half in the validation. Different spectral pre-processing were used in the PLS modeling, depending on the type of sample investigated. In the ethanol fuel analysis the FT-NIR pre-processing was a 17 points smoothed first derivative and for beverages no spectral pre-processing was used. The FT-Raman spectra were pre-processed by vector normalization in the ethanol fuel analysis and by a second derivative (17 points smoothing) in the beverage analysis. The PLS models were used in the analysis of real ethanol fuel and beverage samples. A t-test has shown that the FT-NIR model has an accuracy equivalent to that of the reference method (ASTM D4052) in the analysis of ethanol fuel, while in the analysis of beverages, the FT-Raman model presents an accuracy equivalent to the reference method. The limits of detection for NIR and Raman calibration models were 0.05 and 0.2% (w/w), respectively. It has also been shown that both techniques, present better results than gas chromatography (GC) in evaluating the ethanol content of beverages.     

Spectral regions selection to improve prediction ability of PLS models by changeable size moving window partial least squares and searching combination moving window partial least squares

Changeable size moving window partial least squares (CSMWPLS) and searching combination moving window partial least squares (SCMWPLS) are proposed to search for an optimized spectral interval and an optimized combination of spectral regions from informative regions obtained by a previously proposed spectral interval selection method, moving window partial least squares (MWPLSR) [Anal. Chem. 74 (2002) 3555]. The utilization of informative regions aims to construct better PLS models than those based on the whole spectral points. The purpose of CSMWPLS and SCMWPLS is to optimize the informative regions and their combination to further improve the prediction ability of the PLS models. The results of their application to an open-path (OP)/FT-IR spectra data set show that the proposed methods, especially SCMWPLS can find out an optimized combination, with which one can improve, often significantly, the performance of the corresponding PLS model, in terms of low prediction error, root mean square error of prediction (RMSEP) with the reasonable latent variable (LVs) number, comparing with the results obtained using whole spectra or direct combination of informative regions for a compound. Regions consisting of the combinations obtained can easily be explained by the existence of IR absorption bands in those spectral regions.     

叠加多元校正分析

基于多模型(模型融合)建模的思想,开发了两种新的叠加多元校正分析算法:叠加PCR(PLS)多元校正分析和叠加移动窗口PCR(PLS)多元校正分析。与一般的多模型建模方法不同的是其通过赋予光谱数据中的不同部分不同权重叠加子多元校正模型。因此,其可以通过权重调节或选择变量。在消除光谱数据中常见的冗余信息的同时,避免信息遗漏的缺点,并最终提高模型的稳健性,简化了模型。对于这两个新的算法,尽管其具体步骤不同,但仍取得了相似的预测结果。本文通过两套近红外光谱文献数据计算验证了这两个新方法的优越性。     

Infrared Spectroscopy as Alternative to Wet Chemical Analysis to Characterize Eucalyptus globulus Pulps and Predict Their Ethanol Yield for a Simultaneous Saccharification and Fermentation Process

Bioethanol can be obtained from wood by simultaneous enzymatic saccharification and fermentation step (SSF). However, for enzymatic process to be effective, a pretreatment is needed to break the wood structure and to remove lignin to expose the carbohydrates components. Evaluation of these processes requires characterization of the materials generated in the different stages. The traditional analytical methods of wood, pretreated materials (pulps), monosaccharides in the hydrolyzated pulps, and ethanol involve laborious and destructive methodologies. This, together with the high cost of enzymes and the possibility to obtain low ethanol yields from some pulps, makes it suitable to have rapid, nondestructive, less expensive, and quantitative methods to monitoring the processes to obtain ethanol from wood. In this work, infrared spectroscopy (IR) accompanied with multivariate analysis is used to characterize chemically organosolv pretreated Eucalyptus globulus pulps (glucans, lignin, and hemicellulosic sugars), as well as to predict the ethanol yield after a SSF process. Mid (4,000–400 cm^?1) and near-infrared (12,500–4,000 cm^?1) spectra of pulps were used in order to obtain calibration models through of partial least squares regression (PLS). The obtained multivariate models were validated by cross validation and by external validation. Mid-infrared (mid-IR)/NIR PLS models to quantify ethanol concentration were also compared with a mathematical approach to predict ethanol yield estimated from the chemical composition of the pulps determined by wet chemical methods (discrete chemical data). Results show the high ability of the infrared spectra in both regions, mid-IR and NIR, to calibrate and predict the ethanol yield and the chemical components of pulps, with low values of standard calibration and validation errors (root mean square error of calibration, root mean square error of validation (RMSEV), and root mean square error of prediction), high correlation between predicted and measured by the reference methods values (R ² between 0.789 and 0.997), and adequate values of the ratio between the standard deviation of the reference methods and the standard errors of infrared PLS models relative performance determinant (RPD) (greater than 3 for majority of the models). Use of IR for ethanol quantification showed similar and even better results to the obtained with the discrete chemical data, especially in the case of mid-IR models, where ethanol concentration can be estimated with a RMSEV equal to 1.9 g?L^?1. These results could facilitate the analysis of high number of samples required in the evaluation and optimization of the processes.     

Qualitative and quantitative analysis of oxytetracycline by near-infrared spectroscopy

Near-infrared (NIR) spectroscopy, in combination with chemometrics, enable the analysis of raw materials without time-consuming sample preparation methods. The aim of our work was to estimate critical parameters in the analytical specification of oxytetracycline, and consequently the development of a method for quantification and qualification of these parameters by NIR spectroscopy. A Karl Fischer (K.F.) titration to determine the water content, a colorimetric assay method, and Fourier transform-infrared (FT-IR) spectroscopy to identify the oxytetracycline base, were used as reference methods, respectively. Multivariate calibration was performed on NIR spectral data using principal component analysis (PCA), partial least-squares (PLS 1) and principal component regression (PCR) chemometric methods. Multivariate calibration models for NIR spectroscopy have been developed. Using PCA and the Soft Independent Modelling of Class Analogy (SIMCA) approach, we established the cluster model for the determination of sample identity. PLS 1 and PCR regression methods were applied to develop the calibration models for the determination of water content and the assay of the oxytetracycline base. Comparing the PLS and PCR regression methods we found out that the PLS is better established by NIR, especially as the spectroscopic data (NIR spectra) are highly collinear and there are many wavelengths due to non-selective wavelengths. The calibration models for NIR spectroscopy are convenient alternatives to the colorimetric method and to the K.F. method, as well as to FT-IR spectroscopy, in the routine control of incoming material.     

偏最小二乘回归用于近红外光谱分析的稳健策略

偏最小二乘法（PLS）在近红外光谱（NIR）定量分析中占有重要地位,但预测结果往往容易受到样本分组和奇异样本等因素的影响,稳健性不强。多模型PLS (EPLS）方法在模型稳健性上得到提高,然而它无法识别样本中存在的奇异样本。为了同时提高模型的预测准确性和稳健性,本文提出了一种根据取样概率重新取样的多模型PLS方法,称为稳健共识PLS（RE-PLS）方法。该方法通过迭代赋权偏最小二乘法(IRPLS)计算样本回归残差得到每个校正集样本的取样概率,然后根据样本的取样概率来选择训练子集建立多个PLS模型,最后将所有PLS模型的预测结果平均作为最终预测结果。该方法用于两种不同植物样品的近红外光谱建模,并与传统的PLS及EPLS方法进行比较。结果表明该方法可以有效的避免校正集中奇异样本对模型的影响,同时可以提高预测精确度和稳健性。对于含有较多奇异样本的,复杂近红外光谱烟草实际样本,利用简单PLS或者EPLS方法建模预测效果不是很理想,而RE-PLS凭借其独特优势则有望在这种复杂光谱定量分析中得到广泛的应用。     

Infrared emission spectroscopy of liquid samples with multivariate calibration as a model for process analytical applications

Infrared emission spectroscopy and multivariate calibration are used to provide a method for the quantitative analysis of liquid samples. Differing forms of the data including second derivative and interferogram representation are used for prediction of sample composition, thickness and temperature. Comparisons are made with transmission measurements of the same samples. In some situations emission measurements may be the preferred method of analysis.     

Attenuated Total Reflection-Fourier transform infrared analysis of the fermentation process of pineapple

A direct and reagent free procedure has been developed to monitor the fermentation process of pine apple nectar using Attenuated Total Reflectance Fourier-transform mid-infrared spectrometry (FT-IR) and multivariate analysis. A classical 4² design for standards was employed for calibration using the information in the spectral range from 907 to 1531 cm⁻¹ of the first order derivative spectra after mean centering of infrared data. The root mean square error of calibration (RMSEC) of 0.040, 0.021, 0.063 and 0.074% w/w were obtained for glucose, fructose, saccharose and ethanol, respectively, and a mean relative validation error of 2.9, 2.1, 2.6 and 3.6% was achieved for glucose, fructose, saccharose and ethanol. Results obtained by the proposed procedure for the alcohol content at different fermentation levels were statistically comparable with those obtained by a reference spectrometric method. So, FT-IR spectrometry provides a fast alternative to long and tedious classical procedures to ethanol determination and sugar enzymatic analysis.     

Net analyte signal-based simultaneous determination of antazoline and naphazoline using wavelength region selection by experimental design-neural networks

Net analyte signal (NAS)-based multivariate calibration methods were employed for simultaneous determination of anthazoline and naphazoline. The NAS vectors calculated from the absorbance data of the drugs mixture were used as input for classical least squares (CLS), principal component and partial least squares regression PCR and PLS methods. A wavelength selection strategy was used to find the best wavelength region for each drug separately. As a new procedure, we proposed an experimental design-neural network strategy for wavelength region optimization. By use of a full factorial design method, some different wavelength regions were selected by taking into account different spectral parameters including the starting wavelength, the ending wavelength and the wavelength interval. The performance of all the multivariate calibration methods, in all selected wavelength regions for both drugs, was evaluated by calculating a fitness function based on the root mean square error of calibration and validation. A three-layered feed-forward artificial neural network (ANN) model with back-propagation learning algorithm was employed to model the nonlinear relationship between the spectral parameters and fitness of each regression method. From the resulted ANN models, the spectral regions in which lowest fitness could be obtained were chosen. Comparison of the results revealed that the net NAS-PLS resulted in lower prediction error than the other models. The proposed NAS-based calibration method was successfully applied to the simultaneous analyses of anthazoline and naphazoline in a commercial eye drop sample.     

Prediction of physical–chemical properties of crude oils by 1H NMR analysis of neat samples and chemometrics

In this work, we report the feasibility study to predict the properties of neat crude oil samples from 300‐MHz NMR spectral data and partial least squares (PLS) regression models. The study was carried out on 64 crude oil samples obtained from 28 different extraction fields and aims at developing a rapid and reliable method for characterizing the crude oil in a fast and cost‐effective way. The main properties generally employed for evaluating crudes' quality and behavior during refining were measured and used for calibration and testing of the PLS models. Among these, the UOP characterization factor K (K_UOP) used to classify crude oils in terms of composition, density (D), total acidity number (TAN), sulfur content (S), and true boiling point (TBP) distillation yields were investigated. Test set validation with an independent set of data was used to evaluate model performance on the basis of standard error of prediction (SEP) statistics. Model performances are particularly good for K_UOP factor, TAN, and TPB distillation yields, whose standard error of calibration and SEP values match the analytical method precision, while the results obtained for D and S are less accurate but still useful for predictions. Furthermore, a strategy that reduces spectral data preprocessing and sample preparation procedures has been adopted. The models developed with such an ample crude oil set demonstrate that this methodology can be applied with success to modern refining process requirements. Copyright © 2012 John Wiley & Sons, Ltd.     

Simultaneous determination of methanol and ethanol in gasoline using NIR spectroscopy: effect of gasoline composition

Near infrared (NIR) spectroscopy was employed for simultaneous determination of methanol and ethanol contents in gasoline. Spectra were collected in the range from 714 to 2500 nm and were used to construct quantitative models based on partial least squares (PLS) regression. Samples were prepared in the laboratory and the PLS regression models were developed using the spectral range from 1105 to 1682 nm, showing a root mean square error of prediction (RMSEP) of 0.28% (v/v) for ethanol for both PLS-1 and PLS-2 models and of 0.31 and 0.32% (v/v) for methanol for the PLS-1 and PLS-2 models, respectively. A RMSEP of 0.83% (v/v) was obtained for commercial samples. The effect of the gasoline composition was investigated, it being verified that some solvents, such as toluene and o-xylene, interfere in ethanol content prediction, while isooctane, o-xylene, m-xylene and p-xylene interfere in the methanol content prediction. Other spectral ranges were investigated and the range 1449-1611 nm showed the best results.     

Influence of data pre-processing on the quantitative determination of the ash content and lipids in roasted coffee by near infrared spectroscopy

In near-infrared (NIR) measurements, some physical features of the sample can be responsible for effects like light scattering, which lead to systematic variations unrelated to the studied responses. These errors can disturb the robustness and reliability of multivariate calibration models. Several mathematical treatments are usually applied to remove systematic noise in data, being the most common derivation, standard normal variate (SNV) and multiplicative scatter correction (MSC). New mathematical treatments, such as orthogonal signal correction (OSC) and direct orthogonal signal correction (DOSC), have been developed to minimize the variability unrelated to the response in spectral data. In this work, these two new pre-processing methods were applied to a set of roasted coffee NIR spectra. A separate calibration model was developed to quantify the ash content and lipids in roasted coffee samples by PLS regression. The results provided by these correction methods were compared to those obtained with the original data and the data corrected by derivation, SNV and MSC. For both responses, OSC and DOSC treatments gave PLS calibration models with improved prediction abilities (4.9 and 3.3% RMSEP with corrected data versus 7.1 and 8.3% RMSEP with original data, respectively).     

A modification of the successive projections algorithm for spectral variable selection in the presence of unknown interferents

This work proposes a modification to the successive projections algorithm (SPA) aimed at selecting spectral variables for multiple linear regression (MLR) in the presence of unknown interferents not included in the calibration data set. The modified algorithm favours the selection of variables in which the effect of the interferent is less pronounced. The proposed procedure can be regarded as an adaptive modelling technique, because the spectral features of the samples to be analyzed are considered in the variable selection process. The advantages of this new approach are demonstrated in two analytical problems, namely (1) ultraviolet–visible spectrometric determination of tartrazine, allure red and sunset yellow in aqueous solutions under the interference of erythrosine, and (2) near-infrared spectrometric determination of ethanol in gasoline under the interference of toluene. In these case studies, the performance of conventional MLR-SPA models is substantially degraded by the presence of the interferent. This problem is circumvented by applying the proposed Adaptive MLR-SPA approach, which results in prediction errors smaller than those obtained by three other multivariate calibration techniques, namely stepwise regression, full-spectrum partial-least-squares (PLS) and PLS with variables selected by a genetic algorithm. An inspection of the variable selection results reveals that the Adaptive approach successfully avoids spectral regions in which the interference is more intense.     

Chemometrics: the issues of measurement and modelling

In this paper, two spectral data sets have been used to illustrate the importance of maintaining chemical information whilst generating predictive multivariate calibration models. The first data set is based on 26 duplicate UV/VIS spectra for four meal ions (Fe, Ni, Co, Cu) present at varying concentrations in aqueous solution. Spectra were collected across the range 180–800 nm at a resolution of 3.5 nm generating 211 data points for each sample. Calibration was carried out using multiple linear regression (MLR) and a K-matrix approach to demonstrate the advantages the latter method has in describing real spectral features. In addition, the limitation of MLR in accommodating noise and spectral overlap in the data is also illustrated. The second data set based on NIR spectroscopy, was generated using a four-level 2 factor Factorial design strategy and consisted of two additives present at a range of concentrations in an aqueous caustic system, with the spectra being collected over the range 10,000–3000 cm⁻¹. Whilst a conventional partial least squares (PLS) model was applied to the data, it was through the use of variable selection (VS) prior to PLS and the application of weighted ridge regression (WRR) techniques that the need to develop chemometric methodology which intuitively reflected chemical information has been demonstrated. The results will also illustrate how a poorly designed experimental design protocol and missing data can limit the performance of the calibration models generated. The aims of this paper are not to prescribe ideal calibration methodology but rather to demonstrate the relevance of selecting multivariate calibration methodology that relates more to the chem rather than just the metrics in chemometrics.     

Improving the linearity of spectroscopic data subjected to fluctuations in external variables by the extended loading space standardization

In process analytical applications, spectral measurements can be subject to changes in process temperature, pressure, flow turbulence, and compactness as well as other external variations. Generally, the variations of external variables influence spectral data in a non-linear manner which leads to the poor predictive ability of bilinear calibration models on raw spectral data. In this contribution, the influence of external variables on spectral data is generally classified into two different modes, multiplicative influential mode and composition-related influential mode. A new chemometric method, termed Extended Loading Space Standardization (ELSS), has been developed to explicitly model these two kinds of influential modes. ELSS was applied to two sets of spectral data with fluctuations in external variables and its performance evaluated and compared with global partial least squares (PLS) models and Loading Space Standardization (LSS). Results show that ELSS can efficiently model the external non-linear effects in both data sets and greatly improve the accuracy of predictions with the mean square error of prediction for test samples being 2-3 times smaller than those of LSS and global PLS.     

Partial least squares modeling of combined infrared, H NMR and C NMR spectra to predict long residue properties of crude oils

Research has been carried out to determine the potential of partial least squares (PLS) modeling of mid-infrared (IR) spectra of crude oils combined with the corresponding ¹H and ¹³C nuclear magnetic resonance (NMR) data, to predict the long residue (LR) properties of these substances. The study elaborates further on a recently developed and patented method to predict this type of information from only IR spectra. In the present study, PLS modeling was carried out for 7 different LR properties, i.e., yield long-on-crude (YLC), density (D_LR), viscosity (V_LR), sulfur content (S), pour point (PP), asphaltenes (Asph) and carbon residue (CR). Research was based on the spectra of 48 crude oil samples of which 28 were used to build the PLS models and the remaining 20 for validation. For each property, PLS modeling was carried out on single type IR, ¹³C NMR and ¹H NMR spectra and on 3 sets of merged spectra, i.e., IR + ¹H NMR, IR + ¹³C NMR and IR + ¹H NMR + ¹³C NMR. The merged spectra were created by considering the NMR data as a scaled extension of the IR spectral region. In addition, PLS modeling of coupled spectra was performed after a Principal Component Analysis (PCA) of the IR, ¹³C NMR and ¹H NMR calibration sets. For these models, the 10 most relevant PCA scores of each set were concatenated and scaled prior to PLS modeling. The validation results of the individual IR models, expressed as root-mean-square-error-of-prediction (RMSEP) values, turned out to be slightly better than those obtained for the models using single input ¹³C NMR or ¹H NMR data. For the models based on IR spectra combined with NMR data, a significant improvement of the RMSEP values was not observed neither for the models based on merged spectra nor for those based on the PCA scores. It implies, that the commonly accepted complementary character of NMR and IR is, at least for the crude oil and bitumen samples under study, not reflected in the results of PLS modeling. Regarding these results, the absence of sample preparation and the straightforward way of data acquisition, IR spectroscopy is preferred over NMR for the prediction of LR properties of crude oils at site.     

Detecting the quality of glycerol monolaurate: A method for using Fourier transform infrared spectroscopy with wavelet transform and modified uninformative variable elimination

Glycerol monolaurate (GML) products contain many impurities, such as lauric acid and glucerol. The GML content is an important quality indicator for GML production. A hybrid variable selection algorithm, which is a combination of wavelet transform (WT) technology and modified uninformative variable eliminate (MUVE) method, was proposed to extract useful information from Fourier transform infrared (FT-IR) transmission spectroscopy for the determination of GML content. FT-IR spectra data were compressed by WT first; the irrelevant variables in the compressed wavelet coefficients were eliminated by MUVE. In the MUVE process, simulated annealing (SA) algorithm was employed to search the optimal cutoff threshold. After the WT-MUVE process, variables for the calibration model were reduced from 7366 to 163. Finally, the retained variables were employed as inputs of partial least squares (PLS) model to build the calibration model. For the prediction set, the correlation coefficient (r) of 0.9910 and root mean square error of prediction (RMSEP) of 4.8617 were obtained. The prediction result was better than the PLS model with full-spectra data. It was indicated that proposed WT-MUVE method could not only make the prediction more accurate, but also make the calibration model more parsimonious. Furthermore, the reconstructed spectra represented the projection of the selected wavelet coefficients into the original domain, affording the chemical interpretation of the predicted results. It is concluded that the FT-IR transmission spectroscopy technique with the proposed method is promising for the fast detection of GML content.