Transfer of multivariate regression models between high‐resolution NMR instruments: application to authenticity control of sunflower lecithin

In recent years the number of spectroscopic studies utilizing multivariate techniques and involving different laboratories has been dramatically increased. In this paper the protocol for calibration transfer of partial least square regression model between high‐resolution nuclear magnetic resonance (NMR) spectrometers of different frequencies and equipped with different probes was established. As the test system previously published quantitative model to predict the concentration of blended soy species in sunflower lecithin was used. For multivariate modelling piecewise direct standardization (PDS), direct standardization, and hybrid calibration were employed. PDS showed the best performance for estimating lecithin falsification regarding its vegetable origin resulting in a significant decrease in root mean square error of prediction from 5.0 to 7.3% without standardization to 2.9–3.2% for PDS. Acceptable calibration transfer model was obtained by direct standardization, but this standardization approach introduces unfavourable noise to the spectral data. Hybrid calibration is least recommended for high‐resolution NMR data. The sensitivity of instrument transfer methods with respect to the type of spectrometer, the number of samples and the subset selection was also discussed. The study showed the necessity of applying a proper standardization procedure in cases when multivariate model has to be applied to the spectra recorded on a secondary NMR spectrometer even with the same magnetic field strength. Copyright © 2016 John Wiley & Sons, Ltd.     

A variable differential consensus method for improving the quantitative near-infrared spectroscopic analysis

Consensus methods have presented promising tools for improving the reliability of quantitative models in near-infrared(NIR) spectroscopic analysis.A strategy for improving the performance of consensus methods in multivariate calibration of NIR spectra is proposed.In the approach,a subset of non-collinear variables is generated using successive projections algorithm(SPA) for each variable in the reduced spectra by uninformative variables elimination(UVE).Then sub-models are built using the variable subsets and the calibration subsets determined by Monte Carlo(MC) re-sampling,and the sub-model that produces minimal error in cross validation is selected as a member model.With repetition of the MC re-sampling,a series of member models are built and a consensus model is achieved by averaging all the member models.Since member models are built with the best variable subset and the randomly selected calibration subset,both the quality and the diversity of the member models are insured for the consensus model.Two NIR spectral datasets of tobacco lamina are used to investigate the proposed method.The superiority of the method in both accuracy and reliability is demonstrated.     

偏最小二乘回归用于近红外光谱分析的稳健策略

偏最小二乘法（PLS）在近红外光谱（NIR）定量分析中占有重要地位,但预测结果往往容易受到样本分组和奇异样本等因素的影响,稳健性不强。多模型PLS (EPLS）方法在模型稳健性上得到提高,然而它无法识别样本中存在的奇异样本。为了同时提高模型的预测准确性和稳健性,本文提出了一种根据取样概率重新取样的多模型PLS方法,称为稳健共识PLS（RE-PLS）方法。该方法通过迭代赋权偏最小二乘法(IRPLS)计算样本回归残差得到每个校正集样本的取样概率,然后根据样本的取样概率来选择训练子集建立多个PLS模型,最后将所有PLS模型的预测结果平均作为最终预测结果。该方法用于两种不同植物样品的近红外光谱建模,并与传统的PLS及EPLS方法进行比较。结果表明该方法可以有效的避免校正集中奇异样本对模型的影响,同时可以提高预测精确度和稳健性。对于含有较多奇异样本的,复杂近红外光谱烟草实际样本,利用简单PLS或者EPLS方法建模预测效果不是很理想,而RE-PLS凭借其独特优势则有望在这种复杂光谱定量分析中得到广泛的应用。     

Maintaining the predictive abilities of multivariate calibration models by spectral space transformation

In quantitative on-line/in-line monitoring of chemical and bio-chemical processes using spectroscopic instruments, multivariate calibration models are indispensable for the extraction of chemical information from complex spectroscopic measurements. The development of reliable multivariate calibration models is generally time-consuming and costly. Therefore, once a reliable multivariate calibration model is established, it is expected to be used for an extended period. However, any change in the instrumental response or variations in the measurement conditions can render a multivariate calibration model invalid. In this contribution, a new method, spectral space transformation (SST), has been developed to maintain the predictive abilities of multivariate calibration models when the spectrometer or measurement conditions are altered. SST tries to eliminate the spectral differences induced by the changes in instruments or measurement conditions through the transformation between two spectral spaces spanned by the corresponding spectra of a subset of standardization samples measured on two instruments or under two sets of experimental conditions. The performance of the method has been tested on two data sets comprising NIR and MIR spectra. The experimental results show that SST can achieve satisfactory analyte predictions from spectroscopic measurements subject to spectrometer/probe alteration, when only a few standardization samples are used. Compared with the existing popular methods designed for the same purpose, i.e. global PLS, univariate slope and bias correction (SBC) and piecewise direct standardization (PDS), SST has the advantages of implementation simplicity, wider applicability and better performance in terms of predictive accuracy.     

Polynomial multivariate least‐squares regression for modeling nonlinear data applied to in‐depth characterization of chromatographic resolution

Well‐established, linear multivariate calibration methods such as multivariate least‐squares regression (MLR), principal component regression (PCR), or partial least squares (PLS) have two limitations: (i) measured data must be linearly related to the response variables and (ii) predictor variables x_{n = 1, …, N} cannot be coupled to each other. For evaluation of nonlinear data, however, these restrictions need to be overcome and thus polynomial multivariate least‐squares regression (PMLR or “response surfaces”) has been introduced here. PMLR is based on multivariate least squares but incorporates all combinations of predictor variables up to a user‐selected polynomial order (e.g., including u or v = 0). Because of the inclusion of such coupled terms and their powers, PMLR models are better adapted to model nonlinear data and can help to enhance the prediction step's accuracy and precision. PMLR has been based on MLR because it facilitates—unlike PCR or PLS—a physical and chemical interpretation of the predictors. Hence, the origins and the relevance of nonlinear and/or coupled predictors can be investigated. The details of the PMLR algorithm and its implementation are presented along with a method for model optimization utilizing gradients of response surfaces. Newly developed PMLR models up to quintic order have been applied to predict a chromatograph's peak resolution as a function of six‐instrument parameters. It has been demonstrated that PMLR is better capable than MLR and PCR to describe these nonlinear and coupled instrument parameters. In addition, the novel software tool has been utilized for model optimization to determine instrument parameters, which result in the best chromatographic resolution. Copyright © 2011 John Wiley & Sons, Ltd.     

Net analyte signal-based simultaneous determination of antazoline and naphazoline using wavelength region selection by experimental design-neural networks

Net analyte signal (NAS)-based multivariate calibration methods were employed for simultaneous determination of anthazoline and naphazoline. The NAS vectors calculated from the absorbance data of the drugs mixture were used as input for classical least squares (CLS), principal component and partial least squares regression PCR and PLS methods. A wavelength selection strategy was used to find the best wavelength region for each drug separately. As a new procedure, we proposed an experimental design-neural network strategy for wavelength region optimization. By use of a full factorial design method, some different wavelength regions were selected by taking into account different spectral parameters including the starting wavelength, the ending wavelength and the wavelength interval. The performance of all the multivariate calibration methods, in all selected wavelength regions for both drugs, was evaluated by calculating a fitness function based on the root mean square error of calibration and validation. A three-layered feed-forward artificial neural network (ANN) model with back-propagation learning algorithm was employed to model the nonlinear relationship between the spectral parameters and fitness of each regression method. From the resulted ANN models, the spectral regions in which lowest fitness could be obtained were chosen. Comparison of the results revealed that the net NAS-PLS resulted in lower prediction error than the other models. The proposed NAS-based calibration method was successfully applied to the simultaneous analyses of anthazoline and naphazoline in a commercial eye drop sample.     

Construction of stable multivariate calibration models using unsupervised segmented principal component regression

In multivariate spectral calibration by principal component regression (PCR), the principal components (PCs) are calculated from the response data measured at all employed instrument channels; however some channels are redundant and their responses do not possess useful information. Thus, the extracted PCs possess mixed information from both useful and redundant channels. In this work, we propose a segmentation approach based on unsupervised pattern recognition to identify the most informative spectral region and then to construct a stable multivariate calibration model by PCR. In this method, the instrument channels are clustered into different segments via Kohonen self‐organization map. The spectral data of each segment are then subjected to PCA and the derived PCs are used as input variables for an inverse least square (ILS) regression model employing stepwise selection of the informative PCs. The proposed method was evaluated by the analysis of four simulated and six experimental data sets. It was found that our proposed method can model the above data sets with prediction errors lower than conventional partial least squares (PLS) and PCR methods. In addition, the prediction ability of our method was better than the previously reported models for these data sets. Copyright © 2011 John Wiley & Sons, Ltd.     

Multivariate calibration leverages and spectral F‐ratios via the filter factor representation

Diagnostics are fundamental to multivariate calibration (MC). Two common diagnostics are leverages and spectral F‐ratios and these have been formulated for many MC methods such as partial least square (PLS), principal component regression (PCR) and classical least squares (CLS). While these are some of the most common methods of calibration in analytical chemistry, ridge regression is also common place and yet spectral F‐ratios have not been developed for it. Noting that ridge regression is a form of Tikhonov regularization (TR) and using the unifying filter factor representation for MC, this paper develops the filter factor form of leverages and spectral F‐ratios. The approach is applied to a spectral data set to demonstrate computational speed‐up advantages and ease of implementation for the filter factor representation. Copyright © 2010 John Wiley & Sons, Ltd.     

A method for near-infrared spectral calibration of complex plant samples with wavelet transform and elimination of uninformative variables

An algorithm is proposed for extracting relevant information from near-infrared (NIR) spectra for multivariate calibration of routine components in complex plant samples. The algorithm is a combination of wavelet transform (WT) data compression and a procedure for uninformative variable elimination (UVE). After compression of the NIR spectra by WT, the UVE approach is used to eliminate the irrelevant wavelet coefficients. Finally, a calibration model is built from the retained wavelet coefficients to enable prediction. Because irrelevant information can be removed from the spectra used for multivariate calibration, the model based on the extracted relevant features is better than those obtained with full-spectrum data. Both prediction precision and calculation speed are improved.     

Pareto calibration with built-in wavelength selection

In multivariate regression, it is often reported that wavelength selection can improve results. Improvement is often solely based on bias measures such as the root mean square error of calibration (RMSEC) and root mean square error of validation (RMSEV), R² for the calibration and validation, etc. In recent studies, it has been shown that when variance measures are included, Pareto optimal models can be determined. However, variance measures used to date do not provide the ability to choose wavelength subset models relative to full wavelength models when wavelength subset models may be the Pareto models. In this paper, simplex optimization is used with a more complete variance measure to generate Pareto optimal models. The standard basis set is used as well a basis set that includes the range and null space of the calibration spectra. Results show that it is possible to identify Pareto optimal models and if a wavelength subset is best, these are the models found. Regression coefficients for non-essential wavelengths are zero to near zero.     

Simultaneous Anodic Stripping Voltammetric Determination of Pb and Cd,Using a Vibrating Gold Microwire Electrode,Assisted by Chemometric Techniques

Simultaneous anodic stripping voltammetric determination of Pb and Cd is restricted on gold electrodes as a result of the overlapping of these two peaks. This work describes the quantitative determination of a binary mixture system of Pb and Cd, at low concentration levels (up to 15.0 and 10.0 µg L^?1 for Pb and Cd, respectively) by differential pulse anodic stripping voltammetry (DPASV; deposition time of 30 s), using a green electrode (vibrating gold microwire electrode) without purging in a chloride medium (0.5 M NaCl) under moderate acidic conditions (HCl 1.0 mM), assisted by chemometric tools. The application of multivariate curve resolution alternating least squares (MCR‐ALS) for the resolution and quantification of both metals is shown. The optimized MCR‐ALS models showed good prediction ability with concentration prediction errors of 12.4 and 11.4 % for Pb and Cd, respectively. The quantitative results obtained by MCR‐ALS were compared to those obtained with partial least squares (PLS) and classical least squares (CLS) regression methods. For both metals, PLS and MCR‐ALS results are comparable and superior to CLS. For Cd, as a result of the peak shift problem, the application of CLS was unsuitable. MCR‐ALS provides additional advantage compared to PLS since it estimates the pure response of the analytes signal. Finally, the built up multivariate calibration models, based either in MCR‐ALS or PLS regression, allowed to quantify concentrations of Pb and Cd in surface river water samples, with satisfactory results.     

Systematic prediction error correction: a novel strategy for maintaining the predictive abilities of multivariate calibration models

The development of reliable multivariate calibration models for spectroscopic instruments in on-line/in-line monitoring of chemical and bio-chemical processes is generally difficult, time-consuming and costly. Therefore, it is preferable if calibration models can be used for an extended period, without the need to replace them. However, in many process applications, changes in the instrumental response (e.g. owing to a change of spectrometer) or variations in the measurement conditions (e.g. a change in temperature) can cause a multivariate calibration model to become invalid. In this contribution, a new method, systematic prediction error correction (SPEC), has been developed to maintain the predictive abilities of multivariate calibration models when e.g. the spectrometer or measurement conditions are altered. The performance of the method has been tested on two NIR data sets (one with changes in instrumental responses, the other with variations in experimental conditions) and the outcomes compared with those of some popular methods, i.e. global PLS, univariate slope and bias correction (SBC) and piecewise direct standardization (PDS). The results show that SPEC achieves satisfactory analyte predictions with significantly lower RMSEP values than global PLS and SBC for both data sets, even when only a few standardization samples are used. Furthermore, SPEC is simple to implement and requires less information than PDS, which offers advantages for applications with limited data.     

Efficient use of pure component and interferent spectra in multivariate calibration

Partial Least Squares (PLS) is by far the most popular regression method for building multivariate calibration models for spectroscopic data. However, the success of the conventional PLS approach depends on the availability of a ‘representative data set’ as the model needs to be trained for all expected variation at the prediction stage. When the concentration of the known interferents and their correlation with the analyte of interest change in a fashion which is not covered in the calibration set, the predictive performance of inverse calibration approaches such as conventional PLS can deteriorate. This underscores the need for calibration methods that are capable of building multivariate calibration models which can be robustified against the unexpected variation in the concentrations and the correlations of the known interferents in the test set. Several methods incorporating ‘a priori’ information such as pure component spectra of the analyte of interest and/or the known interferents have been proposed to build more robust calibration models. In the present study, four such calibration techniques have been benchmarked on two data sets with respect to their predictive ability and robustness: Net Analyte Preprocessing (NAP), Improved Direct Calibration (IDC), Science Based Calibration (SBC) and Augmented Classical Least Squares (ACLS) Calibration. For both data sets, the alternative calibration techniques were found to give good prediction performance even when the interferent structure in the test set was different from the one in the calibration set. The best results were obtained by the ACLS model incorporating both the pure component spectra of the analyte of interest and the interferents, resulting in a reduction of the RMSEP by a factor 3 compared to conventional PLS for the situation when the test set had a different interferent structure than the one in the calibration set.     

Evaluation of Multivariate Calibration Using a Tikhonov Regularization Approach and the Generalized Pair‐Correlation Method with Nonlinear Data

Abstract

In order to reduce data nonlinearity and overfitting with the multivariate calibration model y=Xb, a modified Tikhonov regularization (TR) algorithm is evaluated for selecting key variables from an X augmented with extra columns that contain the original measured variables (x _ij ) as squared terms (x _ij ²) and other orders. The TR approach simultaneously develops the multivariate calibration model. The new generalized pair‐correlation method (GPCM) is also studied for variable selection followed by partial least squares (PLS) for multivariate calibration. Results from synthetic spectral data are compared when using the modified TR approach, GPCM, and PLS without variable selection. The GPCM usually performs slightly better than the TR approach for tabulated bias and variance measures and in some cases, at a sacrifice to parsimony. The method of PLS without variable selection performs the worst. By using synthetic spectral data sets, how the methods work could be studied. Thus, results from this study will aid investigators of real spectral data sets exhibiting nonlinear behavior.     

Optical coefficient‐based multivariate calibration on near‐infrared spectroscopy

The time and expense of calibration development limit the feasibility of NIR spectroscopy for many industrial applications, with a major portion of the costs being related to creation of a sufficient set of calibration samples. Net analyte signal (NAS) and generalized least squares (GLS) pre‐processing have been proposed in the literature as methods to simplify multivariate calibration by reducing the quantity of calibration samples by orthogonalizing or shrinking interference signals. Synthetic calibration has also been reported as a method to combine interference signals with pure component spectra to generate virtual calibration models, thereby reducing the number of real calibration samples required. The goals of this paper were to (1) compare theoretical and practical differences between NAS and GLS pre‐processing and (2) explore the potential of simplified NIR calibrations, both empirical and synthetic, constructed using optical coefficient‐based signal processing on predicting chemical compositions of pharmaceutical powder mixtures. A reduced calibration dataset including only one pharmaceutical powder mixture composition and pure component spectra was used for both empirical and synthetic calibrations. Absorption and reduced scattering coefficients, obtained from spatially‐resolved spectroscopy, were used herein as interference signals in NAS/GLS pre‐processing for both calibrations. As a result, NAS and GLS were shown to be equivalent in both theoretical and practical senses. After optical coefficient‐based signal processing, simplified calibrations, both empirical and synthetic, were demonstrated to have similar model performance as generic pre‐processing methods such as SNV and derivative, while requiring fewer principal components and achieving a lower prediction error. Copyright © 2010 John Wiley & Sons, Ltd.     

Optimized sample-weighted partial least squares

In ordinary multivariate calibration methods, when the calibration set is determined to build the model describing the relationship between the dependent variables and the predictor variables, each sample in the calibration set makes the same contribution to the model, where the difference of representativeness between the samples is ignored. In this paper, by introducing the concept of weighted sampling into partial least squares (PLS), a new multivariate regression method, optimized sample-weighted PLS (OSWPLS) is proposed. OSWPLS differs from PLS in that it builds a new calibration set, where each sample in the original calibration set is weighted differently to account for its representativeness to improve the prediction ability of the algorithm. A recently suggested global optimization algorithm, particle swarm optimization (PSO) algorithm is used to search for the best sample weights to optimize the calibration of the original training set and the prediction of an independent validation set. The proposed method is applied to two real data sets and compared with the results of PLS, the most significant improvement is obtained for the meat data, where the root mean squared error of prediction (RMSEP) is reduced from 3.03 to 2.35. For the fuel data, OSWPLS can also perform slightly better or no worse than PLS for the prediction of the four analytes. The stability and efficiency of OSWPLS is also studied, the results demonstrate that the proposed method can obtain desirable results within moderate PSO cycles.     

Ensemble preprocessing of near-infrared (NIR) spectra for multivariate calibration

Preprocessing of raw near-infrared (NIR) spectral data is indispensable in multivariate calibration when the measured spectra are subject to significant noises, baselines and other undesirable factors. However, due to the lack of sufficient prior information and an incomplete knowledge of the raw data, NIR spectra preprocessing in multivariate calibration is still trial and error. How to select a proper method depends largely on both the nature of the data and the expertise and experience of the practitioners. This might limit the applications of multivariate calibration in many fields, where researchers are not very familiar with the characteristics of many preprocessing methods unique in chemometrics and have difficulties to select the most suitable methods. Another problem is many preprocessing methods, when used alone, might degrade the data in certain aspects or lose some useful information while improving certain qualities of the data. In order to tackle these problems, this paper proposes a new concept of data preprocessing, ensemble preprocessing method, where partial least squares (PLSs) models built on differently preprocessed data are combined by Monte Carlo cross validation (MCCV) stacked regression. Little or no prior information of the data and expertise are required. Moreover, fusion of complementary information obtained by different preprocessing methods often leads to a more stable and accurate calibration model. The investigation of two real data sets has demonstrated the advantages of the proposed method.     

Nonlinear multivariate curve resolution alternating least squares (NL‐MCR‐ALS)

Bilinearity is the basic principle of multivariate curve resolution. In this paper, we consider a case when this premise is violated. We demonstrate that the alternating least squares approach can still be used to solve the problem. The developed theory is applied to calibration of spectral data that includes the so‐called saturated peaks, which are flattened because of samples with ultrahigh absorbance. We demonstrate that in spite of serious violations of the Lambert–Beer law, the results of prediction are quite satisfactory, and the accuracy is better than in other competing methods. Copyright © 2014 John Wiley & Sons, Ltd.     

Application of Multivariate Calibration Methods for the Simultaneous Multiwavelength Spectrophotometric Determination of Fe(II), Cu(II), Zn(II), and Mn(II) in Mixtures

Abstract

A sensitive method for the simultaneous spectrophotometric determination of Fe(II), Cu(II), Zn(II), and Mn(II) in mixtures has been developed with the aid of multivariate calibration methods, such as classical least squares (CLS), principal component regression (PCR) and partial least squares (PLS). The method is based on the spectral differences of the analytes in their complexation reaction with 4‐(2‐pyridylazo)‐resorcinol (PAR) and the use of full spectra with wavelengths in the range of 300–600 nm. It was found that both the spectral positive and negative bands obtained against the PAR blank, are proportional to the concentration for each metal complex. The obtained linear calibration concentration ranges are 0.025–0.6, 0.05–0.8, 0.025–0.8, and 0.05–0.8 µg ml^?1 for Fe(II), Cu(II), Zn(II), and Mn(II), respectively, and the LODs for the four metal ions were found to be approximately 1–3×10^?2 µg ml^?1. The proposed method was applied to a verification set of synthetic mixtures of these four metal ions, with models built in three different wavelength ranges, i.e., 300–450, 450–600, and 300–600 nm, corresponding to the positive, negative bands and their combinations, respectively. It was shown that the PLS model for the 300–600 nm range gave the best results (RPE_T=6.9% and average recovery ～100%; cf. PCR: RPE_T=9.5% and average Recovery ～110%). This method was also successfully applied for the determination of the four metal ions in pharmaceutical preparations, chicken feedstuff, and water samples.