小波变换用于近红外光谱数据压缩

近红外光潜数据量大,需要较大数据存储空间和较长的建模时间、本文以成品柴油性质分析为例．将小波变换用于近红外光谱数据压缩处理,详细考察了小波压缩参数,比较了压缩前后潜图差异以及性质分析偏差的变化。研究结果表明．采用Daubechies小波函数(N=2)为母函数．进行3次分解,直接采用其逼近系数(Ca3)作为谱图压缩数据,其重构光谱与原始光谱基本一致直接利用逼近系数进行性质分析,其分析精度与原始光谱数据基本相当,存储空间减少至原来的1／8,且能够明显缩短其建模时间和分析时间。     

离散小波变换-遗传算法-交互检验法用于近红外光谱数据的高倍压缩与变量筛选

用遗传算法(GA)与交互检验(CV)相结合建立了一种用于对近红外光谱(NIR)数据及其离散小波变换(DWT)系数进行变量筛选的方法，并应用于烟草样品中总挥发碱和总氮的同时测定。结果表明：NIR数据经DWT压缩为原始大小的3．3％时基本没有光谱信息的丢失；有效的变量筛选可以极大地减少模型中的变量个数，降低模型的复杂程度，改善预测的准确度。     

自适应小波算法用于近红外光谱的多元校正

实现了一种构建自适应小波滤波器的方法,并将其用于近红外光谱数据的多元校正。该方法根据一定的目标函数,针对信号的特性自适应地构造小波滤波器。用该法构建的滤波器对烟草样品的近红外光谱进行压缩,并将压缩后的数据采用偏最小二乘法建模,实现了烟草样品常规组分的定量分析。     

基于小波变换动态时间规整的近红外光谱模型传递方法

为解决因测量环境及仪器差异而导致的近红外光谱模型通用性较差的不足,提出一种基于小波变换动态时间规整算法的模型传递方法(Wavelet transform combined with dynamic time warping,WDTW),从而实现不同仪器之间模型的共享。首先,该方法将光谱进行小波变换预处理,然后利用动态时间规整算法(Dynamic time warping,DTW)找到近红外光谱波长点之间最优的对应关系并建立回归方程。使用近红外药品光谱数据集和汽油数据集建立传递模型,验证了基于小波变换动态时间规整模型传递方法的有效性。汽油光谱数据集C7、C8、C9和C10成分的预测标准偏差(SEP)分别为0.414 4、0.801 1、1.090 4和1.290 8;药品光谱数据集活性、硬度和重量的SEP分别为2.585 6、0.434 5和2.270 3,均小于传统方法。上述实验结果表明,所建立的模型传递方法能有效消除源机光谱和目标机光谱之间的差异,提高模型的稳定性和准确性,实现模型传递的效果。     

近红外漫反射光谱的小波变换滤波

利用小波变换对５２个烟草样品的近红外漫反射光谱进行滤波处理，并用ＰＬＳ法来计算烟草样品的总氮含量，结果表明小波变换滤波后，预测集的相对标准偏差由原来的９．２％降为７．４％，此结果也优于傅里叶变换和五点三次平滑。     

小波变换用于近红外光谱性质分析

以汽油研究法辛烷值分析为例,研究了小波变换在近红外光谱分析中的应用。对近红外光谱的小波特性、小波变换参数以及变量提取方法进行了详细研究。研究结果表明：光谱噪音、有用信息和背景分别分布在小波高、中和低频区域;母小波函数对性质分析结果影响很大;小波变换可以同时扣除光谱背景、去除噪音和压缩变量,具有运算速度快、分析精度高以及无需去噪后处理等优点,在近红外光谱分析中具有很好的应用前景。     

基于近红外光谱技术的内燃机油鉴别研究

针对常规近红外光谱技术测试内燃机油时光谱信号响应低,对大分子基团分辨率不高,以及光谱信息与其结构组成之间存在非线性关系等难点,提出了一种基于电压为外扰方式的内燃机油二维近红外光谱测试技术,介绍了近红外光谱具有分形的特征.运用小波变换将近红外光谱分解至不同分辨尺度,然后计算各尺度分量的分形维数(盒维数),用近红外光谱的小波基分形参量替代近红外光谱的采样值.计算结果表明,在不同小波基和不同分解尺度下,内燃机油近红外光谱具有不同的盒维数,得到了近红外光谱在分形意义下的特征信息.以美孚、埃索和壳牌3种内燃机油品种鉴别分类问题为实例,比较研究了近红外光谱采样值与小波基分形参量,K近邻法的交互验证计算结果表明,小波基分形参量的分类效果优于近红外光谱采样值.采用近红外光谱技术测试内燃机油的结构组成信息是可行的.     

红外光谱数据的小波压缩和重建

介绍了小波变换及多分辨分析理论，并利用Ｄａｕｂｅｃｈｉｅｓ的正交紧支集小波基和Ｍａｌｌａｔ算法实现了对红外光谱数据的压缩和重建。计算表明，即使对原始数据压缩５倍，仍能很好地重建原有图谱，重建光谱数据与原始光谱数据之间的均方差为０．２６０。这为光谱数据的存储、检索和处理带来了方便。     

小波变换-可见-近红外光谱技术用于鉴别品牌料酒的研究

模式识别技术广泛应用于食品种类、品牌和原产地的分类鉴别.本文测定了三个品牌114个料酒样品的可见-近红外光谱,利用小波变换技术对光谱信号进行了去噪和压缩处理,并采用Fisher权重法计算了16个小波细节系数的Fisher权重.以16个小波细节系数为特征变量采用向量相似度法对三种不同品牌料酒进行了相似度分析,主成分分析法...     

基于聚类分析的局部建模方法在茶叶近红外光谱分析中的应用

为提高茶叶中咖啡碱、氨基酸近红外光谱分析模型的预测精度,采用基于聚类分析的局部建模方法。先提取茶叶样品光谱数据的特征因子,使用聚类分析对样品进行硬划分,经样品间距离和类间距离判别,确定单个模型定标样品个数。完成特征谱带的分析并进行波段选择后,随机抽取15个样品,偏最小二乘法局部建模结果显示:咖啡碱、氨基酸的预测平均相对偏差分别由聚类前的5.80%和6.14%下降为聚类后的2.75%和2.44%,模型预测精度显著提高。     

近红外发光稀土配合物及杂化材料研究进展

稀土因其特殊的物理和化学性质,在信息技术、能源技术、生物技术等高科技领域及国防建设等方面都起着非常重要的作用,中国作为稀土大国,十分重视对稀土材料的研究和开发。稀土离子近红外发光(750～1700 nm)在激光和光纤通讯、医学诊断、免疫分析等热门领域的潜在应用,受到了科研人员的极大关注。稀土离子本身发光极弱,通过分子内传能有机配体可以敏化稀土离子发光,但稀土配合物常受外界干扰,其稳定性较差,若将其与凝胶、介孔材料、离子液体等无机基质复合,得到具有良好光、热稳定性和化学稳定性的有机/无机杂化材料。总结了近些年来近红外发光稀土配合物及近红外发光稀土杂化材料的研究进展,并对其发展前景进行了展望。     

Insect Protein Content Analysis in Handcrafted Fitness Bars by NIR Spectroscopy. Gaussian Process Regression and Data Fusion for Performance Enhancement of Miniaturized Cost-Effective Consumer-Grade Sensors

Future food supply will become increasingly dependent on edible material extracted from insects. The growing popularity of artisanal food products enhanced by insect proteins creates particular needs for establishing effective methods for quality control. This study focuses on developing rapid and efficient on-site quantitative analysis of protein content in handcrafted insect bars by miniaturized near-infrared (NIR) spectrometers. Benchtop (Büchi NIRFlex N-500) and three miniaturized (MicroNIR 1700 ES, Tellspec Enterprise Sensor and SCiO Sensor) in hyphenation to partial least squares regression (PLSR) and Gaussian process regression (GPR) calibration methods and data fusion concept were evaluated via test-set validation in performance of protein content analysis. These NIR spectrometers markedly differ by technical principles, operational characteristics and cost-effectiveness. In the non-destructive analysis of intact bars, the root mean square error of cross prediction (RMSEP) values were 0.611% (benchtop) and 0.545–0.659% (miniaturized) with PLSR, and 0.506% (benchtop) and 0.482–0.580% (miniaturized) with GPR calibration, while the analyzed total protein content was 19.3–23.0%. For milled samples, with PLSR the RMSEP values improved to 0.210% for benchtop spectrometer but remained in the inferior range of 0.525–0.571% for the miniaturized ones. GPR calibration improved the predictive performance of the miniaturized spectrometers, with RMSEP values of 0.230% (MicroNIR 1700 ES), 0.326% (Tellspec) and 0.338% (SCiO). Furthermore, Tellspec and SCiO sensors are consumer-oriented devices, and their combined use for enhanced performance remains a viable economical choice. With GPR calibration and test-set validation performed for fused (Tellspec + SCiO) data, the RMSEP values were improved to 0.517% (in the analysis of intact samples) and 0.295% (for milled samples).     

Quantitative Analysis of Berberine in Processed Coptis by Near-Infrared Diffuse Reflectance Spectroscopy

The near-infrared（NIR） diffuse reflectance spectroscopy was used to study the content of Berberine in the processed Coptis. The allocated proportions of Coptis to ginger, yellow liquor or Evodia rutaecarpa changed according to the results of orthogonal design as well as the temperature. For as withdrawing the full and effective information from the spectral data as possible, the spectral data was preprocessed through first derivative and multiplicative scatter correetion（MSC） according to the optimization results of different preprocessing methods. Firstly, the model was established by partial least squares（PLS）; the coefficient of determination（R2） of the prediction was 0.839, the root mean squared error of prediction（RMSEP） was 0.1422, and the mean relative error（RME） was 0.0276. Secondly, for reducing the dimension and removing noise, the spectral variables were highly effectively compressed via the wavelet transformation（WT） technology and the Haar wavelet was selected to decompose the spectral signals. After the wavelet coefficients from WT were input into the artificial neural network（ANN） instead of the spectra signal, the quantitative analysis model of Berberine in processed Coptis was established. The R^2 of the model was 0.9153, the RMSEP was 0.0444, and the RME was 0.0091. The values of appraisal index, namely R^2, RMSECV, and RME, indicate that the generalization ability and prediction precision of ANN are superior to those of PLS. The overall results show that NIR spectroscopy combined with ANN can be efficiently utilized for the rapid and accurate analysis of routine chemical compositions in Coptis. Accordingly, the result can provide technical support for the further analysis of Berberine and other components in processed Coptis. Simultaneously, the research can also offer the foundation of quantitative analysis of other NIR application.     

基于局部最小二乘支持向量机的光谱定量分析

提出了一种基于局部最小二乘支持向量机(LSSVM)的回归方法,以克服待测参数和光谱数据间的非线性。本方法首先通过欧式距离选取局部训练样本子集,然后利用该子集建立LSSVM校正模型。由于每个测试样本建模时要选取不同的训练样本,因此提出相对距离的概念用来改进高斯核函数,使LSSVM的参数对于不同的训练样本具有自调整功能。针对一批汽油样本的实验结果表明,本方法的预测精度优于常见的局部线性建模方法和全局建模方法。     

小波变换-偏最小二乘算法及其在复方甲硝唑注射液分析中的应用

提出了结合小波变换的偏最小二乘法（ＷＰＬＳ）,即先对光谱信号进行小波变换,去除噪声,再用偏最小二乘法对多组分同时测定。将该法用于模拟体系及复方甲硝唑注射液体系,结果表明,该法优于偏最小二乘法。     

Determination of API Gravity and Total and Basic Nitrogen Content by Mid- and Near-Infrared Spectroscopy in Crude Oil with Multivariate Regression and Variable Selection Tools

Abstract

American Petroleum Institute (API) gravity is an important parameter in the crude oil industry and the nitrogen compounds are related to the toxic effects of the oil in refineries and the environment. In this paper, 194 crude oil samples with API gravities ranging from 11.4 to 57.5 were used for the purpose of estimating the physicochemical properties: API gravity, total nitrogen content (TNC) and basic nitrogen content (BNC). Initially, infrared spectra in the mid and near regions (MIR and NIR) were collected, then full-spectral partial least squares (PLS) and the orthogonal projections to latent structures (OPLS) chemometric models were developed and validated, as well as models using interval PLS (iPLS), synergy interval PLS (siPLS) and competitive adaptive reweighted sampling PLS (CARSPLS) as variable selection tools. For API gravity and TNC, the best calibration technique is the NIR CARSPLS with a root mean square error of prediction (RMSEP) values of 0.9 and 0.0275?wt%, respectively. For BNC, the best technique is MIR siPLS with a prediction error of 0.0134?wt%. The results were validated based on the evaluation of the figures of merit, a statistical evaluation of the accuracy, characterization of the systematic error and measurement for errors in the residues. The results were satisfactory considering the high variability of the data and the diversity of the samples, demonstrating suitable applicability for practical analysis.     

Near-infrared spectroscopy and multivariate calibration for the quantitative determination of certain properties in the petrochemical industry

Near-infrared (NIR) spectroscopy in conjunction with chemometric techniques allows on-line monitoring in real time, which can be of considerable use in industry. If it is to be correctly used in industrial applications, generally some basic considerations need to be taken into account, although this does not always apply. This study discusses some of the considerations that would help evaluate the possibility of applying multivariate calibration in combination with NIR to properties of industrial interest. Examples of these considerations are whether there is a relation between the NIR spectrum and the property of interest, what the calibration constraints are and how a sample-specific error of prediction can be quantified. Various strategies for maintaining a multivariate model after it has been installed are also presented and discussed.     

Using Sub-Band Reconstruction in Wavelet Space and Fourier Transform to Extract Local Features from Analytical Signals Exactly and Straightforwardly

To cope with the problem of frequency aliasing in Mallat algorithm, which makes traditional discrete wavelet transform (DWT) inappropriate for feature extraction in some cases, an improved algorithm composed of sub-band reconstruction and Fourier transform is suggested through which the original signal could be split into a series of sub-bands of different frequencies with little distortion both in time and frequency domains. This strategy is developed to extract local features from analytical signals accurately as well as straightforwardly. Some NIR spectra have been selected as examples to demonstrate the availability and application of the proposed method.     

Determination of Parameter Uncertainty for Quantitative Analysis of Shaddock Peel Pectin using Linear and Nonlinear Near-infrared Spectroscopic Models

Fourier transform near-infrared spectrometry has been used in combination with multivariate chemometric methods for wide applications in agriculture and food analysis. In this paper, we used linear partial least square and nonlinear least square support vector machine regression methods to establish calibration models for Fourier transform near-infrared spectrometric determination of pectin in shaddock peel samples. In particular, the tunable kernel parameters of the linear and nonlinear models were set changing in a moderate range and were optimally selected in conjunction with a Savitzky–Golay smoother. The smoothing parameters and the linear/nonlinear modeling parameters were combined for simultaneous optimization. To investigate the robustness of calibration models, parameter uncertainty were estimated in a direct way for the optimal linear and nonlinear models. Our results show that the nonlinear least square support vector machine method gives more accurate predictive results and is substantially more robust compared to the spectral noise when compared with the linear partial least square regression. Furthermore, the optimized least square support vector machine model was evaluated by the randomly selected test samples and the model test effect was much satisfactory. We anticipate that these linear and nonlinear methods and the methodology of determination of model parameter uncertainty will be applied to other analytes in the fields of near-infrared or Fourier transform near-infrared spectroscopy.