A comparison of two algorithms for warping of analytical signals

The alignment of analytical signals is an important preprocessing step when further analysis (e.g. PCA) requires the same lengths of all of them. Two techniques for alignment of profiles, namely dynamic time warping (DTW) and correlation optimized warping (COW) were tested and compared. The attention was focused on chromatographic and spectroscopic profiles. Simulated and two sets of real data were studied in this study.     

基于深度学习的太赫兹时域光谱识别研究

太赫兹时域光谱技术,由于其具有物质"指纹谱"特性,是一种可以快速无损地鉴别物质的重要手段,在毒品和爆炸物的无损检测等方面有广阔的应用前景.其中,光谱识别是太赫兹时域光谱技术应用研究的重要方向之一.现有的光谱识别方法多是依靠手工选取特征后进行机器学习分类,或是通过设置吸收峰阈值门限进行判断.由于一些物质在太赫兹波段内并没...     

Solving large-scale mixed-integer programs with fixed charge variables

We consider large-scale mixed-integer programming problems containing fixed charge variables. In practice such problems are frequently approached by using commercial mathematical programming systems. Depending on the formulation, size and structure of the problem this approach may or may not be successful. We describe algorithms for preprocessing and optimization of such problems and discuss the design of an experimental software system based on MPSX/370. Numerical results for solving some large real life problems are also presented.     

Some properties of cliques in 0–1 mixed integer programs

Summary In this note we present new properties of cliques induced constraints straintsX(C _r ⁺ )-X(C _r ^- ) ≤ 1 - |C _r ^- | for λ εS, whereS is the set of cliques that are implied by 0–1 mixed integer programs. These properties allow to further fixing of 0–1 variables, to detect instance's infeasibility and to imply new cliques.     

Comparative study of the alignment method on experimental and simulated chromatographic data

One of the major problems in the signal comparison of chromatographic data is the variability of response caused by instrumental drifts and others instabilities. Measures of quality control and evaluation of conformity are inherently sensitive to shift. It is essential to be able to compare test samples to reference samples in an evolutionary analytical environment by offsetting the inevitable drift. Therefore, prior to any multivariate analysis, the alignment of analytical signals is a compulsory preprocessing step. During recent years, many researchers have taken a greater interest in the study of the alignment. The present paper is an updated review on the alignment algorithms, methods, and improvements used in chromatography. The study is dedicated to one‐dimensional signals. Several of the exposed methods have common theoretical bases and can differ through their optimization methods. The main issue for the operator is to choose the appropriate method according to the type of signals to be processed.     

光谱预处理方法选择研究

复杂样品光谱信号往往会受到杂散光、噪声、基线漂移等因素的干扰,从而影响最终的定性定量分析结果,因此通常需要在建模前对原始光谱进行预处理。目前已有的光谱预处理方法包括很多种,如何寻找合适的预处理方法是很棘手的问题。一种途径是观察光谱信号特点选择预处理方法（visual inspection）,另一种途径是根据建模性能的优劣反过来选择预处理方法（trial-and-error strategy）。前者无需建模,更具有解释性,但是有时会由于选择者主观的因素导致错误的结果;后者无需观察光谱特点,但需要考察大量的预处理方法,对大数据集比较费时。因此需要探讨哪种选择方式更科学与合理。本研究采用9组数据,通过对10种预处理方法的120种排列组合来探讨预处理的必要性及预处理方法的选择。首先,优化偏最小二乘（PLS）的因子数及一阶导数、二阶导数、SG平滑的窗口参数,连续小波变换（CWT）的小波函数和分解尺度。然后把无预处理及一阶导数、二阶导数、CWT、多元散射校正（MSC）、标准正态变量（SNV）、SG平滑、中心化、Pareto尺度化、最大最小归一化、标准化10种预处理方法按照背景校正、散射校正、平滑和尺度化的顺序进行排列组合,得到120种预处理及其组合方法。最后对不同数据及相同数据的不同组分分别进行120种预处理,分析光谱信号特点及预处理后PLS建模的预测均方根误差值（RMSEP）。结果表明,相比观察光谱信号特点,根据光谱与预测组分的建模效果可以更为准确地选择最佳预处理方法。对于多数数据,采用合适的预处理方法可以提高建模效果;对于不同的数据集,因为其数据集信息和复杂性不同,所以其最佳预处理方法也不同;对于相同数据集,即使光谱相同,但不同组分的预处理方法也不相同。因此,不存在普适性的最佳预处理方法,最佳预处理方法除了与光谱有关,还与预测组分有关。通过对已有预处理方法按照预处理目的进行分类再排列组合是选择最佳预处理方法的一种有效途径。     

可见光-近红外光谱的矽卡岩型铁矿反演模型

铁矿资源是我国国民经济基础产业中的重要组成要素,在我国经济发展中有举足轻重的地位。铁矿品位的检定效率对铁矿石开采效率有重大影响。目前,铁矿石品位的化学分析检定法,不仅存在成本较高,化验周期长的问题,更主要的是其无法实现铁矿品位原位测定,相对配矿流程存在滞后效应,无法有效降低矿石开采的损失贫化率;基于可见光-近红外光谱分析的铁矿品位原位测定技术是解决这一问题的有效途径。以225个红岭矽卡岩型铁矿测试样本的可见光-近红外光谱数据及化学分析数据为数据源,首先对原始数据进行了平滑处理,并分析了矽卡岩型铁矿可见光-近红外光谱特征,然后利用倒数对数、多元散射校正（MSC）两种预处理方法对平滑后的光谱数据进行处理,再分别以主成分分析法（PCA）、遗传算法（GA）两种降维算法对预处理前后的光谱数据进行了处理,获取了六种不同预处理组合算法处理后的数据源。其中以PCA降维算法所降维数分别为3维、3维、7维;以GA降维算法所降维数分别为477维、489维、509维。最后基于随机森林（RF）和极限学习机（ELM）建立了矽卡岩型矿石金属铁品位的定量反演模型,以决定系数（R2）、均方根误差（RMSE）和平均相对误差（MRE）三个指标分别对模型的稳定性、精确度、可信度进行评价。结果表明,经MSC处理及PCA降维后的数据基于ELM算法建立的定量反演模型效果最优,其R2可达0.99、RMSE为0.005 7、MRE为2.0%,该方法所建模型对红岭矽卡岩型铁矿品位反演精度有明显的提升。对矽卡岩铁矿品位的实时、快速分析提供了一种有效的方法,对实现矽卡岩型铁矿的高效开采具有重要的现实意义。     

NMR and pattern recognition methods in metabolomics: From data acquisition to biomarker discovery: A review

Metabolomics is the discipline where endogenous and exogenous metabolites are assessed, identified and quantified in different biological samples. Metabolites are crucial components of biological system and highly informative about its functional state, due to their closeness to functional endpoints and to the organism's phenotypes. Nuclear Magnetic Resonance (NMR) spectroscopy, next to Mass Spectrometry (MS), is one of the main metabolomics analytical platforms. The technological developments in the field of NMR spectroscopy have enabled the identification and quantitative measurement of the many metabolites in a single sample of biofluids in a non-targeted and non-destructive manner. Combination of NMR spectra of biofluids and pattern recognition methods has driven forward the application of metabolomics in the field of biomarker discovery. The importance of metabolomics in diagnostics, e.g. in identifying biomarkers or defining pathological status, has been growing exponentially as evidenced by the number of published papers. In this review, we describe the developments in data acquisition and multivariate analysis of NMR-based metabolomics data, with particular emphasis on the metabolomics of Cerebrospinal Fluid (CSF) and biomarker discovery in Multiple Sclerosis (MScl).     

Capillary electrophoresis in association with chemometrics approach for bitterness hop (Humulus lupulus L.) classification

The precursor compounds related to the bitterness of beer are called α‐acids. These compounds are extracted from the hop, which is an important ingredient in the brewing process. These compounds were analyzed by capillary electrophoresis. The electrophoretic method used 160 mmol/L of ammonium carbonate (pH 9) as BGE (background electrolyte), a voltage of +20 kV in a capillary with 50 μm of internal diameter and with a 62.5 cm of total length (54 cm effective). The samples were injected in hydrodynamic mode applying a pressure of 25 mbar for 5 s and the analytes were detected at 230 nm. A hydromethanolic extraction during 3 h was considered as the optimum condition for the sample preparation using MeOH/H₂O 80:20 v/v as the extract solution. From the optimized conditions the electropherograms were evaluated for their use as input for chemometric modeling. Preprocessing investigation for electrophoretic data taking into account the alignment, denoising and baseline correction, and variable selection were considered before the chemometric modeling using principal component analysis (PCA). The electrophoretic data were systematically evaluated to find the optimum conditions to modeling. A PCA analysis for all tests was carried out using different preprocessing methods and, an explained variance higher than 90% was achieved in all of them. The optimized chemometric method worked with aligned and meancentered data. From this approach, a simple and efficient method to classify hop samples with high and low α‐acids content without the use of analytical standards was established from a simple electrophoretic analysis.     

Alignment and clustering strategies for GC×GC–MS features using a cylindrical mapping

Comprehensive two-dimensional gas chromatography coupled to mass spectrometry is a powerful tool to analyze complex samples. For application of the technique in studies like biomarker discovery in which large sets of complex samples have to be analyzed, extensive preprocessing is needed to align the data obtained in several injections (analyses). We developed new alignment and clustering algorithms for this type of data. New in the current procedures is the consistent way in which the phenomenon referred to as wrap-around is treated. The data analysis problems associated with this phenomenon are solved by treating the 2D display as the surface of a three-dimensional cylinder. Based on this transformation we developed a new similarity metric for features as a function of both the cylindrical distance (reflecting similarity in chromatographic behavior) and of the mass spectral correlation (reflecting similarity in chemical structure). The concepts are used in warping and clustering, and include a protection against greedy warping.