Multiscale Entropy Analysis of Short Signals: The Robustness of Fuzzy Entropy-Based Variants Compared to Full-Length Long Signals

Multiscale entropy (MSE) analysis is a fundamental approach to access the complexity of a time series by estimating its information creation over a range of temporal scales. However, MSE may not be accurate or valid for short time series. This is why previous studies applied different kinds of algorithm derivations to short-term time series. However, no study has systematically analyzed and compared their reliabilities. This study compares the MSE algorithm variations adapted to short time series on both human and rat heart rate variability (HRV) time series using long-term MSE as reference. The most used variations of MSE are studied: composite MSE (CMSE), refined composite MSE (RCMSE), modified MSE (MMSE), and their fuzzy versions. We also analyze the errors in MSE estimations for a range of incorporated fuzzy exponents. The results show that fuzzy MSE versions—as a function of time series length—present minimal errors compared to the non-fuzzy algorithms. The traditional multiscale entropy algorithm with fuzzy counting (MFE) has similar accuracy to alternative algorithms with better computing performance. For the best accuracy, the findings suggest different fuzzy exponents according to the time series length.     

A New Method Based on Time-Varying Filtering Intrinsic Time-Scale Decomposition and General Refined Composite Multiscale Sample Entropy for Rolling-Bearing Feature Extraction

The early fault diagnosis of rolling bearings has always been a difficult problem due to the interference of strong noise. This paper proposes a new method of early fault diagnosis for rolling bearings with entropy participation. First, a new signal decomposition method is proposed in this paper: intrinsic time-scale decomposition based on time-varying filtering. It is introduced into the framework of complete ensemble intrinsic time-scale decomposition with adaptive noise (CEITDAN). Compared with traditional intrinsic time-scale decomposition, intrinsic time-scale decomposition based on time-varying filtering can improve frequency-separation performance. It has strong robustness in the presence of noise interference. However, decomposition parameters (the bandwidth threshold and B-spline order) have significant impacts on the decomposition results of this method, and they need to be artificially set. Aiming to address this problem, this paper proposes rolling-bearing fault diagnosis optimization based on an improved coyote optimization algorithm (COA). First, the minimal generalized refined composite multiscale sample entropy parameter was used as the objective function. Through the improved COA algorithm, optimal intrinsic time-scale decomposition parameters based on time-varying filtering that match the input signal are obtained. By analyzing generalized refined composite multiscale sample entropy (GRCMSE), whether the mode component is dominated by the fault signal is determined. The signal is reconstructed and decomposed again. Finally, the mode component with the highest energy in the central frequency band is selected for envelope spectrum variation for fault diagnosis. Lastly, simulated and experimental signals were used to verify the effectiveness of the proposed method.     

Multiscale Weighted Permutation Entropy Analysis of Schizophrenia Magnetoencephalograms

Schizophrenia is a neuropsychiatric disease that affects the nonlinear dynamics of brain activity. The primary objective of this study was to explore the complexity of magnetoencephalograms (MEG) in patients with schizophrenia. We combined a multiscale method and weighted permutation entropy to characterize MEG signals from 19 schizophrenia patients and 16 healthy controls. When the scale was larger than 42, the MEG signals of schizophrenia patients were significantly more complex than those of healthy controls (p<0.004). The difference in complexity between patients with schizophrenia and the controls was strongest in the frontal and occipital areas (p<0.001), and there was almost no difference in the central area. In addition, the results showed that the dynamic range of MEG complexity is wider in healthy individuals than in people with schizophrenia. Overall, the multiscale weighted permutation entropy method reliably quantified the complexity of MEG from schizophrenia patients, contributing to the development of potential magnetoencephalographic biomarkers for schizophrenia.     

Refined Composite Multi-Scale Reverse Weighted Permutation Entropy and Its Applications in Ship-Radiated Noise

Ship-radiated noise is one of the important signal types under the complex ocean background, which can well reflect physical properties of ships. As one of the valid measures to characterize the complexity of ship-radiated noise, permutation entropy (PE) has the advantages of high efficiency and simple calculation. However, PE has the problems of missing amplitude information and single scale. To address the two drawbacks, refined composite multi-scale reverse weighted PE (RCMRWPE), as a novel measurement technology of describing the signal complexity, is put forward based on refined composite multi-scale processing (RCMP) and reverse weighted PE (RWPE). RCMP is an improved method of coarse-graining, which not only solves the problem of single scale, but also improves the stability of traditional coarse-graining; RWPE has been proposed more recently, and has better inter-class separability and robustness performance to noise than PE, weighted PE (WPE), and reverse PE (RPE). Additionally, a feature extraction scheme of ship-radiated noise is proposed based on RCMRWPE, furthermore, RCMRWPE is combined with discriminant analysis classifier (DAC) to form a new classification method. After that, a large number of comparative experiments of feature extraction schemes and classification methods with two artificial random signals and six ship-radiated noise are carried out, which show that the proposed feature extraction scheme has better performance in distinguishing ability and stability than the other three similar feature extraction schemes based on multi-scale PE (MPE), multi-scale WPE (MWPE), and multi-scale RPE (MRPE), and the proposed classification method also has the highest recognition rate.     

Parameter Analysis of Multiscale Two-Dimensional Fuzzy and Dispersion Entropy Measures Using Machine Learning Classification

Two-dimensional fuzzy entropy, dispersion entropy, and their multiscale extensions (MFuzzyEn2D and MDispEn2D, respectively) have shown promising results for image classifications. However, these results rely on the selection of key parameters that may largely influence the entropy values obtained. Yet, the optimal choice for these parameters has not been studied thoroughly. We propose a study on the impact of these parameters in image classification. For this purpose, the entropy-based algorithms are applied to a variety of images from different datasets, each containing multiple image classes. Several parameter combinations are used to obtain the entropy values. These entropy values are then applied to a range of machine learning classifiers and the algorithm parameters are analyzed based on the classification results. By using specific parameters, we show that both MFuzzyEn2D and MDispEn2D approach state-of-the-art in terms of image classification for multiple image types. They lead to an average maximum accuracy of more than 95% for all the datasets tested. Moreover, MFuzzyEn2D results in a better classification performance than that extracted by MDispEn2D as a majority. Furthermore, the choice of classifier does not have a significant impact on the classification of the extracted features by both entropy algorithms. The results open new perspectives for these entropy-based measures in textural analysis.     

A Novel Fault Diagnosis Method for Rolling Bearing Based on Hierarchical Refined Composite Multiscale Fluctuation-Based Dispersion Entropy and PSO-ELM

This paper proposes a novel fault diagnosis method for rolling bearing based on hierarchical refined composite multiscale fluctuation-based dispersion entropy (HRCMFDE) and particle swarm optimization-based extreme learning machine (PSO-ELM). First, HRCMFDE is used to extract fault features in the vibration signal at different time scales. By introducing the hierarchical theory algorithm into the vibration signal decomposition process, the problem of missing high-frequency signals in the coarse-grained process is solved. Fluctuation-based dispersion entropy (FDE) has the characteristics of insensitivity to noise interference and high computational efficiency based on the consideration of nonlinear time series fluctuations, which makes the extracted feature vectors more effective in describing the fault information embedded in each frequency band of the vibration signal. Then, PSO is used to optimize the input weights and hidden layer neuron thresholds of the ELM model to improve the fault identification capability of the ELM classifier. Finally, the performance of the proposed rolling bearing fault diagnosis method is verified and analyzed by using the CWRU dataset and MFPT dataset as experimental cases, respectively. The results show that the proposed method has high identification accuracy for the fault diagnosis of rolling bearings with varying loads and has a good load migration effect.     

Double Feature Extraction Method of Ship-Radiated Noise Signal Based on Slope Entropy and Permutation Entropy

In order to accurately identify various types of ships and develop coastal defenses, a single feature extraction method based on slope entropy (SlEn) and a double feature extraction method based on SlEn combined with permutation entropy (SlEn&PE) are proposed. Firstly, SlEn is used for the feature extraction of ship-radiated noise signal (SNS) compared with permutation entropy (PE), dispersion entropy (DE), fluctuation dispersion entropy (FDE), and reverse dispersion entropy (RDE), so that the effectiveness of SlEn is verified, and SlEn has the highest recognition rate calculated by the k-Nearest Neighbor (KNN) algorithm. Secondly, SlEn is combined with PE, DE, FDE, and RDE, respectively, to extract the feature of SNS for a higher recognition rate, and SlEn&PE has the highest recognition rate after the calculation of the KNN algorithm. Lastly, the recognition rates of SlEn and SlEn&PE are compared, and the recognition rates of SlEn&PE are higher than SlEn by 4.22%. Therefore, the double feature extraction method proposed in this paper is more effective in the application of ship type recognition.     

Optimized Ship-Radiated Noise Feature Extraction Approaches Based on CEEMDAN and Slope Entropy

Slope entropy (Slopen) has been demonstrated to be an excellent approach to extracting ship-radiated noise signals (S-NSs) features by analyzing the complexity of the signals; however, its recognition ability is limited because it extracts the features of undecomposed S-NSs. To solve this problem, in this study, we combined complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) to explore the differences of Slopen between the intrinsic mode components (IMFs) of the S-NSs and proposed a single-IMF optimized feature extraction approach. Aiming to further enhance its performance, the optimized combination of dual-IMFs was selected, and a dual-IMF optimized feature extraction approach was also proposed. We conducted three experiments to demonstrate the effectiveness of CEEMDAN, Slopen, and the proposed approaches. The experimental and comparative results revealed both of the proposed single- and dual-IMF optimized feature extraction approaches based on Slopen and CEEMDAN to be more effective than the original ship signal-based and IMF-based feature extraction approaches.     

Intelligent Fault Diagnosis of Rolling-Element Bearings Using a Self-Adaptive Hierarchical Multiscale Fuzzy Entropy

The fuzzy-entropy-based complexity metric approach has achieved fruitful results in bearing fault diagnosis. However, traditional hierarchical fuzzy entropy (HFE) and multiscale fuzzy entropy (MFE) only excavate bearing fault information on different levels or scales, but do not consider bearing fault information on both multiple layers and multiple scales at the same time, thus easily resulting in incomplete fault information extraction and low-rise identification accuracy. Besides, the key parameters of most existing entropy-based complexity metric methods are selected based on specialist experience, which indicates that they lack self-adaptation. To address these problems, this paper proposes a new intelligent bearing fault diagnosis method based on self-adaptive hierarchical multiscale fuzzy entropy. On the one hand, by integrating the merits of HFE and MFE, a novel complexity metric method, named hierarchical multiscale fuzzy entropy (HMFE), is presented to extract a multidimensional feature matrix of the original bearing vibration signal, where the important parameters of HMFE are automatically determined by using the bird swarm algorithm (BSA). On the other hand, a nonlinear feature matrix classifier with strong robustness, known as support matrix machine (SMM), is introduced for learning the discriminant fault information directly from the extracted multidimensional feature matrix and automatically identifying different bearing health conditions. Two experimental results on bearing fault diagnosis show that the proposed method can obtain average identification accuracies of 99.92% and 99.83%, respectively, which are higher those of several representative entropies reported by this paper. Moreover, in the two experiments, the standard deviations of identification accuracy of the proposed method were, respectively, 0.1687 and 0.2705, which are also greater than those of the comparison methods mentioned in this paper. The effectiveness and superiority of the proposed method are verified by the experimental results.     

Fault Diagnosis of Power Transformer Based on Time-Shift Multiscale Bubble Entropy and Stochastic Configuration Network

In order to accurately diagnose the fault type of power transformer, this paper proposes a transformer fault diagnosis method based on the combination of time-shift multiscale bubble entropy (TSMBE) and stochastic configuration network (SCN). Firstly, bubble entropy is introduced to overcome the shortcomings of traditional entropy models that rely too heavily on hyperparameters. Secondly, on the basis of bubble entropy, a tool for measuring signal complexity, TSMBE, is proposed. Then, the TSMBE of the transformer vibration signal is extracted as a fault feature. Finally, the fault feature is inputted into the stochastic configuration network model to achieve an accurate identification of different transformer state signals. The proposed method was applied to real power transformer fault cases, and the research results showed that TSMBE-SCN achieved 99.01%, 99.1%, 99.11%, 99.11%, 99.14% and 99.02% of the diagnostic rates under different folding numbers, respectively, compared with conventional diagnostic models MBE-SCN, TSMSE-SCN, MSE-SCN, TSMDE-SCN and MDE-SCN. This comparison shows that TSMBE-SCN has a strong competitive advantage, which verifies that the proposed method has a good diagnostic effect. This study provides a new method for power transformer fault diagnosis, which has good reference value.     

Information Theory for Biological Sequence Classification: A Novel Feature Extraction Technique Based on Tsallis Entropy

In recent years, there has been an exponential growth in sequencing projects due to accelerated technological advances, leading to a significant increase in the amount of data and resulting in new challenges for biological sequence analysis. Consequently, the use of techniques capable of analyzing large amounts of data has been explored, such as machine learning (ML) algorithms. ML algorithms are being used to analyze and classify biological sequences, despite the intrinsic difficulty in extracting and finding representative biological sequence methods suitable for them. Thereby, extracting numerical features to represent sequences makes it statistically feasible to use universal concepts from Information Theory, such as Tsallis and Shannon entropy. In this study, we propose a novel Tsallis entropy-based feature extractor to provide useful information to classify biological sequences. To assess its relevance, we prepared five case studies: (1) an analysis of the entropic index q; (2) performance testing of the best entropic indices on new datasets; (3) a comparison made with Shannon entropy and (4) generalized entropies; (5) an investigation of the Tsallis entropy in the context of dimensionality reduction. As a result, our proposal proved to be effective, being superior to Shannon entropy and robust in terms of generalization, and also potentially representative for collecting information in fewer dimensions compared with methods such as Singular Value Decomposition and Uniform Manifold Approximation and Projection.     

Intelligent Fault Identification for Rolling Bearings Fusing Average Refined Composite Multiscale Dispersion Entropy-Assisted Feature Extraction and SVM with Multi-Strategy Enhanced Swarm Optimization

Rolling bearings act as key parts in many items of mechanical equipment and any abnormality will affect the normal operation of the entire apparatus. To diagnose the faults of rolling bearings effectively, a novel fault identification method is proposed by merging variational mode decomposition (VMD), average refined composite multiscale dispersion entropy (ARCMDE) and support vector machine (SVM) optimized by multistrategy enhanced swarm optimization in this paper. Firstly, the vibration signals are decomposed into different series of intrinsic mode functions (IMFs) based on VMD with the center frequency observation method. Subsequently, the proposed ARCMDE, fusing the superiorities of DE and average refined composite multiscale procedure, is employed to enhance the ability of the multiscale fault-feature extraction from the IMFs. Afterwards, grey wolf optimization (GWO), enhanced by multistrategy including levy flight, cosine factor and polynomial mutation strategies (LCPGWO), is proposed to optimize the penalty factor C and kernel parameter g of SVM. Then, the optimized SVM model is trained to identify the fault type of samples based on features extracted by ARCMDE. Finally, the application experiment and contrastive analysis verify the effectiveness of the proposed VMD-ARCMDE-LCPGWO-SVM method.     

Composite Multiscale Cross-Sample Entropy Analysis for Long-Term Structural Health Monitoring of Residential Buildings

This study proposesd a novel, entropy-based structural health monitoring (SHM) system for measuring microvibration signals generated by actual buildings. A structural health diagnosis interface was established for demonstration purposes. To enhance the reliability and accuracy of entropy evaluation at various scales, composite multiscale cross-sample entropy (CMSCE) was adopted to increase the number of coarse-grained time series. The degree of similarity and asynchrony between ambient vibration signals measured on adjacent floors was used as an in-dicator for structural health assessment. A residential building that has been monitored since 1994 was selected for long-term monitoring. The accumulated database, including both the earthquake and ambient vibrations in each seismic event, provided the possibility to evaluate the practicability of the CMSCE-based method. Entropy curves obtained for each of the years, as well as the stable trend of the corresponding damage index (DI) graphs, demonstrated the relia-bility of the proposed SHM system. Moreover, two large earthquake events that occurred near the monitoring site were analyzed. The results revealed that the entropy values may have been slightly increased after the earthquakes. Positive DI values were obtained for higher floors, which could provide an early warning of structural instability. The proposed SHM system is highly stable and practical.     

An Improved Incipient Fault Diagnosis Method of Bearing Damage Based on Hierarchical Multi-Scale Reverse Dispersion Entropy

The amplitudes of incipient fault signals are similar to health state signals, which increases the difficulty of incipient fault diagnosis. Multi-scale reverse dispersion entropy (MRDE) only considers difference information with low frequency range, which omits relatively obvious fault features with a higher frequency band. It decreases recognition accuracy. To defeat the shortcoming with MRDE and extract the obvious fault features of incipient faults simultaneously, an improved entropy named hierarchical multi-scale reverse dispersion entropy (HMRDE) is proposed to treat incipient fault data. Firstly, the signal is decomposed hierarchically by using the filter smoothing operator and average backward difference operator to obtain hierarchical nodes. The smoothing operator calculates the mean sample value and the average backward difference operator calculates the average deviation of sample values. The more layers, the higher the utilization rate of filter smoothing operator and average backward difference operator. Hierarchical nodes are obtained by these operators, and they can reflect the difference features in different frequency domains. Then, this difference feature is reflected with MRDE values of some hierarchical nodes more obviously. Finally, a variety of classifiers are selected to test the separability of incipient fault signals treated with HMRDE. Furthermore, the recognition accuracy of these classifiers illustrates that HMRDE can effectively deal with the problem that incipient fault signals cannot be easily recognized due to a similar amplitude dynamic.     

Optimized Variational Mode Decomposition and Permutation Entropy with Their Application in Feature Extraction of Ship-Radiated Noise

The complex and changeable marine environment surrounded by a variety of noise, including sounds of marine animals, industrial noise, traffic noise and the noise formed by molecular movement, not only interferes with the normal life of residents near the port, but also exerts a significant influence on feature extraction of ship-radiated noise (S-RN). In this paper, a novel feature extraction technique for S-RN signals based on optimized variational mode decomposition (OVMD), permutation entropy (PE), and normalized Spearman correlation coefficient (NSCC) is proposed. Firstly, with the mode number determined by reverse weighted permutation entropy (RWPE), OVMD decomposes the target signal into a set of intrinsic mode functions (IMFs). The PE of all the IMFs and SCC between each IMF with the raw signal are then calculated, respectively. Subsequently, feature parameters are extracted through the sum of PE weighted by NSCC for the IMFs. Lastly, the obtained feature vectors are input into the support vector machine multi-class classifier (SVM) to discriminate various types of ships. Experimental results indicate that five kinds of S-RN samples can be accurately identified with a recognition rate of 94% by the proposed scheme, which is higher than other previously published methods. Hence, the proposed method is more advantageous in practical applications.     

Feature Enhancement Method of Rolling Bearing Based on K-Adaptive VMD and RBF-Fuzzy Entropy

The complex and harsh working environment of rolling bearings cause the fault characteristics in vibration signal contaminated by the noise, which make fault diagnosis difficult. In this paper, a feature enhancement method of rolling bearing signal based on variational mode decomposition with K determined adaptively (K-adaptive VMD), and radial based function fuzzy entropy (RBF-FuzzyEn), is proposed. Firstly, a phenomenon called abnormal decline of center frequency (ADCF) is defined in order to determine the parameter K of VMD adaptively. Then, the raw signal is separated into K intrinsic mode functions (IMFs). A coefficient En for selecting optimal IMFs is calculated based on the center frequency bands (CFBs) of all IMFs and frequency spectrum for original signal autocorrelation operation. After that, the optimal IMFs of which En are bigger than the threshold are selected to reconstruct signal. Secondly, RBF is introduced as an innovative fuzzy function to enhance the feature discrimination of fuzzy entropy between bearings in different states. A specific way for determination of parameter r in fuzzy function is also presented. Finally, RBF-FuzzyEn is used to extract features of reconstructed signal. Simulation and experiment results show that K-adaptive VMD can effectively reduce the noise and enhance the fault characteristics; RBF-FuzzyEn has strong feature differentiation, superior noise robustness, and low dependence on data length.     

On the Genuine Relevance of the Data-Driven Signal Decomposition-Based Multiscale Permutation Entropy

Ordinal pattern-based approaches have great potential to capture intrinsic structures of dynamical systems, and therefore, they continue to be developed in various research fields. Among these, the permutation entropy (PE), defined as the Shannon entropy of ordinal probabilities, is an attractive time series complexity measure. Several multiscale variants (MPE) have been proposed in order to bring out hidden structures at different time scales. Multiscaling is achieved by combining linear or nonlinear preprocessing with PE calculation. However, the impact of such a preprocessing on the PE values is not fully characterized. In a previous study, we have theoretically decoupled the contribution of specific signal models to the PE values from that induced by the inner correlations of linear preprocessing filters. A variety of linear filters such as the autoregressive moving average (ARMA), Butterworth, and Chebyshev were tested. The current work is an extension to nonlinear preprocessing and especially to data-driven signal decomposition-based MPE. The empirical mode decomposition, variational mode decomposition, singular spectrum analysis-based decomposition and empirical wavelet transform are considered. We identify possible pitfalls in the interpretation of PE values induced by these nonlinear preprocessing, and hence, we contribute to improving the PE interpretation. The simulated dataset of representative processes such as white Gaussian noise, fractional Gaussian processes, ARMA models and synthetic sEMG signals as well as real-life sEMG signals are tested.     

Hierarchical Amplitude-Aware Permutation Entropy-Based Fault Feature Extraction Method for Rolling Bearings

In order to detect the incipient fault of rolling bearings and to effectively identify fault characteristics, based on amplitude-aware permutation entropy (AAPE), an enhanced method named hierarchical amplitude-aware permutation entropy (HAAPE) is proposed in this paper to solve complex time series in a new dynamic change analysis. Firstly, hierarchical analysis and AAPE are combined to excavate multilevel fault information, both low-frequency and high-frequency components of the abnormal bearing vibration signal. Secondly, from the experimental analysis, it is found that HAAPE is sensitive to the early failure of rolling bearings, which makes it suitable to evaluate the performance degradation of a bearing in its run-to-failure life cycle. Finally, a fault feature selection strategy based on HAAPE is put forward to select the bearing fault characteristics after the application of the least common multiple in singular value decomposition (LCM-SVD) method to the fault vibration signal. Moreover, several other entropy-based methods are also introduced for a comparative analysis of the experimental data, and the results demonstrate that HAAPE can extract fault features more effectively and with a higher accuracy.     

Adversarial Multiscale Feature Learning Framework for Overlapping Chromosome Segmentation

Chromosome karyotype analysis is of great clinical importance in the diagnosis and treatment of diseases. Since manual analysis is highly time and effort consuming, computer-assisted automatic chromosome karyotype analysis based on images is routinely used to improve the efficiency and accuracy of the analysis. However, the strip-shaped chromosomes easily overlap each other when imaged, significantly affecting the accuracy of the subsequent analysis and hindering the development of chromosome analysis instruments. In this paper, we present an adversarial, multiscale feature learning framework to improve the accuracy and adaptability of overlapping chromosome segmentation. We first adopt the nested U-shaped network with dense skip connections as the generator to explore the optimal representation of the chromosome images by exploiting multiscale features. Then we use the conditional generative adversarial network (cGAN) to generate images similar to the original ones; the training stability of the network is enhanced by applying the least-square GAN objective. Finally, we replace the common cross-entropy loss with the advanced Lovász-Softmax loss to improve the model’s optimization and accelerate the model’s convergence. Comparing with the established algorithms, the performance of our framework is proven superior by using public datasets in eight evaluation criteria, showing its great potential in overlapping chromosome segmentation.