A fast heuristic attribute reduction approach to ordered decision systems

Rough set theory has shown success in being a filter-based feature selection approach for analyzing information systems. One of its main aims is to search for a feature subset called a reduct, which preserves the classification ability of the original system. In this paper, we consider ordered decision systems, where the preference order, a fundamental concept in dominance-based rough set approach, plays a critical role. In recent literature, based on the greedy hill climbing method, many heuristic attribute reduction algorithms are proposed by utilizing significance measures of attributes, and they are extended to deal with ordered decision systems. Unfortunately, they are often time-consuming, especially when applied to deal with large scale data sets with high dimensions. To reduce the complexity, a novel accelerator is introduced in heuristic algorithms from the perspectives of objects and criteria. Based on the new accelerator, the number of objects and the dimension of criteria are lessened thus making the accelerated algorithms faster than their original counterparts while maintaining the same reducts. Experimental analysis shows the validity and efficiency of the proposed methods.     

Variable-precision dominance-based rough set approach and attribute reduction

In this paper, a variable-precision dominance-based rough set approach (VP-DRSA) is proposed together with several VP-DRSA-based approaches to attribute reduction. The properties of VP-DRSA are shown in comparison to previous dominance-based rough set approaches. An advantage of VP-DRSA over variable-consistency dominance-based rough set approach in decision rule induction is emphasized. Some relations among the VP-DRSA-based attribute reduction approaches are investigated.     

Multi-confidence rule acquisition and confidence-preserved attribute reduction in interval-valued decision systems

Rule acquisition is one of the most important objectives in the analysis of decision systems. Because of the interference of errors, a real-world decision system is generally inconsistent, which can lead to the consequence that some rules extracted from the system are not certain but possible rules. In practice, however, the possible rules with high confidence are also useful in making decision. With this consideration, we study how to extract from an interval-valued decision system the compact decision rules whose confidences are not less than a pre-specified threshold. Specifically, by properly defining a binary relation on an interval-valued information system, the concept of interval-valued granular rules is presented for the interval-valued decision system. Then, an index is introduced to measure the confidence of an interval-valued granular rule and an implication relationship is defined between the interval-valued granular rules whose confidences are not less than the threshold. Based on the implication relationship, a confidence-preserved attribute reduction approach is proposed to extract compact decision rules and a combinatorial optimization-based algorithm is developed to compute all the reducts of an interval-valued decision system. Finally, some numerical experiments are conducted to evaluate the performance of the reduction approach and the gain of using the possible rules in making decision.     

Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation

Attribute reduction is one of the key issues in rough set theory. Many heuristic attribute reduction algorithms such as positive-region reduction, information entropy reduction and discernibility matrix reduction have been proposed. However, these methods are usually computationally time-consuming for large data. Moreover, a single attribute significance measure is not good for more attributes with the same greatest value. To overcome these shortcomings, we first introduce a counting sort algorithm with time complexity O(∣C∣ ∣U∣) for dealing with redundant and inconsistent data in a decision table and computing positive regions and core attributes (∣C∣ and ∣U∣ denote the cardinalities of condition attributes and objects set, respectively). Then, hybrid attribute measures are constructed which reflect the significance of an attribute in positive regions and boundary regions. Finally, hybrid approaches to attribute reduction based on indiscernibility and discernibility relation are proposed with time complexity no more than max(O(∣C∣²∣U/C∣), O(∣C∣∣U∣)), in which ∣U/C∣ denotes the cardinality of the equivalence classes set U/C. The experimental results show that these proposed hybrid algorithms are effective and feasible for large data.     

An incremental attribute reduction approach based on knowledge granularity under the attribute generalization

Attribute reduction is a key step to discover interesting patterns in the decision system with numbers of attributes available. In recent years, with the fast development of data processing tools, the information system may increase quickly in attributes over time. How to update attribute reducts efficiently under the attribute generalization becomes an important task in knowledge discovery related tasks since the result of attribute reduction may alter with the increase of attributes. This paper aims for investigation of incremental attribute reduction algorithm based on knowledge granularity in the decision system under the variation of attributes. Incremental mechanisms to calculate the new knowledge granularity are first introduced. Then, the corresponding incremental algorithms are presented for attribute reduction based on the calculated knowledge granularity when multiple attributes are added to the decision system. Finally, experiments performed on UCI data sets and the complexity analysis show that the proposed incremental methods are effective and efficient to update attribute reducts with the increase of attributes.     

Attribute reduction based on generalized fuzzy evidence theory in fuzzy decision systems

Attribute reduction is viewed as an important issue in data mining and knowledge representation. This paper studies attribute reduction in fuzzy decision systems based on generalized fuzzy evidence theory. The definitions of several kinds of attribute reducts are introduced. The relationships among these reducts are then investigated. In a fuzzy decision system, it is proved that the concepts of fuzzy positive region reduct, lower approximation reduct and generalized fuzzy belief reduct are all equivalent, the concepts of fuzzy upper approximation reduct and generalized fuzzy plausibility reduct are equivalent, and a generalized fuzzy plausibility consistent set must be a generalized fuzzy belief consistent set. In a consistent fuzzy decision system, an attribute set is a generalized fuzzy belief reduct if and only if it is a generalized fuzzy plausibility reduct. But in an inconsistent fuzzy decision system, a generalized fuzzy belief reduct is not a generalized fuzzy plausibility reduct in general.     

A rough set-based incremental approach for learning knowledge in dynamic incomplete information systems

With the rapid growth of data sets nowadays, the object sets in an information system may evolve in time when new information arrives. In order to deal with the missing data and incomplete information in real decision problems, this paper presents a matrix based incremental approach in dynamic incomplete information systems. Three matrices (support matrix, accuracy matrix and coverage matrix) under four different extended relations (tolerance relation, similarity relation, limited tolerance relation and characteristic relation), are introduced to incomplete information systems for inducing knowledge dynamically. An illustration shows the procedure of the proposed method for knowledge updating. Extensive experimental evaluations on nine UCI datasets and a big dataset with millions of records validate the feasibility of our proposed approach.     

An efficient decision making approach in incomplete soft set

Zou et al. (2008) [21] presented weighted-average of all possible choice values approach of soft sets under incomplete information system in decision making. However, the approach is hard to understand and involves a great amount of computation. In order to simplify the approach, we present the simplified probability to directly instead of the incomplete information, and demonstrate the equivalence between the weighted-average of all possible choice values approach and the simplified probability approach. Finally, comparison results show that the proposed approach involves relatively less computation and is easier to implement and understand as compared with the weighted-average of all possible choice values approach.     

Some similarity measures of intuitionistic fuzzy sets and their applications to multiple attribute decision making

Atanassov (1986) defined the notion of intuitionistic fuzzy set, which is a generalization of the notion of Zadeh’ fuzzy set. In this paper, we first develop some similarity measures of intuitionistic fuzzy sets. Then, we define the notions of positive ideal intuitionistic fuzzy set and negative ideal intuitionistic fuzzy set. Finally, we apply the similarity measures to multiple attribute decision making under intuitionistic fuzzy environment.     

A relational perspective of attribute reduction in rough set-based data analysis

Attribute reduction is very important in rough set-based data analysis (RSDA) because it can be used to simplify the induced decision rules without reducing the classification accuracy. The notion of reduct plays a key role in rough set-based attribute reduction. In rough set theory, a reduct is generally defined as a minimal subset of attributes that can classify the same domain of objects as unambiguously as the original set of attributes. Nevertheless, from a relational perspective, RSDA relies on a kind of dependency principle. That is, the relationship between the class labels of a pair of objects depends on component-wise comparison of their condition attributes. The larger the number of condition attributes compared, the greater the probability that the dependency will hold. Thus, elimination of condition attributes may cause more object pairs to violate the dependency principle. Based on this observation, a reduct can be defined alternatively as a minimal subset of attributes that does not increase the number of objects violating the dependency principle. While the alternative definition coincides with the original one in ordinary RSDA, it is more easily generalized to cases of fuzzy RSDA and relational data analysis.     

Evidence-theory-based numerical algorithms of attribute reduction with neighborhood-covering rough sets

Covering rough sets generalize traditional rough sets by considering coverings of the universe instead of partitions, and neighborhood-covering rough sets have been demonstrated to be a reasonable selection for attribute reduction with covering rough sets. In this paper, numerical algorithms of attribute reduction with neighborhood-covering rough sets are developed by using evidence theory. We firstly employ belief and plausibility functions to measure lower and upper approximations in neighborhood-covering rough sets, and then, the attribute reductions of covering information systems and decision systems are characterized by these respective functions. The concepts of the significance and the relative significance of coverings are also developed to design algorithms for finding reducts. Based on these discussions, connections between neighborhood-covering rough sets and evidence theory are set up to establish a basic framework of numerical characterizations of attribute reduction with these sets.     

An interactive procedure for linguistic multiple attribute decision making with incomplete weight information

In this paper, we consider the multiple attribute decision making (MADM) problems, in which the information about attribute weights is partly known and the attribute values are expressed in linguistic labels. We first define the concepts of linguistic positive ideal point, linguistic negative ideal point, and satisfactory degree of alternative. Based on these concepts, we then establish some linear programming models, through which the decision maker interacts with the analyst. Furthermore, we establish a practical interactive procedure for solving the MADM problems considered in this paper. The interactive process can be realized by giving and revising the satisfactory degrees of alternatives till an optimum satisfactory solution is achieved. Finally, a practical example is given to illustrate the developed procedure.     

Bijective soft set decision system based parameters reduction under fuzzy environments

Gong et al. (2010) and Xiao et al. (2010) have proposed the notion of bijective soft set and exclusive disjunctive soft set, respectively, which is a subtype of soft set. On the basis of their work, this paper extends these notions to fuzzy environments, and formulates the concept of bijective fuzzy soft set, which can deal with more uncertain problems. Moreover, this paper proposes two parameters reduction algorithms: one (Algorithm 1) is based on bijective fuzzy soft system, and the other (Algorithm 2) takes weight of an element into consideration. Since the threshold plays an important role in these algorithms, we proposed an algorithm (Algorithm 3) to decide the optimal value of threshold specially. Afterwards, an example analysis of the two parameters reduction algorithms is given and the result shows that the two algorithms lead to the same parameters reduction of a bijective fuzzy soft system. Since Algorithm 2 considers the detail weights of elements, thus it can be used in more uncertain problems, such as time series analysis problems, than Algorithm 1.     

Updating incomplete factorization preconditioners for shifted linear systems arising in a wind model

The efficiency of a finite element mass consistent model for wind field adjustment depends on the stability parameter α which allows adjustment from a strictly horizontal wind to a pure vertical one. Each simulation with the wind model leads to the resolution of a linear system of equations, the matrix of which depends on a function ε(α), i.e., (M+εN)x_ε=b_ε, where M and N are constant, symmetric and positive definite matrices with the same sparsity pattern for a given level of discretization. The estimation of this parameter may be carried out by using genetic algorithms. This procedure requires the evaluation of a fitness function for each individual of the population defined in the searching space of α, that is, the resolution of one linear system of equations for each value of α. Preconditioned Conjugate Gradient algorithm (PCG) is usually applied for the resolution of these types of linear systems due to its good convergence results. In order to solve this set of linear systems, we could either construct a different preconditioner for each of them or use a single preconditioner constructed from the first value of ε to solve all the systems. In this paper, an intermediate approach is proposed. An incomplete Cholesky factorization of matrix A_ε is constructed for the first linear system and it is updated for each ε at a low computational cost. Numerical experiments related to realistic wind field are presented in order to show the performance of the proposed preconditioning strategy.     

Correlation coefficient of dual hesitant fuzzy sets and its application to multiple attribute decision making

A dual hesitant fuzzy set (DHFS) consists of two parts, that is, the membership hesitancy function and the nonmembership hesitancy function, supporting a more exemplary and flexible access to assign values for each element in the domain, and can handle two kinds of hesitancy in this situation. It can be considered as a powerful tool to express uncertain information in the process of group decision making. Therefore, we propose a correlation coefficient between DHFSs as a new extension of existing correlation coefficients for hesitant fuzzy sets and intuitionistic fuzzy sets and apply it to multiple attribute decision making under dual hesitant fuzzy environments. Through the weighted correlation coefficient between each alternative and the ideal alternative, the ranking order of all alternatives can be determined and the best alternative can be easily identified as well. Finally, a practical example of investment alternatives is given to demonstrate the practicality and effectiveness of the developed approach.     

A least deviation method for priority derivation in group decision making with incomplete reciprocal preference relations

In this paper, based on the transfer relationship between reciprocal preference relation and multiplicative preference relation, we proposed a least deviation method (LDM) to obtain a priority vector for group decision making (GDM) problems where decision-makers' (DMs') assessments on alternatives are furnished as incomplete reciprocal preference relations with missing values. Relevant theorems are investigated and a convergent iterative algorithm about LDM is developed. Using three numerical examples, the LDM is compared with the other prioritization methods based on two performance evaluation criteria: maximum deviation and maximum absolute deviation. Statistical comparative study, complexity of computation of different algorithms, and comparative analyses are provided to show its advantages over existing approaches.     

On the stability of evolutionary dynamics in games with incomplete information

In an interaction it is possible that one agent has features it is aware of but the opponent is not. These features (e.g. cost, valuation or fighting ability) are referred to as the agent’s type. The paper compares two models of evolution in symmetric situations of this kind. In one model the type of an agent is fixed and evolution works on strategies of types. In the other model every agent adopts with fixed probabilities both types, and type-contingent strategies are exposed to evolution. It is shown that the dynamic stability properties of equilibria may differ even when there are only two types and two strategies. However, in this case the dynamic stability properties are generically the same when the payoff of a player does not depend directly on the type of the opponent. Examples illustrating these results are provided.     

Set choice problems with incomplete information about the preferences of the decision maker

We consider the problem of selecting a predetermined number of objects from a given finite set. It is assumed that the preferences of the decision maker on this set are only partially known. Our solution approach is based on the notions of optimal and non-dominated subsets. The properties of such subsets and the objects they contain are investigated. The implementation of the developed approach is discussed and illustrated by various examples.     

Modal analysis reduction of multi-body systems with generic damping

Modal analysis of multi-body systems is broadly used to study the behavior and controller design of dynamic systems. In both cases, model reduction that does not degrade accuracy is necessary for the efficient use of these models. Previous work by the author addressed the reduction of modal representations by eliminating entire modes or individual modal elements (inertial, compliant, resistive). In that work, the bond graph formulation was used to model the system and the modal decomposition was limited to systems with proportional damping. The objective of the current work is to develop a new methodology such that model reduction can be implemented to modal analysis of multi-body systems with non-proportional damping that were not modeled using bond graphs. This extension also makes the methodology applicable to realistic systems where the importance of modal coupling terms is quantified and potentially eliminated. The new methodology is demonstrated through an illustrative example.