Classifying efficient alternatives in SMAA using cross confidence factors

Stochastic multicriteria acceptability analysis (SMAA) is a family of methods for aiding multicriteria group decision making. These methods are based on exploring the weight space in order to describe the preferences that make each alternative the most preferred one. The main results of the analysis are rank acceptability indices, central weight vectors and confidence factors for different alternatives. The rank acceptability indices describe the variety of different preferences resulting in a certain rank for an alternative; the central weight vectors represent the typical preferences favouring each alternative; and the confidence factors measure whether the criteria data are sufficiently accurate for making an informed decision.In some cases, when the problem involves a large number of efficient alternatives, the analysis may fail to discriminate between them. This situation is revealed by low confidence factors. In this paper we develop cross confidence factors, which are based on computing confidence factors for alternatives using each other’s central weight vectors. The cross confidence factors can be used for classifying efficient alternatives into sets of similar and competing alternatives. These sets are related to the concept of reference sets in Data Envelopment Analysis (DEA), but generalized for stochastic models. Forming these sets is useful when trying to identify one or more most preferred alternatives, or suitable compromise alternatives. The reference sets can also be used for evaluating whether criteria need to be measured more accurately, and at which alternatives the measurements should be focused. This may cause considerable savings in measurement costs. We demonstrate the use of the cross confidence factors and reference sets using a real-life example.     

SMAA - Stochastic multiobjective acceptability analysis

Stochastic multiobjective acceptability analysis (SMAA) is a multicriteria decision support technique for multiple decision makers based on exploring the weight space. Inaccurate or uncertain input data can be represented as probability distributions. In SMAA the decision makers need not express their preferences explicitly or implicitly; instead the technique analyses what kind of valuations would make each alternative the preferred one. The method produces for each alternative an acceptability index measuring the variety of different valuations that support that alternative, a central weight vector representing the typical valuations resulting in that decision, and a confidence factor measuring whether the input data is accurate enough for making an informed decision.     

Ranking DMUs by using interval DEA cross efficiency matrix with acceptability analysis

Cross efficiency method is an extension of data envelopment analysis (DEA), and has been widely used for ranking performance of decision making units (DMUs). To eliminate the non-uniqueness of cross efficiency scores, the aggressive and benevolent strategies have been proposed as secondary goals to determine the unique cross efficiency score. The current paper aims to propose an alternative strategy which does not consider the preference of the decision maker in choosing aggressive or benevolent strategy. Instead, the paper considers all possible weight sets in weight space when computing the cross efficiency and each DMU is given an interval cross efficiency. By using the stochastic multicriteria acceptability analysis (SMAA-2) method, all DMUs in the interval cross efficiency matrix (CEM) could be fully ranked according to the acceptability indices. A numerical example about efficiency evaluation to seven academic departments in a university is illustrated.     

A simulation-based test of stochastic multicriteria acceptability analysis using achievement functions

Stochastic multicriteria acceptability analysis using achievement functions (SMAA-A) is a preference model for discrete-choice decision making that inverts the traditional goal programming process by asking what combinations of aspirations are necessary to make each alternative the preferred one, rather than what alternative is preferred given a set of aspirations. In this paper, we test the ability of the model to discern good-performing alternatives from poorly-performing ones using a simulation study. Simulation results show that a suitably detailed construction of the acceptability index is particularly important, and that the resulting model can be fruitfully applied in the selection of a shortlist of alternatives from a larger set with only very limited decision maker involvement.     

Locating a waste treatment facility by using stochastic multicriteria acceptability analysis with ordinal criteria

In this paper we describe a real-life application of an ordinal multicriteria method in the context of choosing a location for a waste treatment facility near Lappeenranta in South-Eastern Finland. The associated environmental impact assessment (EIA) procedure is briefly described. The application was characterized by two interesting properties: no preference information was available, and only ordinal measurements for the criteria were available. The large amount of data obtained was then analyzed using the SMAA-O method – Stochastic Multicriteria Acceptability Analysis with Ordinal criteria designed for this problem setting. SMAA-O converts ordinal information into cardinal data by simulating all possible mappings between ordinal and cardinal scales that preserve the given rankings. As with the basic SMAA-method, the decision makers' (DMs) unknown or partly known preferences are at the same time simulated by choosing weights randomly from appropriate distributions. The main results of the analysis are acceptability indices for alternatives describing the variety of preferences that could make each alternative the best choice. Based on these and additional considerations, the DMs made the final choice for the location of the plant.     

The analytic hierarchy process with stochastic judgements

The analytic hierarchy process (AHP) is a widely-used method for multicriteria decision support based on the hierarchical decomposition of objectives, evaluation of preferences through pairwise comparisons, and a subsequent aggregation into global evaluations. The current paper integrates the AHP with stochastic multicriteria acceptability analysis (SMAA), an inverse-preference method, to allow the pairwise comparisons to be uncertain. A simulation experiment is used to assess how the consistency of judgements and the ability of the SMAA-AHP model to discern the best alternative deteriorates as uncertainty increases. Across a range of simulated problems results indicate that, according to conventional benchmarks, judgements are likely to remain consistent unless uncertainty is severe, but that the presence of uncertainty in almost any degree is sufficient to make the choice of best alternative unclear.     

Pseudo-criteria versus linear utility function in stochastic multi-criteria acceptability analysis

Stochastic multi-criteria acceptability analysis (SMAA) is a multi-criteria decision support method for multiple decision-makers (DMs) in discrete problems. SMAA does not require explicit or implicit preference information from the DMs. Instead, the method is based on exploring the weight space in order to describe the valuations that would make each alternative the preferred one. Partial preference information can be represented in the weight space analysis through weight distributions. In this paper we compare two variants of the SMAA method using randomly generated test problems with 2–12 criteria and 4–12 alternatives. In the original SMAA, a utility or value function models the DMs' preference structure, and the inaccuracy or uncertainty of the criteria is represented by probability distributions. In SMAA-3, ELECTRE III-type pseudo-criteria are used instead. Both methods compute for each alternative an acceptability index measuring the variety of different valuations that supports this alternative, and a central weight vector representing the typical valuations resulting in this decision. We seek answers to three questions: (1) how similar are the results provided by the decision models, (2) what kind of systematic differences exists between the models, and (3) how could one select indifference and preference thresholds of the pseudo-criteria model to match a utility model with given probability distributions?     

A stochastic method for robustness analysis in sorting problems

ELECTRE TRI is a multiple criteria decision aiding sorting method with a history of successful real-life applications. In ELECTRE TRI, values for certain parameters have to be provided. We propose a new method, SMAA-TRI, that is based on stochastic multicriteria acceptability analysis (SMAA), for analyzing the stability of such parameters. The stability analysis can be used for deriving robust conclusions. SMAA-TRI allows ELECTRE TRI to be used with uncertain, arbitrarily distributed values for weights, the lambda cutting level, and profiles. The method consists of analyzing finite spaces of arbitrarily distributed parameter values. Monte Carlo simulation is applied in this in order to describe for each alternative the share of parameter values that have it assigned to different categories. We show the real-life applicability by re-analyzing a case study in the field of risk assessment.     

Mutual funds performance appraisal using stochastic multicriteria acceptability analysis

Mutual fund investors are concerned with the selection of the best fund in terms of performance among the set of alternative funds. This paper proposes an innovative mutual funds performance evaluation measure in the context of multicriteria decision making. We implement a multicriteria methodology using stochastic multicriteria acceptability analysis, on Greek domestic equity funds for the period 2000-2009. Combining a unique dataset of risk-adjusted returns such as Carhart’s alpha with funds’ cost variables, we obtain a multicriteria performance evaluation and ranking of the mutual funds, by means of an additive value function model. The main conclusion is that among employed variables, the sophisticated Carhart’s alpha plays the most important role in determining fund rankings. On the other hand, funds’ rankings are affected only marginally by operational attributes. We believe that our results could have serious implications either in terms of a fund rating system or for constructing optimal combinations of portfolios.     

2-order additive fuzzy measure identification method based on diamond pairwise comparison and maximum entropy principle

Fuzzy measures can flexibly describe the relative importance of decision criterion as well as their interactions in multicriteria decision making. Based on the diamond pairwise comparison, a new identification method of 2-order additive fuzzy measure is proposed. The relative weight and the interaction degree can be obtained simultaneously for every pair of criteria in the diamond pairwise comparison. The Choquet integral-based equivalent alternative curve can help the decision maker estimate the interaction degrees between criteria. The overall importance of each criterion is obtained by the maximum eigenvector method of AHP. According to the maximum fuzzy measure entropy principal, a nonlinear programming is constructed to identify the interaction indices among criteria. Finally, an illustrative example shows the feasibility and validity of the proposed identification method.     

Stochastic multicriteria acceptability analysis using the data envelopment model

Data envelopment analysis (DEA) and stochastic multicriteria acceptability analysis (SMAA-2) are methods for evaluating alternatives based on multiple criteria. While DEA is mainly an ex-post tool used for classifying alternatives into efficient and inefficient ones, SMAA-2 is an ex-ante tool for supporting multiple criteria decision-making. Both methods use a kind of value function where the importance of criteria is modeled using weights. Unlike many other methods, neither DEA nor SMAA-2 requires decision-makers’ weights as input. Instead, these so-called non-parametric methods explore the weight space in order to identify weights favorable for each alternative. This paper introduces the SMAA-D method, which is a combination of DEA and SMAA-2. SMAA-D can be characterized as an extension of DEA to handle uncertain or imprecise data to provide stochastic efficiency measures. Alternatively, the combined method can be seen as a variant of SMAA-2 with a DEA-type value function.     

基于群体冲突的模糊偏好关系大群体决策方法

在大群体决策中,针对每一个决策者都有一个关于决策方案的模糊偏好关系的决策问题,提出了一种基于冲突的模糊偏好关系大群体决策方法。该方法首先考虑了复杂大群体的偏好差异,对决策者偏好进行聚类分析,形成不同的聚集,然后通过熵权法确定聚集的权重,集结成大群体模糊偏好关系,再对聚集内及聚集间进行冲突分析,通过一个迭代算子进行冲突消解,以达到一定冲突范围内的群体模糊偏好关系。最后通过一个算例说明了方法的有效性。     

Ranking by pairwise comparisons for Swiss-system tournaments

Pairwise comparison matrices are widely used in multicriteria decision making. This article applies incomplete pairwise comparison matrices in the area of sport tournaments, namely proposing alternative rankings for the 2010 Chess Olympiad Open tournament. It is shown that results are robust regarding scaling technique. In order to compare different rankings, a distance function is introduced with the aim of taking into account the subjective nature of human perception. Analysis of the weight vectors implies that methods based on pairwise comparisons have common roots. Visualization of the results is provided by multidimensional scaling on the basis of the defined distance. The proposed rankings give in some cases intuitively better outcome than currently used lexicographical orders.     

Spatial multicriteria decision support for robust land-use suitability: The case of landfill site selection in Northeastern Greece

Multicriteria spatial decision support systems (MC-SDSS) have emerged as an integration of geographical information systems (GIS) and multiple criteria decision aid (MCDA) methods for incorporating conflicting objectives and decision makers’ preferences into spatial decision models. In this paper, we present spatial UTASTAR (S-UTASTAR), a raster-based MC-SDSS for land-use suitability analysis. The multicriteria component of the system is based on the UTA-type disaggregation-aggregation approach. S-UTASTAR is applied in a raster-based case study concerning land-use suitability analysis to identify appropriate municipal solid waste landfill (MSW) sites in Northeast Greece. Moreover, robustness analysis tools are implemented to guarantee robust decision support results. More specifically, during the aggregation phase, the Stochastic Multiobjective Acceptability Analysis (SMAA) is used to indicate the frequency at which a site achieves the best ranking positions within a large set of alternative landfill sites.     

An outranking method under uncertainty

The uncertainty of consequences and the imprecision of data often imply, in multicriteria decision problems, the use of probability distributions to characterize the evaluation of each action with respect to eacg criterion. To keep as much information as possible, the analysis should treat directly these probability distributions instead of reducing them to single values such as mean or median. In this context, the paper proposes a multicriteria procedure which transforms these distributive evaluations of actions, according to decisionmaker's preferences, in order to progress to a ranking of these actions. The procedure consists, for each couple of actions, to construct a distributive preference degree with respect to each criterion and a distributive outranking degree over all criteria. These distributive outranking degrees are then explored in order to rank the actions, totally or partially.     

A grey relational projection method for multi-attribute decision making based on intuitionistic trapezoidal fuzzy number

With respect to multiple attribute decision making (MADM) problems in which the attribute value takes the form of intuitionistic trapezoidal fuzzy number, and the attribute weight is unknown, a new decision making analysis methods are developed. Firstly, some operational laws and expected values of intuitionistic trapezoidal fuzzy numbers, and distance between two intuitionistic trapezoidal fuzzy numbers, are introduced. Then information entropy method is used to determine the attribute weight, and the grey relational projection method combined grey relational analysis method and projection method is proposed, and to rank the alternatives are done by the relative closeness to PIS which combines grey relational projection values from the positive ideal solution and negative ideal solution to each alternative. Finally, an illustrative example is given to verify the developed approach and to demonstrate its practicality and effectiveness.     

Extension of the LINMAP for multiattribute decision making under Atanassov’s intuitionistic fuzzy environment

The aim of this article is further extending the linear programming techniques for multidimensional analysis of preference (LINMAP) to develop a new methodology for solving multiattribute decision making (MADM) problems under Atanassov’s intuitionistic fuzzy (IF) environments. The LINMAP only can deal with MADM problems in crisp environments. However, fuzziness is inherent in decision data and decision making processes. In this methodology, Atanassov’s IF sets are used to describe fuzziness in decision information and decision making processes by means of an Atanassov’s IF decision matrix. A Euclidean distance is proposed to measure the difference between Atanassov’s IF sets. Consistency and inconsistency indices are defined on the basis of preferences between alternatives given by the decision maker. Each alternative is assessed on the basis of its distance to an Atanassov’s IF positive ideal solution (IFPIS) which is unknown a prior. The Atanassov’s IFPIS and the weights of attributes are then estimated using a new linear programming model based upon the consistency and inconsistency indices defined. Finally, the distance of each alternative to the Atanassov’s IFPIS can be calculated to determine the ranking order of all alternatives. A numerical example is examined to demonstrate the implementation process of this methodology. Also it has been proved that the methodology proposed in this article can deal with MADM problems under not only Atanassov’s IF environments but also both fuzzy and crisp environments.     

On rank reversal in decision analysis

Analytic hierarchy process (AHP) has been criticized for its possible rank reversal phenomenon caused by the addition or deletion of an alternative. This paper shows the fact that the rank reversal phenomenon occurs not only in the AHP but also in many other decision making approaches such as the Borda–Kendall (BK) method for aggregating ordinal preferences, the simple additive weighting (SAW) method, the technique for order preference by similarity to ideal solution (TOPSIS) method, and the cross-efficiency evaluation method in data envelopment analysis (DEA). Numerical examples are provided to illustrate the rank reversal phenomenon in these popular decision making approaches.