Performance evaluation: An integrated method using data envelopment analysis and fuzzy preference relations

In a multi-attribute decision-making (MADM) context, the decision maker needs to provide his preferences over a set of decision alternatives and constructs a preference relation and then use the derived priority vector of the preference to rank various alternatives. This paper proposes an integrated approach to rate decision alternatives using data envelopment analysis and preference relations. This proposed approach includes three stages. First, pairwise efficiency scores are computed using two DEA models: the CCR model and the proposed cross-evaluation DEA model. Second, the pairwise efficiency scores are then utilized to construct the fuzzy preference relation and the consistent fuzzy preference relation. Third, by use of the row wise summation technique, we yield a priority vector, which is used for ranking decision-making units (DMUs). For the case of a single output and a single input, the preference relation can be directly obtained from the original sample data. The proposed approach is validated by two numerical examples.     

Implausible alternatives in eliciting multi-attribute value functions

Many methods to elicit preference models in multi-attribute decision making rely on evaluations of a set of sample alternatives by decision makers. Using orthogonal design methods to create this set of alternatives might require respondents to evaluate unrealistic alternatives. In this paper, we perform an empirical study to analyze whether the presence of such implausible alternatives has an effect on the quality of utility elicitation. Using a new approach to measure consistency, we find that implausible alternatives in fact, have a positive effect on consistency of intra-attribute preference information and consistency with dominance, but do not affect inter-attribute preference information.     

DIS-CARD: a new method of multiple criteria sorting to classes with desired cardinality

In this paper, we present a new preference disaggregation method for multiple criteria sorting problems, called DIS-CARD. Real-life experience indicates the need of considering decision making situations in which a decision maker (DM) specifies a desired number of alternatives to be assigned to single classes or to unions of some classes. These situations require special methods for multiple criteria sorting subject to desired cardinalities of classes. DIS-CARD deals with such a problem, using the ordinal regression approach to construct a model of DM’s preferences from preference information provided in terms of exemplary assignments of some reference alternatives, together with the above desired cardinalities. We develop a mathematical model for incorporating such preference information via mixed integer linear programming (MILP). Then, we adapt the MILP model to two types of preference models: an additive value function and an outranking relation. Illustrative example is solved to illustrate the methodology.     

Aggregation of utility-based individual preferences for group decision-making

Multi-attribute utility theory (MAUT) elicits an individual decision maker’s preferences for single attributes and develops a utility function by mathematics formulation to add up the preferences of the entire set of attributes when assessing alternatives. A common aggregation method of MAUT for group decisions is the simple additive weighting (SAW) method, which does not consider the different preferential levels and preferential ranks for individual decision makers’ assessments of alternatives in a decision group, and thus seems too intuitive in achieving the consensus and commitment for group decision aggregation. In this paper, the preferential differences denoting the preference degrees among different alternatives and preferential priorities denoting the favorite ranking of the alternatives for each decision maker are both considered and aggregated to construct the utility discriminative values for assessing alternatives in a decision group. A comparative analysis is performed to compare the proposed approach to the SAW model, and a satisfaction index is used to investigate the satisfaction levels of the final two resulting group decisions. In addition, a feedback interview is conducted to understand the subjective perceptions of decision makers while examining the results obtained from these two approaches for the second practical case. Both investigation results show that the proposed approach is able to achieve a more satisfying and agreeable group decision than that of the SAW method.     

Evidential reasoning based preference programming for multiple attribute decision analysis under uncertainty

Multiple attribute decision analysis (MADA) problems having both quantitative and qualitative attributes under uncertainty can be modelled and analysed using the evidential reasoning (ER) approach. Several types of uncertainty such as ignorance and fuzziness can be consistently modelled in the ER framework. In this paper, both interval weight assignments and interval belief degrees are considered, which could be incurred in many decision situations such as group decision making. Based on the existing ER algorithm, several pairs of preference programming models are constructed to support global sensitivity analysis based on the interval values and to generate the upper and lower bounds of the combined belief degrees for distributed assessment and also the expected values for ranking of alternatives. A post-optimisation procedure is developed to identify non-dominated solutions, examine the robustness of the partial ranking orders generated, and provide guidance for the elicitation of additional information for generating more desirable assessment results. A car evaluation problem is examined to show the implementation process of the proposed approach.     

ELECTRE: Robust ordinal regression for outranking methods

We present a new method, called ELECTRE^GKMS, which employs robust ordinal regression to construct a set of outranking models compatible with preference information. The preference information supplied by the decision maker (DM) is composed of pairwise comparisons stating the truth or falsity of the outranking relation for some real or fictitious reference alternatives. Moreover, the DM specifies some ranges of variation of comparison thresholds on considered pseudo-criteria. Using robust ordinal regression, the method builds a set of values of concordance indices, concordance thresholds, indifference, preference, and veto thresholds, for which all specified pairwise comparisons can be restored. Such sets are called compatible outranking models. Using these models, two outranking relations are defined, necessary and possible. Whether for an ordered pair of alternatives there is necessary or possible outranking depends on the truth of outranking relation for all or at least one compatible model, respectively. Distinguishing the most certain recommendation worked out by the necessary outranking, and a possible recommendation worked out by the possible outranking, ELECTRE^GKMS answers questions of robustness concern. The method is intended to be used interactively with incremental specification of pairwise comparisons, possibly with decreasing confidence levels. In this way, the necessary and possible outranking relations can be, respectively, enriched or impoverished with the growth of the number of pairwise comparisons. Furthermore, the method is able to identify troublesome pieces of preference information which are responsible for incompatibility. The necessary and possible outranking relations are to be exploited as usual outranking relations to work out recommendation in choice or ranking problems. The introduced approach is illustrated by a didactic example showing how ELECTRE^GKMS can support real-world decision problems.     

考虑决策者风险偏好的区间直觉模糊多属性群决策方法

提出了一种考虑决策者风险偏好且属性权重信息不完全的区间直觉模糊数多属性群决策方法。同时考虑相似度和接近度,确定每一属性的决策者权重。为了考虑决策者风险偏好对决策结果的影响和避免区间直觉模糊矩阵的渐进性,引入了决策者风险偏好系数,将集结后的综合决策矩阵转换成区间数矩阵。然后,为了客观地求出属性权重信息不完全环境下属性的权重,构建了基于区间直觉模糊交叉熵的属性权重目标规划模型,该模型不仅考虑了评价值的偏差,也强调了评价值自身的可信度。最后,通过研发项目选择问题的实例分析说明了所提方法的合理性和优越性。     

Dealing with inconsistent judgments in multiple criteria sorting models

Sorting models consist in assigning alternatives evaluated on several criteria to ordered categories. To implement such models it is necessary to set the values of the preference parameters used in the model. Rather than fixing the values of these parameters directly, a usual approach is to infer these values from assignment examples provided by the decision maker (DM), i.e., alternatives for which (s)he specifies a required category. However, assignment examples provided by DMs can be inconsistent, i.e., may not match the sorting model. In such situations, it is necessary to support the DMs in the resolution of this inconsistency. In this paper, we extend algorithms from mous5ejor03 that calculate different ways to remove assignment examples so that the information can be represented in the sorting model. The extension concerns the possibility to relax (rather than to delete) assignment examples. These algorithms incorporate information about the confidence attached to each assignment example, hence providing inconsistency resolutions that the DMs are most likely to accept. Received: September 2004, Revised: June 2005 AMS classification: 90B50, 91B08, 90C05     

Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements

We consider a problem of ranking alternatives based on their deterministic performance evaluations on multiple criteria. We apply additive value theory and assume the Decision Maker’s (DM) preferences to be representable with general additive monotone value functions. The DM provides indirect preference information in form of pair-wise comparisons of reference alternatives, and we use this to derive the set of compatible value functions. Then, this set is analyzed to describe (1) the possible and necessary preference relations, (2) probabilities of the possible relations, (3) ranges of ranks the alternatives may obtain, and (4) the distributions of these ranks. Our work combines previous results from Robust Ordinal Regression, Extreme Ranking Analysis and Stochastic Multicriteria Acceptability Analysis under a unified decision support framework. We show how the four different results complement each other, discuss extensions of the main proposal, and demonstrate practical use of the approach by considering a problem of ranking 20 European countries in terms of 4 criteria reflecting the quality of their universities.     

Towards a constructive approach to act-conditional subjective expected utility models

In structuring a decision problem under uncertainty, the uncertain environment may be affected by the choice of an act. In decision analysis, the decision maker provides subjective probabilities and utilities through separate elicitation processes, and then both components are combined together to give an index of his preference over decision alternatives. Based upon this conceptualisation of decision analysis, a constructive approach to act-conditional subjective expected utility theory is proposed. Two utility models have been addressed: the linear utility model and the weighted utility model.     

Sequential incorporation of imprecise information in multiple criteria decision processes

In this paper we deal with multicriteria decision processes and develop tools that permit to ease the task of analysing such models. We provide a methodology to sequentially incorporate imprecise preference information which is given by means of general linear relations in the weighting coefficients. The results presented allow us to evaluate the quality of the information supplied and can be used to reduce the number of irrelevant alternatives to be presented to the decision maker (DM). Several examples based on multiple criteria linear programming illustrate the results of the paper.     

Selection of a representative value function in robust multiple criteria ranking and choice

We introduce the concept of a representative value function in robust ordinal regression applied to multiple criteria ranking and choice problems. The proposed method can be seen as a new interactive UTA-like procedure, which extends the UTA^GMS and GRIP methods. The preference information supplied by the decision maker (DM) is composed of a partial preorder and intensities of preference on a subset of reference alternatives. Robust ordinal regression builds a set of general additive value functions which are compatible with the preference information, and returns two binary preference relations: necessary and possible. They identify recommendations which are compatible with all or at least one compatible value function, respectively. In this paper, we propose a general framework for selection of a representative value function from among the set of compatibles ones. There are a few targets which build on results of robust ordinal regression, and could be attained by a representative value function. In general, according to the interactively elicited preferences of the DM, the representative value function may emphasize the advantage of some alternatives over the others when all compatible value functions acknowledge this advantage, or reduce the ambiguity in the advantage of some alternatives over the others when some compatible value functions acknowledge an advantage and other ones acknowledge a disadvantage. The basic procedure is refined by few extensions. They enable emphasizing the advantage of alternatives that could be considered as potential best options, accounting for intensities of preference, or obtaining a desired type of the marginal value functions.     

On Method for Uncertain Multiple Attribute Decision Making Problems with Uncertain Multiplicative Preference Information on Alternatives

The uncertain multiple attribute decision making (UMADM) problems are investigated, in which the information about attribute weights is known partly and the attribute values take the form of interval numbers, and the decision maker (DM) has uncertain multiplicative preference information on alternatives. We make the decision information uniform by using a transformation formula, and then establish an objective-programming model. The attribute weights can be determined by solving the developed model. The concept of interval positive ideal point of alternatives (IPIPA) is introduced, and an approach based on IPIPA and projection to ranking alternatives is proposed. The method can avoid comparing and ranking interval numbers, and can reflect both the objective information and the DMs subjective preferences.     

Families of relations modelling preferences under incomplete information

Let us consider a preferential information of type preference–indifference–incomparability (P, I, J), with additional information about differences in attractiveness between pairs of alternatives. The present paper offers a theoretical framework for the study of the “level of constraint” of this kind of partial preferential information. It suggests a number of structures as potential models being less demanding than the classical one in which differences in utilities can be used to represent the comparison of differences in attractiveness. The models are characterized in the more general context of families of non-complete preference structures, according to two different perspectives (called “semantico-numerical” and “matrix”). Both perspectives open the door to further practical applications connected with elicitation of the preferences of a decision maker.     

When conflict induces the expression of incomplete preferences

Multicriteria conflict arises in pairwise comparisons, where each alternative outperforms the other one on some criterion, which imposes a trade-off. Comparing two alternatives can be difficult if their respective advantages are of high magnitude (the attribute spread is large). In this paper, we investigate to which extent conflict in a comparison situation can lead decision makers to express incomplete preferences, that is, to refuse to compare the two alternatives, or to be unable to compare them with confidence. We report on an experiment in which subjects expressed preferences on pairs of alternatives involving varying conflicts. Results show that depending on whether the participants are allowed to express incomplete preferences or not, attribute spread has a different effect: a large attribute spread increases the frequency of incomparability statements, when available, while it increases the use of indifference statements when only indifference and preference answers are permitted. These results lead us to derive some implications for preference elicitation methods involving comparison tasks.     

A simulation optimization method that considers uncertainty and multiple performance measures

Simulation optimization provides a structured approach to system design and configuration when analytical expressions for input/output relationships are unavailable. This research focuses on the development of a new simulation optimization technique applicable to systems having multiple performance measures. The aim of this research is to incorporate a simulation end user’s preference towards risk and uncertainty into the search process for the best decision alternative. Automation of the optimization procedure is a necessity. Therefore, this paper proposes a simulation optimization method that involves a preference model, specifically adapted for decision making with simulation models.     

Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral

Within the multicriteria aggregation–disaggregation framework, ordinal regression aims at inducing the parameters of a decision model, for example those of a utility function, which have to represent some holistic preference comparisons of a Decision Maker (DM). Usually, among the many utility functions representing the DM’s preference information, only one utility function is selected. Since such a choice is arbitrary to some extent, recently robust ordinal regression has been proposed with the purpose of taking into account all the sets of parameters compatible with the DM’s preference information. Until now, robust ordinal regression has been implemented to additive utility functions under the assumption of criteria independence. In this paper we propose a non-additive robust ordinal regression on a set of alternatives A, whose utility is evaluated in terms of the Choquet integral which permits to represent the interaction among criteria, modelled by the fuzzy measures, parameterizing our approach.     

Distributed preference relations for multiple attribute decision analysis

In this paper, we propose a new pairwise comparison approach called distributed preference relation (DPR) to simultaneously signify preferred, non-preferred, indifferent, and uncertain degrees of one alternative over another on a set of grades, which is more versatile for elicitation of preference information from a decision maker than multiplicative preference relation, fuzzy preference relation (FPR) and intuitionistic FPR. In a DPR matrix on a set of alternatives, each element is a distribution recording the preferred, non-preferred, indifferent, and uncertain degrees of one alternative over another using a set of grades. To facilitate the comparison of alternatives, we define a score matrix based on a DPR matrix using the given score values of the grades. Its additive consistency is constructed, analysed, and compared with the additive consistency of FPRs between alternatives. A method for comparing two interval numbers is then employed to create a possibility matrix from the score matrix, which can generate a ranking order of alternatives with possibility degrees. A problem of evaluating strategic emerging industries is investigated using the approach to demonstrate the application of a DPR matrix to modelling and analysing a multiple attribute decision analysis problem.     

Simulation techniques for the sensitivity analysis of multi-criteria decision models

This paper presents a simulation approach for high dimensional sensitivity analysis of the weights of multi-criteria decision models. This approach allows simultaneous changes of the weights and generates results that can easily be analyzed statistically to provide insights into multi-criteria model recommendations. In this study we consider three cases: no information, order information, and partial information regarding the weights. Our approach also allows investigation of sensitivity to the form of multi-criteria decision models. The simulation procedures we propose can also be used to aide in the actual decision process, particularly when the task is to select a subset of superior alternatives.