A methodology for developing Bayesian networks: An application to information technology (IT) implementation

Bayesian Networks (BNs) are probabilistic inference engines that support reasoning under uncertainty. This article presents a methodology for building an information technology (IT) implementation BN from client–server survey data. The article also demonstrates how to use the BN to predict the attainment of IT benefits, given specific implementation characteristics (e.g., application complexity) and activities (e.g., reengineering). The BN is an outcome of a machine learning process that finds the network’s structure and its associated parameters, which best fit the data. The article will be of interest to academicians who want to learn more about building BNs from real data and practitioners who are interested in IT implementation models that make probabilistic statements about certain implementation decisions.     

Hybridizing principles of the Electre method with case-based reasoning for data mining: Electre-CBR-I and Electre-CBR-II

Electre is an important outranking method developed in the area of decision-aiding. Data mining is a vital developing technique that receives contributions from lots of disciplines such as databases, machine learning, information retrieval, statistics, and so on. Techniques in outranking approaches, e.g. Electre, could also contribute to the development of data mining. In this research, we address the following two issues: a) why and how to combine Electre with case-based reasoning (CBR) to generate corresponding hybrid models by extending the fundamental principles of Electre into CBR; b) the effect on predictive performance by employing evidence vetoing the assertion on the base of evidence supporting the assertion. The similarity measure of CBR is implemented by revising and fulfilling three basic ideas of Electre, i.e. assertion that two cases are indifferent, evidence supporting the assertion, and evidence vetoing the assertion. Two corresponding CBR models are constructed by combining principles of the Electre decision-aiding method with CBR. The first one, named Electre-CBR-I, derives from evidence supporting the assertion. The other one, named Electre-CBR-II, derives from both evidence supporting and evidence vetoing the assertion. Leave-one-out cross-validation and hold-out method are integrated to form 30-times hold-out method. In financial distress mining, data was collected from Shanghai and Shenzhen Stock Exchanges, ANOVA was employed to select features that are significantly different between companies in distress and health, 30-times hold-out method was used to assess predictive performance, and grid-search technique was utilized to search optimal parameters. Original data distributions were kept in the experiment. Empirical results of long-term financial distress prediction with 30 initial financial ratios and 135 initial pairs of samples indicate that Electre-CBR-I outperforms Electre-CBR-II and other comparative CBR models, and Electre-CBR-II outperforms the other comparative CBR models.     

A case-based fuzzy multicriteria decision support model for tropical cyclone forecasting

This paper proposes a multi-stage framework for intelligent decision support. The proposed framework integrates case-based reasoning and fuzzy multicriteria decision making techniques. It potentially leads to more accurate, flexible and efficient retrieval of alternatives that are most similar and most useful to the current decision situation. Additionally, the framework provides intelligent assistance in articulating domain expert's preferences through outranking relations. We illustrated the proposed approach in the context of tropical cyclone prediction. Ten years of historical observation data about tropical cyclones was represented within fuzzy multicriteria decision-making problem. We describe a prototype intelligent decision support system, which helps the forecaster in retrieving best-fitted solutions in terms of both usefulness and similarity to the current observed case.     

A hybrid heuristic ordering and variable neighbourhood search for the nurse rostering problem

This paper is concerned with the development of intelligent decision support methodologies for nurse rostering problems in large modern hospital environments. We present an approach which hybridises heuristic ordering with variable neighbourhood search. We show that the search can be extended and the solution quality can be significantly improved by the careful combination and repeated use of heuristic ordering, variable neighbourhood search and back-tracking. The amount of computational time that is allowed plays a significant role and we analyse and discuss this. The algorithms are evaluated against a commercial Genetic Algorithm on commercial data. We demonstrate that this methodology can significantly outperform the commercial algorithm. This paper is one of the few in the scientific nurse rostering literature which deal with commercial data and which compare against a commercially implemented algorithm.     

Explanation of exceptional values in multi-dimensional business databases

In this paper, we describe an extension of the OnLine Analytical Processing (OLAP) framework with causal explanation, offering the possibility to automatically generate explanations for exceptional cell values. This functionality can be built into conventional OLAP databases using a generic explanation formalism, which supports the work of managers in diagnostic processes. The central goal is the identification of specific knowledge structures and reasoning methods required to construct computerized explanations from multi-dimensional data and business models. The methodology was tested on a case study involving the comparison of financial figures of a firm’s business units. The findings suggest improved decision-making by managers because the current tedious and error-prone manual analysis process is enhanced by automated problem identification and explanation generation. It is also noted that this novel methodology has general utility for decision-support systems, for example, for automated diagnosis in the financial and accountancy domain.     

An incentive-compatible solution for trade credit term incorporating default risk

This paper studies the optimal trade credit term decision in an extended economic ordering quantity (EOQ) framework that incorporates a default risk component. A principal-agent bilevel programming model with costs minimization objectives is set up to derive the incentive-compatible credit term. The supplier determines the credit term as the leader in the first level programming, by balancing her/his financing capacity with the retailer’s default risk, order behavior and cost shifting. At the second level, the retailer makes decisions on ordering and payment time by reacting on the term offered by the supplier. A first order condition solution procedure is derived for the bilevel programming when credit term is confined within the practically feasible interval. Two key results are obtained – the condition to derive incentive-compatible credit term, and an equation system to derive threshold default risk criterion filtering retailers suitable for credit granting. Numerical experiments show that the capital cost of the supplier is the most important factor determining the credit term. Default risk acts like a filtering criterion for selecting retailers suitable for credit granting. Empirical evidence supporting our theoretical considerations is obtained by estimating three panel econometric models, using a dataset from China’s listed companies.     

Prediction of financial distress: An empirical study of listed Chinese companies using data mining

The deterioration in profitability of listed companies not only threatens the interests of the enterprise and internal staff, but also makes investors face significant financial loss. It is important to establish an effective early warning system for prediction of financial crisis for better corporate governance. This paper studies the phenomenon of financial distress for 107 Chinese companies that received the label ‘special treatment’ from 2001 to 2008 by the Shanghai Stock Exchange and the Shenzhen Stock Exchange. We use data mining techniques to build financial distress warning models based on 31 financial indicators and three different time windows by comparing these 107 firms to a control group of firms. We observe that the performance of neural networks is more accurate than other classifiers, such as decision trees and support vector machines, as well as an ensemble of multiple classifiers combined using majority voting. An important contribution of the paper is to discover that financial indicators, such as net profit margin of total assets, return on total assets, earnings per share, and cash flow per share, play an important role in prediction of deterioration in profitability. This paper provides a suitable method for prediction of financial distress for listed companies in China.     

On the evolution of an intelligent maintenance optimization system

In this paper the author reviews the development of an intelligent maintenance optimization system over the past 16 years. The paper starts with discussion of the initial motivation behind developing the system and the designs of the early versions of a computer program to access maintenance history data and provide an analysis. The concept behind this system was gradually developed to incorporate a rule base for the selection of a suitable model for preventive maintenance (PM) scheduling and then to a fully developed knowledge-based system for decision support. The need to incorporate case-based reasoning thus creating a hybrid system that can learn with use in addition to using elicited knowledge from experts is discussed. The experience with system validation with two versions of the system is analysed. The paper also reviews the extensive fundamental work on developing appropriate PM models that can deal with real data patterns. Finally, the scope for future development is presented.     

Integration and dimensional modeling approaches for complex data warehousing

With the broad development of the World Wide Web, various kinds of heterogeneous data (including multimedia data) are now available to decision support tasks. A data warehousing approach is often adopted to prepare data for relevant analysis. Data integration and dimensional modeling indeed allow the creation of appropriate analysis contexts. However, the existing data warehousing tools are well-suited to classical, numerical data. They cannot handle complex data. In our approach, we adapt the three main phases of the data warehousing process to complex data. In this paper, we particularly focus on two main steps in complex data warehousing. The first step is data integration. We define a generic UML model that helps representing a wide range of complex data, including their possible semantic properties. Complex data are then stored in XML documents generated by a piece of software we designed. The second important phase we address is the preparation of data for dimensional modeling. We propose an approach that exploits data mining techniques to assist users in building relevant dimensional models.     

Executive views concerning decision support tools

Support tools for strategic-level decision-making have become increasingly popular. This study investigates the role of OR/MS tools in today’s strategic-level decision support tool market. Executives working in Finland’s 500 largest companies were asked about the decision support tools they use when making major decisions. The responses received indicated that executives actively use a variety of tools, and an average of five different strategic-level tools. Approximately 10% of the tools used could be identified as OR/MS type, these often suit the needs of larger companies with strategic logistical or production functions and compared to other tools, have a specific profile. Executives see advantages in using tools that provide cognitive, collaboration and communication possibilities, and also in using tools that make processes more efficient. OR methodologies have influenced some of the other tools on the market, but ‘soft OR’ tool usage could not be identified. Tools which support creativity are needed.     

A methodology for supporting strategy implementation based on the VSM: A case study in a Latin-American multi-national

Soft OR tools have increasingly been used to support the strategic development of companies at operational and managerial levels. However, we still lack OR applications that can be useful in dealing with the “implementation gap”, understood as the scarcity of resources available to organizations seeking to align their existing processes and structures with a new strategy. In this paper we contribute to filling that gap, describing an action research case study where we supported strategy implementation in a Latin American multinational corporation through a soft OR methodology. We enhanced the ‘Methodology to support organizational self-transformation’, inspired by the Viable System Model, with substantive improvements in data collection and analyses. Those adjustments became necessary to facilitate second order learning and agreements on required structural changes among a large number of participants. This case study contributes to the soft OR and strategy literature with insights about the promise and constraints of this soft OR methodology to collectively structure complex decisions that support organizational redesign and strategy implementation.     

Subagging for credit scoring models

The logistic regression framework has been for long time the most used statistical method when assessing customer credit risk. Recently, a more pragmatic approach has been adopted, where the first issue is credit risk prediction, instead of explanation. In this context, several classification techniques have been shown to perform well on credit scoring, such as support vector machines among others. While the investigation of better classifiers is an important research topic, the specific methodology chosen in real world applications has to deal with the challenges arising from the real world data collected in the industry. Such data are often highly unbalanced, part of the information can be missing and some common hypotheses, such as the i.i.d. one, can be violated. In this paper we present a case study based on a sample of IBM Italian customers, which presents all the challenges mentioned above. The main objective is to build and validate robust models, able to handle missing information, class unbalancedness and non-iid data points. We define a missing data imputation method and propose the use of an ensemble classification technique, subagging, particularly suitable for highly unbalanced data, such as credit scoring data. Both the imputation and subagging steps are embedded in a customized cross-validation loop, which handles dependencies between different credit requests. The methodology has been applied using several classifiers (kernel support vector machines, nearest neighbors, decision trees, Adaboost) and their subagged versions. The use of subagging improves the performance of the base classifier and we will show that subagging decision trees achieve better performance, still keeping the model simple and reasonably interpretable.     

Multistage decision-making fuzzy methodology for optimal investments based on experts’ evaluations

A new methodology of making a decision on an optimal investment in several projects is proposed. The methodology is based on experts’ evaluations and consists of three stages. In the first stage, Kaufmann’s expertons method is used to reduce a possibly large number of applicants for credit. Using the combined expert data, the credit risk level is determined for each project. Only the projects with low risks are selected.     

Modeling international investment decisions for financial holding companies

This research analyzes the internationalization process model developed by Johanson and Vahlne and derives two integer programming investment decision models that consider the risk attitudes of investment firms. Johanson and Vahlne’s model provides a starting point for building a model that suits the investment approach and decision making process of financial holding companies. In practice, when firms make an international investment decision, there is a need for a model that can generate outputs based on financial measures such as profit, investment returns, and tolerable levels of risk. Thus, in this paper, Johanson and Vahlne’s concepts are studied and financial managers are interviewed to derive models that match the investment decision procedures of the firms. The model helps firms manage the risks of their investments and derive accurate investment strategies based on investment objectives and constraints.     

Expert systems approach to decision support

An approach to building decision support systems based on expert systems methods is proposed. The relatively weak basic assumptions include only stationarity (repeatability) of the decision in the same environment (circumstances) and ordering of the values of all the attributes with regard to the decision maker's preferences. The proposed approach is aimed at reflecting the experienced domain expert's and decision maker's knowledge and preferences, both in the form of facts and rasoning rules. Among the purposes of the described class of decision support systems there are the storage and retrieval of the expert's knowledge and decisions, decision making support and ranking of admissible decision alternatives. A general model of the decision process is proposed and a language for representation of the expert's knowledge is introduced in brief. The structure, reasoning control, and an example of application of the proposed system are discussed and possible further extensions are pointed out.     

A reference model for customer-centric data mining with support vector machines

Supervised classification is an important part of corporate data mining to support decision making in customer-centric planning tasks. The paper proposes a hierarchical reference model for support vector machine based classification within this discipline. The approach balances the conflicting goals of transparent yet accurate models and compares favourably to alternative classifiers in a large-scale empirical evaluation in real-world customer relationship management applications. Recent advances in support vector machine oriented research are incorporated to approach feature, instance and model selection in a unified framework.     

Multiple-retrieval case-based reasoning for course timetabling problems

The structured representation of cases by attribute graphs in a case-based reasoning (CBR) system for course timetabling has been the subject of previous research by the authors. In that system, the case base is organized as a decision tree and the retrieval process chooses those cases that are sub-attribute graph isomorphic to the new case. The drawback of that approach is that it is not suitable for solving large problems. This paper presents a multiple-retrieval approach that partitions a large problem into small solvable sub-problems by recursively inputting the unsolved part of the graph into the decision tree for retrieval. The adaptation combines the retrieved partial solutions of all the partitioned sub-problems and employs a graph heuristic method to construct the whole solution for the new case. We present a methodology which is not dependent upon problem-specific information and which, as such, represents an approach which underpins the goal of building more general timetabling systems. We also explore the question of whether this multiple-retrieval CBR could be an effective initialization method for local search methods such as hill climbing, tabu search and simulated annealing. Significant results are obtained from a wide range of experiments. An evaluation of the CBR system is presented and the impact of the approach on timetabling research is discussed. We see that the approach does indeed represent an effective initialization method for these approaches.     

DEA based dimensionality reduction for classification problems satisfying strict non-satiety assumption

This study shows how data envelopment analysis (DEA) can be used to reduce vertical dimensionality of certain data mining databases. The study illustrates basic concepts using a real-world graduate admissions decision task. It is well known that cost sensitive mixed integer programming (MIP) problems are NP-complete. This study shows that heuristic solutions for cost sensitive classification problems can be obtained by solving a simple goal programming problem by that reduces the vertical dimension of the original learning dataset. Using simulated datasets and a misclassification cost performance metric, the performance of proposed goal programming heuristic is compared with the extended DEA-discriminant analysis MIP approach. The holdout sample results of our experiments shows that the proposed heuristic approach outperforms the extended DEA-discriminant analysis MIP approach.     

From decision theory to decision aiding methodology

The paper presents the author’s partial and personal historical reconstruction of how decision theory is evolving to a decision aiding methodology. The presentation shows mainly how “alternative” approaches to classic decision theory evolved. In the paper it is claimed that all such decision “theories” share a common methodological feature, which is the use of formal and abstract languages as well as of a model of rationality. Different decision aiding approaches can thus be defined, depending on the origin of the model of rationality used in the decision aiding process. The concept of decision aiding process is then introduced and analysed. The paper’s ultimate claim is that all such decision aiding approaches can be seen as part of a decision aiding methodology.