Mixing OR methods in practice: Past, present and future directions

Although mixing of OR methods is an area of increasing interest to the OR community, there has been little discussion regarding generic lessons that can be learnt from mixing methods in practice. The aim of this paper is to carry out such an analysis through considering generic lessons that may be associated with mixing methods, regardless of the methods chosen. To identify these lessons, published case studies on how OR methods have been mixed are analysed giving rise to a number of themes revealing the lessons. These themes include; the implications from the use of different facilitators/modellers, how methods have been mixed together, the nature of the modelling interventions, the client value and the rationale given for mixing methods. The paper discusses the lessons learnt in each of these themes and presents opportunities for future work.     

Community facilitation of problem structuring and decision making processes: Experiences from the EU LEADER+ programme

This paper reports on the work carried out supporting a rural community in Denmark under the LEADER+ programme. This is a programme that supports development in particularly vulnerable rural regions of the European countries members of EU. It supports creative and innovative projects that can contribute to long-term and sustainable development in these regions. The main tasks have been the organisation and facilitation of conferences and workshops to structure the problematic situation of identifying and designing innovative projects for the development of the community and to support decision making processes related to the agreement on action plans. Learning to design, plan, manage and facilitate conferences and workshops have also being another central activity. The main purpose of these conferences and workshops was not only problem structuring and decision making in connection with community development but also the transfer of facilitation skills and appropriate methods to the community.     

Understanding problem structuring methods interventions

This article presents a conceptual framework and methodological guide for researching and understanding OR interventions particularly problem structuring methods (PSM). The article argues that OR/PSM interventions are complex events which can not be understood by traditional approaches alone. In this paper an alternative methodology is developed, where the units of analysis are the narratives and networks produced during PSM interventions. The paper outlines the main theoretical and methodological concerns that need to be appreciated in studying PSM interventions. The paper then explores actor-network theory and narrative analysis as approaches to study them. A case study describing the use of these approaches is provided.     

WASAN: The development of a facilitated methodology for structuring a waste minimisation problem

This paper contributes a new methodology called Waste And Source-matter ANalyses (WASAN) which supports a group in building agreeable actions for safely minimising avoidable waste. WASAN integrates influences from the Operational Research (OR) methodologies/philosophies of Problem Structuring Methods, Systems Thinking, simulation modelling and sensitivity analysis as well as industry approaches of Waste Management Hierarchy, Hazard Operability (HAZOP) Studies and As Low As Reasonably Practicable (ALARP). The paper shows how these influences are compiled into facilitative structures that support managers in developing recommendations on how to reduce avoidable waste production. WASAN is being designed as Health and Safety Executive Guidance on what constitutes good decision making practice for the companies that manage nuclear sites. In this paper we report and reflect on its use in two soft OR/problem structuring workshops conducted on radioactive waste in the nuclear industry.     

A problem structuring method for ecosystem-based management: The DPSIR modelling process

The purpose of this paper is to learn from Complex Adaptive Systems (CAS) theory to inform the development of Problem Structuring Methods (PSMs) both in general and in the specific context of marine management. The focus on marine management is important because it is concerned with a CAS (formed through the interconnection between natural systems, designed systems and social systems) which exemplifies their particularly ‘wicked’ nature. Recognition of this compels us to take seriously the need to develop tools for knowledge elicitation and structuring which meet the demands of CAS. In marine management, chief among those tools is the DPSIR (Drivers – Pressures – State Changes – Impacts – Responses) model and, although widely applied, the extent to which it is appropriate for dealing with the demands of a CAS is questionable. Such questioning is particularly pertinent in the context of the marine environment where there is a need to not only recognise a broad range of stakeholders (a question of boundary critique) but also to manage competing knowledge (economic, local and scientific) and value claims. Hence this paper emphasises how a CAS perspective might add impetus to the development of a critical perspective on DPSIR and PSM theory and practice to promote a more systemic view of decision-making and policy development.     

Towards a new framework for evaluating systemic problem structuring methods

Operational researchers and social scientists often make significant claims for the value of systemic problem structuring and other participative methods. However, when they present evidence to support these claims, it is usually based on single case studies of intervention. There have been very few attempts at evaluating across methods and across interventions undertaken by different people. This is because, in any local intervention, contextual factors, the skills of the researcher and the purposes being pursued by stakeholders affect the perceived success or failure of a method. The use of standard criteria for comparing methods is therefore made problematic by the need to consider what is unique in each intervention. So, is it possible to develop a single evaluation approach that can support both locally meaningful evaluations and longer-term comparisons between methods? This paper outlines a methodological framework for the evaluation of systemic problem structuring methods that seeks to do just this.     

Critical rationalism in practice: Strategies to manage subjectivity in OR investigations

The philosophical position referred to as critical rationalism (CR) is potentially important to OR because it holds out the possibility of supporting OR’s claim to offer managers a scientifically ‘rational’ approach. However, as developed by Karl Popper, and subsequently extended by David Miller, CR can only support practice (deciding what to do, how to act) in a very limited way; concentrating on the critical application of deductive logic, the crucial role of subjective judgements in making technical and moral choices are ignored or are at least left underdeveloped. By reflecting on the way that managers, engineers, administrators and other professionals take decisions in practice, three strategies are identified for handling the inevitable subjectivity in practical decision-making. It is argued that these three strategies can be understood as attempts to emulate the scientific process of achieving intersubjective consensus, a process inherent in CR. The perspective developed in the paper provides practitioners with a way of understanding their clients’ approach to decision-making and holds out the possibility of making coherent the claim that they are offering advice on how to apply a scientific approach to decision-making; it presents academics with some philosophical challenges and some new avenues for research.     

The non-codified use of problem structuring methods and the need for a generic constitutive definition

When we use a PSM what is it we are actually doing? An answer to this question would enable the PSM community to considerably enlarge the available source of case studies by the inclusion of examples of non-codified PSM use. We start from Checkland’s own proposal for a “constitutive definition” of SSM, which originated from trying to answer the question of knowing when a claim of SSM use was legitimate. By extending this idea to a generic constitutive definition for all PSMs leads us to propose a self-consistent labelling schema for observed phenomena arising from PSMs in action. This consists of a set of testable propositions, which, through observation of putative PSM use, can be used to assess validity of claims of PSM use. Such evidential support for the propositions as may be found in putative PSM use can then make it back into a broader axiomatic formulation of PSMs through the use of a set-theoretic approach, which enables our method to scale to large data sets. The theoretical underpinning to our work is in causal realism and middle range theory. We illustrate our approach through the analysis of three case studies drawn from engineering organisations, a rich source of possible non-codified PSM use. The combination of a method for judging cases of non-codified PSM use, sound theoretical underpinning, and scalability to large data sets, we believe leads to a demystification of PSMs and should encourage their wider use.     

Soft OR in China: A critical report

As China’s reform steps into the ‘deep water zone’ where value complexity becomes paramount, general-purpose decision-making aids such as Operational Research (OR) are increasingly confronted with the challenge of dealing with interest conflicts. However, due to historical events and institutional circumstances, OR in China to date is largely constrained by a technocratic approach which is not fit for purpose. Encouragingly, recent OR innovations inside China signify a conscious move to embrace value plurality and tackle social conflicts. OR is not merely a neutral tool for solving technical problems, but a world-building discourse that shapes society. The future of OR, particularly Soft OR, in China will be determined by whether OR workers are willing and capable to act as institutional entrepreneurs promoting scientific and democratic decision-making that deepens the reform toward an open, just and prosperous society. The implications go beyond the OR community and China’s borders.     

On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems

We point out the need for Behavioral Operational Research (BOR) in advancing the practice of OR. So far, in OR behavioral phenomena have been acknowledged only in behavioral decision theory but behavioral issues are always present when supporting human problem solving by modeling. Behavioral effects can relate to the group interaction and communication when facilitating with OR models as well as to the possibility of procedural mistakes and cognitive biases. As an illustrative example we use well known system dynamics studies related to the understanding of accumulation. We show that one gets completely opposite results depending on the way the phenomenon is described and how the questions are phrased and graphs used. The results suggest that OR processes are highly sensitive to various behavioral effects. As a result, we need to pay attention to the way we communicate about models as they are being increasingly used in addressing important problems like climate change.     

Structuring decision problems: A case study and reflections for practitioners

This article reviews several approaches to problem structuring and, in particular, the three-step structuring process for decision analysis proposed by von Winterfeldt and Edwards: (1) identifying the problem; (2) selecting an appropriate analytical approach; (3) developing the a detailed analytic structure. This three-step process is re-examined in the context of a decision analysis of alternative policies to reduce electromagnetic field exposure from electric power lines. This decision analysis was conducted for a public health organization funded by the California Public Utilities Commission and it was scrutinized throughout by interested stakeholders. As a result a significant effort went into structuring this problem appropriately, with some successes and some missteps. The article extracts lessons from this experience, updating existing guidance on structuring problems for decision analysis, and concluding with some general insights for problem structuring.     

Issues Mapping: A problem structuring method for addressing science and technology conflicts

There are new opportunities for the application of problem structuring methods to address science and technology risk conflicts through stakeholder dialogue. Most previous approaches to addressing risk conflicts have been developed from a traditional risk communication perspective, which tends to construct engagement between stakeholders based on the assumption that scientists evaluate technologies using facts, and lay participants do so based on their values. ‘Understanding the facts’ is generally privileged, so the value framings of experts often remain unexposed, and the perspectives of lay participants are marginalized. When this happens, risk communication methodologies fail to achieve authentic dialogue and can exacerbate conflict. This paper introduces ‘Issues Mapping’, a problem structuring method that enables dialogue by using visual modelling techniques to clarify issues and develop mutual understanding between stakeholders. A case study of the first application of Issues Mapping is presented, which engaged science and community protagonists in the genetic engineering debate in New Zealand. Participant and researcher evaluations suggest that Issues Mapping helped to break down stereotypes of both scientists and environmental activists; increased mutual understanding; reduced conflict; identified common ground; started building trust; and supported the emergence of policy options that all stakeholders in the room could live with. The paper ends with some reflections and priorities for further research.     

OR in healthcare: A European perspective

The European Working Group “Operational Research Applied to Health Services” (ORAHS) is one of the domain specific EURO Working Groups organized by EURO - the European Association of Operational Research Societies. In this paper we report on the development of ORAHS as a platform for OR in health, and analyse the papers presented at meetings over the 35 years of its existence. We propose a two-way framework for analysis, where one dimension is the nine stages of the product life cycle: identifying consumer requirements, designing a new service to meet these requirements, forecasting demand for such a service, securing resources for it, allocating these resources, developing Programs & Plans to use these resources for delivering the service, establishing criteria for service delivery, managing the performance of the service, and finally, evaluating its performance. The other dimension is a three-level classification into broad application areas referring to processes at different levels in healthcare: Patients & Providers, Units & Hospitals, and Regional & National. We use this framework to carry out a quantitative analysis of all the papers presented during the meetings of ORAHS since its inception in 1975. We then describe developments over this period in applying OR approaches and techniques to healthcare, and present an overview of the main application areas and challenges.     

An MCDA approach for the selection of bike projects based on structuring and appraising activities

This paper presents an MCDA approach for the structuring and appraising activities of a large and complex decision problem. More specifically, the paper makes use of the three-step structuring process for decision analysis proposed by von Winterfeldt and Edwards: (1) identifying the problem; (2) selecting an appropriate analytic approach; and (3) developing a detailed analytic structure. For illustration of the approach a case study dealing with the assessment task of prioritising and selecting initiatives and projects from a public pool with limited funds is examined throughout the paper. The process is embedded in a Decision Support System (DSS) making use of the REMBRANDT technique for pair wise comparisons to determine project rankings. A procedure for limiting the number of pair wise comparisons to be made in the process is in this connection presented. Finally, strengths and weaknesses in the approach are discussed and conclusions are made.     

Making decisions in the absence of clear facts

Bennis and O’Toole [Bennis, W.G., O’Toole, J., 2005. How business schools lost their way. Harvard Business Review 83, 96–104] have recently argued that decision makers need guidance in ‘making decisions in the absence of clear facts’. As such, decision makers must be able to resourcefully use whatever limited information is available and advantageously portray its implications. Based on recently published theory which directly addresses this requirement, this paper demonstrates, through a practical example, how decision makers can make systemic decisions in situations characterized by extremely limited information and, furthermore, what form such decisions can take. Evidence is provided, therefore, that operational research can effectively address what appears to be a gap in management training.     

Spatial structuring and the development of number sense: A case study of young children working with blocks

This case study discusses an activity that makes up one of five lessons in an ongoing classroom teaching experiment. The goal of the teaching experiment is (a) to gain insight into kindergartners’ spatial structuring abilities, and (b) to design an educational setting that can support kindergartners in becoming aware of spatial structures and in learning to apply spatial structuring as a means to abbreviate and ultimately elucidate numerical procedures. This paper documents children's spatial structuring of three-dimensional block constructions and the teacher's role in guiding the children's learning processes. The episodes have contributed to developing the activity into a lesson that could foster children's use of spatial structure for determining the number of blocks. The observations complement existing research that relates spatial structuring to mathematical performance, with additional insight into the development of number sense of particularly young children in a regular classroom setting.     

The SEXTANT software: A tool for automating the comparative analysis of mental models of dynamic systems

The comparison of mental models of dynamic systems improves our understanding of how people comprehend, interpret, and subsequently influence dynamic management tasks. Approaches to comparing mental models currently used in managerial and organizational cognition research, especially the distance-ratio and the closeness-approaches, have been criticized for not considering essential characteristics of dynamic managerial situations. This paper builds on a recent analysis method developed to compare mental models of dynamics systems, and introduces this mathematical approach to management and organizational researchers by means of the SEXTANT software. It presents the process of mental model elicitation, analysis, comparison, and interpretation. An example with four elicited mental models illustrates the software’s features to analyze and present the results. Then, the software is compared with existing software to map and compare mental models. Our conclusion is that SEXTANT marks a significant step in enabling large-scale studies about mental models of dynamic systems.     

Structuring an MCDA model using SSM: A case study in energy efficiency

This work presents the use of a problem structuring method, Soft Systems Methodology (SSM), to structure a Multi-Criteria Decision Analysis (MCDA) model, aimed at appraising energy efficiency initiatives. SSM was useful to help defining clearly the decision problem context and the main actors involved, as well as to unveil the relevant objectives for each stakeholder. Keeney’s Value Focused Thinking approach was then used to refine and structure the list of objectives according to the perspective of the main evaluators identified. In addition to describing this particular case study, this paper aims at providing some general guidelines on how SSM may facilitate the emergence of objectives for MCDA models.     

Convergence of an Alternating Method to Solve the Cauchy Problem for Poisson's Equation

This work concerns the development of iterative algorithms for the solution of the Cauchy problem for the Poisson equation. We accelerate the process proposed by Kozlov et al. [V.A. Kozlov, V.G. Maz'ya and A.V. Fomin (1991). An iterative method for solving the Cauchy problem for elliptic equations. Comput. Maths. Phys. , 31 (1), 45-52.] by making use of a relaxation of the Dirichlet data. We provide theoretical justification of the convergence of the new algorithm, and present some results of numerical experiments with the method.     

Some perturbation results for the Linear Complementarity Problem

It has been shown previously that the Linear Complementarity Problem is stable when the defining matrix is positive semidefinite and when (locally) the set of solutions is nonempty and bounded. We enlarge the class of matrices for which this is true and also demonstrate how the boundedness condition leads to other stability type questions.