Structuring problems for multi-criteria decision analysis in practice: a literature review of method combinations. (English) Zbl 1380.91063

Summary: Structuring problems for multi-criteria decision analysis (MCDA) has attracted increasing attention over the past 20 years from both a conceptual and a practical perspective. This is reflected in a significant growth in the number of published applications which use a formal approach to problem structuring in combination with an analytic method for multi-criteria analysis. The problem structuring approaches (PSMs) include general methodologies such as Checkland’s soft systems method (SSM), Eden and Ackermann’s strategic options design and analysis (SODA) and other methods that focus on a particular aspect. We carried out a literature review that covers eight PSMs (cognitive and causal maps, DPSIR, scenario planning, SSM, stakeholder analysis, strategic choice approach, SODA and SWOT) and seven MCDA methods (AHP, ANP, ELECTRE, MAUT, MAVT, PROMETHEE and TOPSIS). We first identified and analysed 333 articles published during 2000–2015, then selected 68 articles covering all PSM-MCDA combinations, which were studied in detail to understand the associated processes, benefits and challenges. The three PSMs most commonly combined with MCDA are SWOT, scenario planning and DPSIR. AHP was by far the most commonly applied MCDA method. Combining PSMs with MCDA produces a richer view of the decision situation and enables more effective support for different phases of the decision-making process. Some limitations and challenges in combining PSMs and MCDA are also identified, most importantly relating to building a value tree and assigning criteria weights.


91B06 Decision theory
91-02 Research exposition (monographs, survey articles) pertaining to game theory, economics, and finance
Full Text: DOI Link


[1] Ackermann, F.; Eden, C., Strategic options development and analysis (2010), Springer: Springer London
[2] Adrianto, L.; Matsuda, Y.; Sakuma, Y., Assessing local sustainability of fisheries system: a multi-criteria participatory approach with the case of Yoron Island, Kagoshima prefecture, Japan, Marine Policy, 29, 9-23 (2005)
[3] Akbulak, C.; Cengiz, T., Determining ecotourism strategies using A’WOT hybrid method: case study of Troia Historical National Park, Çanakkale, Turkey, International Journal of Sustainable Development & World Ecology, 21, 380-388 (2014)
[4] Azarnivand, A.; Chitsaz, N., Adaptive policy responses to water shortage mitigation in the arid regions—a systematic approach based on eDPSIR, DEMATEL, and MCDA, Environmental Monitoring and Assessment, 187 (2015)
[5] Bana e. Costa, C. A.; Ensslin, L.; Correa, E. C.; Vansnick, J. C., Decision Support Systems in action: integrated application in a multicriteria decision aid process, European Journal of Operational Research, 113, 315-335 (1999) · Zbl 0957.90072
[6] Bana e. Costa, C. A.; Fernandes, T. G.; Correia, P. V.D., Prioritisation of public investments in social infra-structures using multicriteria value analysis and decision conferencing: a case-study, International Transactions in Operational Research, 13, 279-297 (2006) · Zbl 1184.91115
[7] Bana e. Costa, C. A.; Lourenco, J. C.; Oliveira, M. D.; Bana e. Costa, J. C., A socio-technical approach for group decision support in public strategic planning: the Pernambuco PPA case, Group Decision and Negotiation, 23, 5-29 (2014)
[8] Bana e. Costa, C. A.; Vansnick, J. C., The Macbeth approach: basic ideas, software, and an application, Advances in Decision Analysis, 4, 131-157 (1999) · Zbl 0934.90043
[9] Banville, C.; Landry, M.; Martel, J. M.; Boulaire, C., A stakeholder approach to MCDA, Systems Research and Behavioral Science, 15, 15-32 (1998)
[10] Baykasoğlu, A.; Gölcuk, I., Development of a novel multiple-attribute decision making model via fuzzy cognitive maps and hierarchical fuzzy TOPSIS, Information Sciences, 301, 75-98 (2015)
[11] Behzadian, M.; Kazemzadeh, R. B.; Albadvi, A.; Aghdasi, M., PROMETHEE: a comprehensive literature review on methodologies and applications, European Journal of Operational Research, 200, 198-215 (2010) · Zbl 1189.90074
[12] Behzadian, M.; Khanmohammadi Otaghsara, S.; Yazdani, M.; Ignatius, J., A state-of the-art survey of TOPSIS applications, Expert Systems with Applications, 39, 13051-13069 (2012)
[13] Belton, V.; Ackermann, F.; Shepherd, I. A.N., Integrated support from problem structuring through to alternative evaluation using COPE and V•I•S•A, Journal of Multi-Criteria Decision Analysis, 6, 115-130 (1997) · Zbl 0900.90309
[14] Belton, V.; Stewart, T. J., Multiple criteria decision analysis - An integrated approach (2002), Kluwer: Kluwer Boston
[15] Belton, V.; Stewart, T. J., Problem structuring and multiple criteria decision analysis, (Ehrgott, M.; Figueira, J. R.; Greco, S., Trends in multiple criteria decision analysis (2010), Springer) · Zbl 1200.90122
[16] Benini, L.; Bandini, V.; Marazza, D.; Contin, A., Assessment of land use changes through an indicator-based approach: a case study from the Lamone river basin in Northern Italy, Ecological Indicators, 10, 4-14 (2010)
[17] Bhave, A. G.; Mishra, A.; Raghuwanshi, N. S., A combined bottom-up and top-down approach for assessment of climate change adaptation options, Journal of Hydrology, 518, 150-161 (2014)
[18] Bizikova, L.; Krcmar, E., Integrated scenario planning and multi-criteria decision analysis framework with application to forest planning, Open Journal of Forestry, 05, 139-153 (2015)
[19] Borzoni, M.; Rizzi, F.; Frey, M., Geothermal power in Italy: a social multi-criteria evaluation, Renewable Energy, 69, 60-73 (2014)
[20] Bottero, M., A multi-methodological approach for assessing sustainability of urban projects, Management of Environmental Quality: An International Journal, 26, 138-154 (2015)
[21] Bottero, M.; Ferretti, V., An analytic network process-based approach for location problems the case of a new waste incinerator plant in the Province of Torino (Italy), Journal of Multi-Criteria Decision Analysis, 17, 63-84 (2010)
[22] Brans, J. P.; Vincke, P.; Mareschal, B., How to select and how to rank projects - The PROMETHEE method, European Journal of Operational Research, 24, 228-238 (1986) · Zbl 0576.90056
[23] Catron, J.; Stainback, G. A.; Dwivedi, P.; Lhotka, J. M., Bioenergy development in Kentucky: a SWOT-ANP analysis, Forest Policy and Economics, 28, 38-43 (2013)
[24] Cerreta, M.; Panaro, S.; Cannatella, D., Multidimensional spatial decision-making process: local shared values in action, Computational Science and Its Applications - Iccsa 2012, Pt Ii, 7334, 54-70 (2012)
[25] Checkland, P.; Scholes, J., Soft systems methodology in action (1990), John Wiley: John Wiley New York
[26] Chung, E. S.; Lee, K. S., Prioritization of water management for sustainability using hydrologic simulation model and multicriteria decision making techniques, Journal of Environmental Management, 90, 1502-1511 (2009)
[27] Coelho, D.; Antunes, C. H.; Martins, A. G., Using SSM for structuring decision support in urban energy planning, Technological and Economic Development of Economy, 16, 641-653 (2010)
[28] Comes, T.; Hiete, M.; Schultmann, F., An approach to multi-criteria decision problems under severe uncertainty, Journal of Multi-Criteria Decision Analysis, 48, 29-48 (2013)
[29] Cooper, P., Socio-ecological accounting: DPSWR, a modified DPSIR framework, and its application to marine ecosystems, Ecological Economics, 94, 106-115 (2013)
[30] Cuozzo, V., Integrated assessment for a sustainable valorization project, Italian Journal of Regional Science, 13, 71-92 (2014)
[31] Duchelle, A. E.; Guariguata, M. R.; Less, G.; Albornoz, M. A.; Chavez, A.; Melo, T., Evaluating the opportunities and limitations to multiple use of Brazil nuts and timber in Western Amazonia, Forest Ecology and Management, 268, 39-48 (2012)
[32] Durbach, I.; Stewart, T. J., Integrating scenario planning and goal programming, Journal of Multi-Criteria Decision Analysis, 12, 261-271 (2003) · Zbl 1205.90259
[33] Dyson, R. G., Strategic development and SWOT analysis at the University of Warwick, European Journal of Operational Research, 152, 631-640 (2004) · Zbl 1043.90526
[34] Eden, C., On the nature of cognitive maps, Journal of Management Studies, 29, 261-265 (1992)
[35] Eden, C.; Ackermann, F., Detecting emergent strategizing: working with strategy making teams - the oval mapping technique making strategy, The Journey of Strategic Management (1998), Sage Publications
[36] Europe’s environment: The Dobris assessment (1995), European Environmental Agency: European Environmental Agency Copenhagen
[37] Eisenführ, F.; Weber, M.; Langer, T., Rational decision making (2010), Springer: Springer Berlin · Zbl 1200.90006
[38] Ekmekçioglu, M.; Can Kutlu, A.; Kahraman, C., A fuzzy multi-criteria SWOT analysis: an application to nuclear power plant site selection, International Journal of Computational Intelligence Systems, 4, 583-595 (2011)
[39] Ensslin, L.; Dutra, A.; Ensslin, S. R., MCDA: a constructivist approach to the management of human resources at a governmental agency, International Transactions in Operational Research, 7, 79-100 (2000)
[40] Fassio, A.; Giupponi, C.; Hiederer, R.; Simota, C., A decision support tool for simulating the effects of alternative policies affecting water resources: an application at the European scale, Journal of Hydrology, 304, 462-476 (2005)
[41] Ferreira, F. A.F.; Santos, S. P.; Rodrigues, P. M.M., Adding value to bank branch performance evaluation using cognitive maps and MCDA: a case study, Journal of the Operational Research Society, 62, 1320-1333 (2011)
[42] Ferreira, F. A.F.; Spahr, R. W.; Santos, S. P.; Rodrigues, P. M.M., A multiple criteria framework to evaluate bank branch potential attractiveness, International Journal of Strategic Property Management, 16, 254-276 (2012)
[43] Franco, L. A.; Lord, E., Understanding multi-methodology: evaluating the perceived impact of mixing methods for group budgetary decisions, Omega, 39, 362-372 (2011)
[44] Franco, L. A.; Montibeller, G., Facilitated modelling in operational research, European Journal of Operational Research, 205, 489-500 (2010) · Zbl 1188.90124
[45] Franco, L. A.; Montibeller, G., Problem structuring for multicriteria decision analysis interventions (2011), John Wiley & Sons, Inc: John Wiley & Sons, Inc Oxford
[46] French, S.; Maule, J.; Papamichail, N., Decision behaviour, analysis and support (2009), Cambridge University Press: Cambridge University Press New York, NY
[47] French, S.; Simpson, L.; Atherton, E.; Belton, V.; Dawes, R.; Edwards, W., Problem formulation for multi-criteria decision analysis: report of a workshop, Journal of Multi-Criteria Decision Analysis, 7, 242-262 (1998) · Zbl 0910.90186
[48] Gamboa, G., Social multi-criteria evaluation of different development scenarios of the Aysén region, Ecological Economics, 59, 157-170 (2006)
[49] Gari, S. R.; Newton, A.; Icely, J. D., A review of the application and evolution of the DPSIR framework with an emphasis on coastal social-ecological systems, Ocean & Coastal Management, 103, 63-77 (2015)
[50] Garmendia, E.; Gamboa, G.; Franco, J.; Garmendia, J. M.; Liria, P.; Olazabal, M., Social multi-criteria evaluation as a decision support tool for integrated coastal zone management, Ocean & Coastal Management, 53, 385-403 (2010)
[51] Geneletti, D., Combining stakeholder analysis and spatial multicriteria evaluation to select and rank inert landfill sites, Waste Management, 30, 328-337 (2010)
[52] Ghazinoory, S.; Zadeh, A. E.; Memariani, A., Fuzzy SWOT analysis, Journal of Intelligent & Fuzzy Systems, 18, 99-108 (2007) · Zbl 1169.68602
[53] Giupponi, C.; Mysiak, J.; Fassio, A.; Cogan, V., MULINO-DSS: a computer tool for sustainable use of water resources at the catchment scale, Mathematics and Computers in Simulation, 64, 13-24 (2004) · Zbl 1031.92035
[54] Goodwin, P.; Wright, G., Enhancing strategy evaluation in scenario planning: a role for decision analysis, Journal of Management Studies, 38, 1-16 (2001)
[55] Goodwin, P.; Wright, G., Decision analysis for management judgment (2004), J. Wiley: J. Wiley Chichester
[56] Gregory, R.; Failing, L.; Harstone, M.; Long, G.; McDaniels, T.; Ohlson, D., Structured decision making: A practical guide to environmental management choices (2012), Wiley-Blackwell: Wiley-Blackwell Chichester
[57] Griffiths, A.; Wall, S., Economics for business and management. A student text (2004), Pearson Books
[58] Grimble, R.; Wellard, K., Stakeholder methodologies in natural resource management: a review of principles, contexts, experiences and opportunities, Agricultural Systems, 55, 173-193 (1997)
[59] Hermans, L. M.; Thissen, W. A.H., Actor analysis methods and their use for public policy analysts, European Journal of Operational Research, 196, 808-818 (2009)
[60] Ho, W., Integrated analytic hierarchy process and its applications - A literature review, European Journal of Operational Research, 186, 211-228 (2008) · Zbl 1146.90447
[61] Hodgkinson, G. P.; Bown, N. J.; Maule, A. J.; Glaister, K. W.; Pearman, A. D., Breaking the frame: an analysis of strategic cognition and decision making under uncertainty, Strategic Management Journal, 20, 977-985 (1999)
[62] Hodgkinson, G. P.; Maule, A. J.; Bown, N. J.; Pearman, A. D.; Glaister, K. W., Further reflections on the elimination of framing bias in strategic decision making, Strategic Management Journal, 23, 1069-1076 (2002)
[63] Howick, S.; Ackermann, F., Mixing OR methods in practice: past, present and future directions, European Journal of Operational Research, 215, 503-511 (2011)
[64] Huang, I. B.; Keisler, J.; Linkov, I., Multi-criteria decision analysis in environmental sciences: ten years of applications and trends, The Science of the Total Environment, 409, 3578-3594 (2011)
[65] Huang, H. F.; Kuo, J.; Lo, S. L., Review of PSR framework and development of a DPSIR model to assess greenhouse effect in Taiwan, Environmental Monitoring and Assessment, 177, 623-635 (2011)
[66] Hwang, C. L.; Yoon, K., Multiple attribute decision making: Methods and applications: A state-of-the-art survey (1981), Springer-Verlag: Springer-Verlag BerlinNew York · Zbl 0453.90002
[68] Johnston, R.; Cools, J.; Liersch, S.; Morardet, S.; Murgue, C.; Mahieu, M.; Zsuffa, I.; Uyttendaele, G. P., WETwin: a structured approach to evaluating wetland management options in data-poor contexts, Environmental Science & Policy, 34, 3-17 (2013)
[69] Kabir, G.; Sadiq, R.; Tesfamariam, S., A review of multi-criteria decision-making methods for infrastructure management, Structure and Infrastructure Engineering, 10, 1176-1210 (2014)
[70] Kahraman, C.; Demirel, N. C.; Demirel, T., Prioritization of e-government strategies using a SWOT-AHP analysis: the case of Turkey, European Journal of Information Systems, 16, 284-298 (2007)
[71] Kajanus, M.; Kangas, J.; Kurttila, M., The use of value focused thinking and the A’WOT hybrid method in tourism management, Tourism Management, 25, 499-506 (2004)
[72] Kajanus, M.; Leskinen, P.; Kurttila, M.; Kangas, J., Making use of MCDS methods in SWOT analysis—Lessons learnt in strategic natural resources management, Forest Policy and Economics, 20, 1-9 (2012)
[73] Kangas, J.; Kangas, A.; Leskinen, P.; Pykäläinen, J., MCDM methods in strategic planning of forestry on state-owned lands in Finland: applications and experiences, Journal of Multi-Criteria Decision Analysis, 10, 257-271 (2001) · Zbl 0999.91508
[74] Kaplan, R. S.; Norton, D. P., The balanced scorecard - measures that drive performance, Harvard Business Review, 70, 71-79 (1992)
[75] Karvetski, C. W.; Lambert, J. H., Evaluating deep uncertainties in strategic priority-setting with an application to facility energy investments, Systems Engineering, 15, 483-493 (2012)
[76] Karvetski, C. W.; Lambert, J. H.; Keisler, J. M.; Linkov, I., Integration of decision analysis and scenario planning for coastal engineering and climate change, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 41, 63-73 (2011)
[77] KarvetskI, C. W.; Lambert, J. H.; Linkov, I., Scenario and multiple criteria decision analysis for energy and environmental security of military and industrial installations, Integrated Environmental Assessment and Management, 7, 228-236 (2011)
[78] Keeney, R., Developing objectives and attributes, (Edwards, W.; Miles, R., F.; Von winterfeldt, D., Advances in decision analysis (2007), Cambridge University Press: Cambridge University Press New York)
[79] Keeney, R. L., Building models of values, European Journal of Operational Research, 37, 149-157 (1988)
[80] Keeney, R. L., Value-focused thinking a path to creative decisionmaking (1992), Harvard University Press: Harvard University Press Cambridge, Massachusetts [etc.]
[81] Keeney, R. L.; Raiffa, H., Decisions with multiple objectives preferences and value tradeoffs (1976), Wiley: Wiley New York a.o. · Zbl 0488.90001
[82] Kelble, C. R.; Loomis, D. K.; Lovelace, S.; Nuttle, W. K.; Ortner, P. B.; Fletcher, P., The EBM-DPSER conceptual model: integrating ecosystem services into the DPSIR framework, Plos One, 8, 8, e70766 (2013)
[83] Kenis, P.; Schneider, V., Policy networks and policy analysis: scrutinizing a new analytical toolbox, (Martin, B.; Mayntz, R., Policy networks: Empirical evidence and theoretical considerations (1991), Westview Press: Westview Press Boulder, CO)
[84] Kim, Y.; Chung, E.-S.; Jun, S.-M.; Kim, S. U., Prioritizing the best sites for treated wastewater instream use in an urban watershed using fuzzy TOPSIS, Resources, Conservation and Recycling, 73, 23-32 (2013)
[85] Kotiadis, K.; Mingers, J., Combining PSMs with hard OR methods: the philosophical and practical challenges, Journal of the Operational Research Society, 57, 856-867 (2006) · Zbl 1103.90378
[86] Kotler, P., Marketing management: Analysis, planning, implementation, and control (1988), Prentice-Hall International Edition
[87] Kowalski, K.; Stagl, S.; Madlener, R.; Omann, I., Sustainable energy futures: methodological challenges in combining scenarios and participatory multi-criteria analysis, European Journal of Operational Research, 197, 1063-1074 (2009)
[88] Kpoumié, A.; Damart, S.; Tsoukiàs, A., Integrating cognitive mapping analysis into multi-criteria decision aiding, Laboratoire d ’Analyses et Modélisation de Systèmes pour l ’Aide à la Décision. <hal-01510937> (2017)
[89] Kurttila, M.; Pesonen, M.; Kangas, J.; Kajanus, M., Utilizing the analytic hierarchy process AHP in SWOT, Forest Policy and Economics, 1, 41-52 (2000)
[90] Lambert, J. H.; Karvetski, C. W.; Spencer, D. K.; Sotirin, B. J.; Liberi, D. M.; Zaghloul, H. H., Prioritizing infrastructure investments in Afghanistan with multiagency stakeholders and deep uncertainty of emergent conditions, Journal of Infrastructure Systems, 18, 155-166 (2012)
[91] Lee, M.-T.; Lin, T.-F., Developing an interactive decision support system for sustainable coastal tourism of Cijin, (Taiwan international symposium on computer, consumer and control by IEEE computer society. Taiwan international symposium on computer, consumer and control by IEEE computer society, Taichung (2014))
[92] Lennox, J.; Proctor, W.; Russell, S., Structuring stakeholder participation in New Zealand’s water resource governance, Ecological Economics, 70, 1381-1394 (2011)
[93] Leskinen, L. A.; Leskinen, P.; Kurttila, M.; Kangas, J.; Kajanus, M., Adapting modern strategic decision support tools in the participatory strategy process - A case study of a forest research station, Forest Policy and Economics, 8, 267-278 (2006)
[94] Lewin, K., Force field analysis (1951), Harper & Row: Harper & Row New York
[95] Li, X.; Zhou, Y.; Tian, B.; Kuang, R.; Wang, L., GIS-based methodology for erosion risk assessment of the muddy coast in the Yangtze Delta, Ocean & Coastal Management, 108, 97-108 (2015)
[96] Lienert, J.; Schnetzer, F.; Ingold, K., Stakeholder analysis combined with social network analysis provides fine-grained insights into water infrastructure planning processes, Journal of Environmental Management, 125, 134-148 (2013)
[97] Lienert, J.; Scholten, L.; Egger, C.; Maurer, M., Structured decision-making for sustainable water infrastructure planning and four future scenarios, EURO Journal on Decision Processes, 3, 107-140 (2015)
[98] Linkov, I.; Varghese, A.; Jamil, S.; Seager, T. P.; Kiker, G.; Bridges, T., Multi-criteria decision analysis: a framework for structuring remedial decisions at contaminated sites, Comparative Risk Assessment and Environmental Decision Making, 38, 15-54 (2004)
[99] Longaray, A. A.; Ensslin, L.; Ensslin, S. R.; da Rosa, I. O., Assessment of a Brazilian public hospital’s performance for management purposes: a soft operations research case in action, Operations Research for Health Care, 5, 28-48 (2015)
[100] Longaray, A. A.; Ensslin, L.; Mackness, J. R., Multicriteria decision analysis to lead about messes problems: an illustrated case, Independent Journal of Management & Production, 5, 677-692 (2014)
[101] Macharis, C.; de Witte, A.; Ampe, J., The multi-actor, multi-criteria analysis methodology (MAMCA) for the evaluation of transport projects: theory and practice, Journal of Advanced Transportation, 43, 183-202 (2009)
[102] Macharis, C.; Turcksin, L.; Lebeau, K., Multi actor multi criteria analysis (MAMCA) as a tool to support sustainable decisions: state of use, Decision Support Systems, 54, 610-620 (2012)
[103] Marafon, A. D.; Ensslin, L.; Lacerda, R. T.D. O.; Ensslin, S. R., The effectiveness of multi-criteria decision aid methodology, European Journal of Innovation Management, 18, 86-109 (2015)
[104] Mardani, A.; Jusoh, A.; Zavadskas, E. K., Fuzzy multiple criteria decision-making techniques and applications - Two decades review from 1994 to 2014, Expert Systems with Applications, 42, 4126-4148 (2015)
[105] Margles, S. W.; Masozera, M.; Rugyerinyange, L.; Kaplin, B. A., Participatory planning: sing SWOT-AHP analysis in buffer zone management planning, Journal of Sustainable Forestry, 29, 613-637 (2010)
[106] Marttunen, M.; Hämäläinen, R. P., Decision analysis interviews in environmental impact assessment, European Journal of Operational Research, 87, 551-563 (1995) · Zbl 0915.90193
[107] Marttunen, M.; Hämäläinen, R. P., The decision analysis interview approach in the collaborative management of a large regulated water course, Environmental Management, 42, 1026-1042 (2008)
[108] Marttunen, M.; Mustajoki, J.; Dufva, M.; Karjalainen, T., How to design and realize participation of stakeholders in MCDA processes? A framework for selecting an appropriate approach, EURO Journal on Decision Processes, 3, 187-214 (2015)
[109] Mendoza, G. A.; Prabhu, R., Qualitative multi-criteria approaches to assessing indicators of sustainable forest resource management, Forest Ecology and Management, 174, 329-343 (2003)
[110] Meyar-Naimi, H.; Vaez-Zadeh, S., Sustainable development based energy policy making frameworks, a critical review, Energy Policy, 43, 351-361 (2012)
[111] Mingers, J., Operational research: the science of better?, Journal of the Operational Research Society, 58, 683-686 (2007)
[112] Mingers, J.; Brocklesby, J., Multimethodology: towards a framework for mixing methodologies, Omega-International Journal of Management Science, 25, 489-509 (1997)
[113] Mingers, J.; Rosenhead, J., Problem structuring methods in action, European Journal of Operational Research, 152, 530-554 (2004) · Zbl 1044.90027
[115] Montibeller, G.; Belton, V.; Ackermann, F.; Ensslin, L., Reasoning maps for decision aid: an integrated approach for problem-structuring and multi-criteria evaluation, Journal of the Operational Research Society, 59, 575-589 (2008) · Zbl 1153.90462
[116] Montibeller, G.; Gummer, H.; Tumidei, D., Combining scenario planning and multi-criteria decision analysis in practice, Journal of Multi-Criteria Decision Analysis, 14, 5-20 (2006)
[117] Morton, A.; Fasolo, B., Behavioural decision theory for multi-criteria decision analysis: a guided tour, Journal of the Operational Research Society, 60, 268-275 (2009)
[118] Munda, G., Social multi-criteria evaluation for a sustainable economy (2004), Springer: Springer Berlin
[119] Munda, G., Social multi-criteria evaluation: methodological foundations and operational consequences, European Journal of Operational Research, 158, 662-677 (2004) · Zbl 1056.90089
[120] Munro, I.; Mingers, J., The use of multimethodology in practice - Results of a survey of practitioners, Journal of the Operational Research Society, 53, 369-378 (2002) · Zbl 1130.90361
[121] Myllyviita, T.; Lähtinen, K.; Hujala, T.; Leskinen, L.; Sikanen, L.; Leskinen, P., Identifying and rating cultural sustainability indicators: a case study of wood-based bioenergy systems in eastern Finland, Environment, Development and Sustainability, 16, 287-304 (2014)
[122] Neves, L. P.; Dias, L. C.; Antunes, C. H.; Martins, A. G., Structuring an MCDA model using SSM: a case study in energy efficiency, European Journal of Operational Research, 199, 834-845 (2009) · Zbl 1176.90307
[123] Nikodinoska, N.; Mattivi, M.; Notaro, S.; Paletto, A., Stakeholders’ appraisal of biomass-based energy development at local scale, Journal of Renewable and Sustainable Energy, 7, Article 023117 pp. (2015)
[124] Nordström, E.-M.; Eriksson, L. O.; Öhman, K., Integrating multiple criteria decision analysis in participatory forest planning: experience from a case study in Northern Sweden, Forest Policy and Economics, 12, 562-574 (2010)
[125] O’Higgins, T.; Farmer, A.; Daskalov, G.; Knudsen, S.; Mee, L., Achieving good environmental status in the Black Sea: scale mismatches in environmental management, Ecology and Society, 19, 54 (2014)
[126] Core set of indicators for environmental performance reviews: a synthesis report by the group on the state of the environment, Environment monographs (1993), Organisation for Economic Co-operation and Development: Organisation for Economic Co-operation and Development Paris
[127] Öztürk, S., Determining management strategies for the Sarikum nature protection area, Environmental Monitoring and Assessment, 187, 113 (2015)
[128] Parnell, G. S.; Hughes, D. W.; Burk, R. C.; Driscoll, P. J.; Kucik, P. D.; Morales, B. L., Invited review-survey of value-focused thinking: applications, research developments and areas for future research, Journal of Multi-Criteria Decision Analysis, 20, 49-60 (2013)
[129] Peterson, G. D.; Cumming, G. E.; S. R., C., Scenario planning: a tool for conservation in an uncertain world, Conservation Biology, 17, 358-366 (2003)
[130] Petersson, E.; Giupponi, C.; Feas’, J., Decision support for strategic water management: mdss in the large dam context, Water International, 32, 265-279 (2007)
[131] Petkov, D.; Petkova, O.; Andrew, T.; Nepal, T., Mixing multiple criteria decision making with soft systems thinking techniques for decision support in complex situations, Decision Support Systems, 43, 1615-1629 (2007)
[132] Phillips, L. D.; Phillips, M. C., Facilitated work groups - Theory and practice, Journal of the Operational Research Society, 44, 533-549 (1993)
[133] Proctor, W.; Drechsler, M., Deliberative multicriteria evaluation, Environment and Planning C-Government and Policy, 24, 169-190 (2006)
[134] Ram, C.; Montibeller, G., Exploring the impact of evaluating strategic options in a scenario-based multi-criteria framework, Technological Forecasting and Social Change, 80, 657-672 (2013)
[135] Ram, C.; Montibeller, G.; Morton, A., Extending the use of scenario planning and MCDA for the evaluation of strategic options, Journal of the Operational Research Society, 62, 817-829 (2011)
[136] Reed, M. S.; Graves, A.; Dandy, N.; Posthumus, H.; Hubacek, K.; Morris, J., Who’s in and why? A typology of stakeholder analysis methods for natural resource management, Journal of Environmental Management, 90, 1933-1949 (2009)
[137] Ritchey, T., Problem structuring using computer-aided morphological analysis, Journal of the Operational Research Society, 57, 792-801 (2006) · Zbl 1103.90379
[138] Rolando, D., Multicriteria decision problem structuring: the strategic choice approach in the context of public projects in Italy, International Journal of Multicriteria Decision Making, 5, 4-38 (2015)
[139] Romero, C.; Rehman, T., Natural resource management and the use of multiple criteria decision-making techniques: a review European Review of Agricultural Economics, 14, 61-89 (1987)
[140] Rosenhead, J., Past, present and future of problem structuring methods, Journal of the Operational Research Society, 57, 759-765 (2006) · Zbl 1103.90301
[141] Rosenhead, J., Rational analysis for a problematic world: Problem structuring methods for complexity, uncertainty and conflict (1989), John Wiley and Sons Ltd: John Wiley and Sons Ltd West Sussex, England
[142] Rosenhead, J.; Mingers, J., Rational analysis for a problematic world revisited: Problem structuring methods for complexity, uncertainty and conflict (2001), John Wiley & Sons. Ltd: John Wiley & Sons. Ltd Chichester, London
[143] Roy, B., The outranking approach and the foundations of ELECTRE methods, Theory and Decision, 31, 49-73 (1991)
[144] Saaty, T. L., The analytic hierarchy process (1980), McGraw-Hill: McGraw-Hill New York · Zbl 1176.90315
[145] Saaty, T. L., Theory and applications of the analytic network process decision making with benefits, opportunities, costs, and risks (2005), RWS Publications: RWS Publications Pittsburgh, PA
[146] Schaffernicht, M., Causal loop diagrams between structure and behaviour: a critical analysis of the relationship between polarity, behaviour and events, Systems Research and Behavioral Science, 27, 653-666 (2010)
[147] Schnaars, S. P., How to develop and use scenarios, Long Range Planning, 20, 105-114 (1987)
[148] Schoemaker, P. J.H., Scenario planning: a tool for strategic thinking, Sloan Management Review, 36, 25-40 (1995)
[149] Scholten, L.; Schuwirth, N.; Reichert, P.; Lienert, J., Tackling uncertainty in multi-criteria decision analysis - An application to water supply infrastructure planning, European Journal of Operational Research, 242, 243-260 (2015)
[150] Scolozzi, R.; Schirpke, U.; Morri, E.; D’amato, D.; Santolini, R., Ecosystem services-based SWOT analysis of protected areas for conservation strategies, Journal of Environmental Management, 146, 543-551 (2014)
[151] Sevkli, M.; Oztekin, A.; Uysal, O.; Torlak, G.; Turkyilmaz, A.; Delen, D., Development of a fuzzy ANP based SWOT analysis for the airline industry in Turkey, Expert Systems with Applications, 39, 14-24 (2012)
[152] Shao, C.; Guan, Y.; Chu, C.; Shi, R.; Ju, M.; Shi, J., Trends analysis of ecological environment security based on DPSIR model in the coastal zone: a survey study in Tianjin, China, International Journal of Environmental Research, 8, 765-778 (2014)
[153] Shrestha, R. K.; Alavalapati, J. R.R.; Kalmbacher, R. S., Exploring the potential for silvopasture adoption in south-central Florida: an application of SWOT-AHP method, Agricultural Systems, 81, 185-199 (2004)
[154] Smeets, E.; Weterings, R., Environmental indicators: typology and overview, TNO centre for strategy, technology and policy (1999), European Environment Agency: European Environment Agency The Netherlands
[155] Srdjevic, Z.; Bajcetic, R.; Srdjevic, B., Identifying the criteria set for multicriteria decision making based on SWOT/PESTLE analysis: a case study of reconstructing a water intake structure, Water Resources Management, 26, 3379-3393 (2012)
[156] Steuer, R. E.; Na, P., Multiple criteria decision making combined with finance: a categorized bibliographic study, European Journal of Operational Research, 150, 496-515 (2003) · Zbl 1044.90043
[157] Stewart, T. J., Scenario analysis and multicriteria decision making, (Clímaco, J., Multicriteria analysis proceedings of the XIth international conference on MCDM (1997), Springer: Springer CoimbraPortugalBerlin), 1-6 August 1994 [etc.]
[158] Stewart, T. J., Dealing with uncertainties in MCDA, (Figueira, J. R.; Greco, S.; Ehrgott, M., Multiple criteria decision analysis: State of the art surveys (2005), Springer: Springer New York) · Zbl 1072.90549
[159] Stewart, T. J.; French, S.; Rios, J., Integrating multicriteria decision analysis and scenario planning—Review and extension, Omega, 41, 679-688 (2013)
[160] Straton, A. T.; Jackson, S.; Marinoni, O.; Proctor, W.; Woodward, E., Exploring and evaluating scenarios for a river catchment in Northern Australia using scenario development, multi-criteria analysis and a deliberative process as a tool for water planning, Water Resources Management, 25, 141-164 (2011)
[161] Suriya, S.; Mudgal, B. V., Soft systems methodology and integrated flood management: a study of the Adayar watershed, Chennai, India, Water and Environment Journal, 27, 462-473 (2013)
[162] Terrados, J.; Almonacid, G.; Pérez-Higueras, P., Proposal for a combined methodology for renewable energy planning, Application to a Spanish region. Renewable and Sustainable Energy Reviews, 13, 2022-2030 (2009)
[163] Tikkanen, J.; Isokaanta, T.; Pykalainen, J.; Leskinen, P., Applying cognitive mapping approach to explore the objective-structure of forest owners in a Northern Finnish case area, Forest Policy and Economics, 9, 139-152 (2006)
[164] Trutnevyte, E.; Stauffacher, M.; Scholz, R. W., Supporting energy initiatives in small communities by linking visions with energy scenarios and multi-criteria assessment, Energy Policy, 39, 7884-7895 (2011)
[165] Trutnevyte, E.; Stauffacher, M.; Scholz, R. W., Linking stakeholder visions with resource allocation scenarios and multi-criteria assessment, European Journal of Operational Research, 219, 762-772 (2012)
[167] Turcksin, L.; Macharis, C.; Lebeau, K.; Boureima, F.; Van Mierlo, J.; Bram, S., A multi-actor multi-criteria framework to assess the stakeholder support for different biofuel options: the case of Belgium, Energy Policy, 39, 200-214 (2011)
[168] Vacik, H.; Kurttila, M.; Hujala, T.; Khadka, C.; Haara, A.; Pykalainen, J., Evaluating collaborative planning methods supporting programme-based planning in natural resource management, Journal of Environmental Management, 144, 304-315 (2014)
[169] Van der Heijden, K., Scenarios: The art of strategic conversation (1996), John Wiley & Sons: John Wiley & Sons Chichester
[170] van der Pas, J. W.G. M.; Walker, W. E.; Marchau, V. A.W. J.; Van Wee, G. P.; Agusdinata, D. B., Exploratory MCDA for handling deep uncertainties: the case of intelligent speed adaptation implementation, Journal of Multi-Criteria Decision Analysis, 17, 1-23 (2010)
[171] Ventura, A.; Dias, L.; Clímaco, J., On facilitating group decision making processes with VIP analysis, (Zaraté, P.; Kersten, G. E.; Hernández, J. E., Group decision and negotiation - A process-oriented view (2014), Springer International Publishing: Springer International Publishing Switzerland)
[172] Wack, P., Scenarios - uncharted waters ahead, Harvard Business Review, 63, 72-89 (1985)
[173] Wallenius, J.; Dyer, J. S.; Fishburn, P. C.; Steuer, R. E.; Zionts, S.; Deb, K., Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead, Management Science, 54, 1336-1349 (2008) · Zbl 1232.90228
[174] Wang, Q.; Poh, K. L., A survey of integrated decision analysis in energy and environmental modeling, Energy, 77, 691-702 (2014)
[175] Weihrich, H., The tows matrix - A tool for situational analysis, Long Range Planning, 15, 54-66 (1982)
[176] Wolfslehner, B.; Vacik, H., Evaluating sustainable forest management strategies with the analytic network process in a pressure-state-response framework, Journal of Environmental Management, 88, 1-10 (2008)
[177] Wolfslehner, B.; Vacik, H., Mapping indicator models: from intuitive problem structuring to quantified decision-making in sustainable forest management, Ecological Indicators, 11, 274-283 (2011)
[178] Wright, G.; Bradfield, R.; Cairns, G., Does the intuitive logics method - and its recent enhancements - produce “effective” scenarios?, Technological Forecasting and Social Change, 80, 631-642 (2013)
[179] Wright, G.; Goodwin, P., Future-focussed thinking: combining scenario planning with decision analysis, Journal of Multi-Criteria Decision Analysis, 8, 311-321 (1999) · Zbl 0969.90055
[180] Wright, G.; Goodwin, P., Eliminating a framing bias by using simple instructions to ‘think harder’ and respondents with managerial experience: comment on ‘breaking the frame’, Strategic Management Journal, 23, 1059-1067 (2002)
[181] Yu, R.; Tzeng, G.-H., A soft computing method for multi-criteria decision making with dependence and feedback, Applied Mathematics and Computation, 180, 63-75 (2006) · Zbl 1102.90360
[182] Yüksel, İ.; Dağdeviren, M., Using the analytic network process (ANP) in a SWOT analysis - A case study for a textile firm, Information Sciences, 177, 3364-3382 (2007) · Zbl 1278.90248
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.