Elicitation of criteria importance weights through the Simos method: a robustness concern. (English) Zbl 1346.90446

Siskos, Eleftherios; Tsotsolas, Nikos

Eur. J. Oper. Res. 246, No. 2, 543-553 (2015).

Summary: In the field of multicriteria decision aid, the Simos method is considered as an effective tool to assess the criteria importance weights. Nevertheless, the method’s input data do not lead to a single weighting vector, but infinite ones, which often exhibit great diversification and threaten the stability and acceptability of the results. This paper proves that the feasible weighting solutions, of both the original and the revised Simos procedures, are vectors of a non-empty convex polyhedral set, hence the reason it proposes a set of complementary robustness analysis rules and measures, integrated in a Robust Simos Method. This framework supports analysts and decision makers in gaining insight into the degree of variation of the multiple acceptable sets of weights, and their impact on the stability of the final results. In addition, the proposed measures determine if, and what actions should be implemented, prior to reaching an acceptable set of criteria weights and forming a final decision. Two numerical examples are provided, to illustrate the paper’s evidence, and demonstrate the significance of consistently analyzing the robustness of the Simos method results, in both the original and the revised method’s versions.

MSC:

90B50

Management decision making, including multiple objectives

Keywords:

multiple criteria; decision analysis; criteria weights; robustness analysis; Simos method

Software:

VisualUTA; M-MACBETH

References:

[1]	Alexopoulos, S.; Siskos, Y.; Tsotsolas, N.; Hristodoulakis, N., Evaluating strategic actions for a Greek publishing company, Operational Research, 12, 2, 253-269 (2012)
[2]	Aretoulis, G.; Kalfakakou, G.; Striagka, F., Construction material supplier selection under multiple criteria, Operational Research, 10, 2, 209-230 (2010)
[3]	Ashari, H. E.; Parsaei, M., Application of the multi-criteria decision method ELECTRE III for the weapon selection, Decision Science Letters, 3, 4, 511-522 (2014)
[4]	Augusto, M.; Lisboa, J.; Yasin, M.; Figueira, J. R., Benchmarking in a multiple criteria performance context: An application and a conceptual framework, European Journal of Operational Research, 184, 1, 244-254 (2008) · Zbl 1278.90187
[5]	Azadeh, A.; Kor, H.; Hatefi, S. M., A hybrid genetic algorithm-TOPSIS-computer simulation approach for optimum operator assignment in cellular manufacturing systems, Journal of the Chinese Institute of Engineers, 34, 1, 57-74 (2011)
[6]	Bahraminasab, M.; Jahan, A., Material selection for femoral component of total knee replacement using comprehensive VIKOR, Materials and Design, 32, 8-9, 4471-4477 (2011)
[7]	Bana e. Costa, C. A.; De Corte, J.-M.; Vansnick, J.-C., MACBETH, International Journal of Information Technology and Decision Making, 11, 2, 359-387 (2012)
[8]	Bisdorff, R.; Meyer, P.; Veneziano, T., Elicitation of criteria weights maximising the stability of pairwise outranking statements, Journal of Multi-Criteria Decision Analysis, 21, 1-2, 113-124 (2014)
[9]	Bojovic, D.; Bonzanigo, L.; Giupponi, C., Drivers of change in Southern European agriculture: Online participatory approaches for the analysis of planned and autonomous adaptation strategies, (Seppelt, R.; Lange, A. A.V. S.; Bankamp, D., 2012 International congress on environmental modelling and software. Managing resources of a limited planet (2012)), 684-691
[10]	Bollinger, D.; Maystre, L. Y.; Slowinski, R., Un cas concret de la contribution de l’aide multicritère à la décision à la coordination inter-cantonale pour l’incinération des déchets urbains, (45e Journées du Groupe de Travail Européen Aide Multicritère à la Décision, Celàkovice, République Tchèque (1997)), 20-21 Mars
[11]	Brifcani, N.; Day, R.; Walker, D.; Hughes, S.; Ball, K.; Price, D., A review of cutting-edge techniques for material selection, (Proceedings of the 2nd international conference on advanced composite materials and technologies for aerospace applications, June 11-13, 2012 (2012)), http://collections.crest.ac.uk/3975/1/fulltext.pdf Accessed online 16.11.14
[12]	Cai, F. L.; Liao, X.; Wang, K. L., An interactive sorting approach based on the assignment examples of multiple decision makers with different priorities, Annals of Operations Research., 197, 1, 87-108 (2012) · Zbl 1251.90215
[13]	Cavallaro, F., Multi-criteria decision aid to assess concentrated solar thermal technologies, Renewable Energy, 34, 7, 1678-1685 (2009)
[14]	Cavallaro, F., A comparative assessment of thin-film photovoltaic production processes using the ELECTRE III method, Energy Policy, 38, 1, 463-474 (2010)
[15]	Dawson, L.; Schlyter, P., Less is more: strategic scale site suitability for concentrated solar thermal power in Western Australia, Energy Policy, 47, 91-101 (2012)
[16]	Esseghir, H.; Mellouli, K., A decision support system for the evaluation of the scientific research structures in Tunisia, (Proceedings of the ICSSSM’06: 2006 international conference on service systems and service management, 2 (2006)), 872-877
[17]	Figueira, J.; Roy, R., Determining the weights of criteria in the ELECTRE type methods with a revised Simos’ procedure, European Journal of Operational Research, 139, 317-326 (2002) · Zbl 1001.90036
[18]	(Figueira, J.; Greco, S.; Ehrgott, M., State-of-Art of multiple criteria decision analysis (2005), Kluwer Academic Publishers: Kluwer Academic Publishers Dortrecht) · Zbl 1060.90002
[19]	Figueira, J.; Greco, S.; Słowiński, R., Building a set of additive value functions representing a reference preorder and intensities of preference: GRIP method, European Journal of Operational Research, 195, 2, 460-486 (2009) · Zbl 1159.91341
[20]	Figueira, J. R.; Almeida-Dias, J.; Matias, S.; Roy, B.; Carvalho, M. J.; Plancha, C. E., Electre Tri-C, a multiple criteria decision aiding sorting model applied to assisted reproduction, International Journal of Medical Informatics, 80, 4, 262-273 (2011)
[21]	Fontana, M. E.; Morais, D. C.; Almeida, A. T., A MCDM model for urban water conservation strategies adapting Simos procedure for evaluating alternatives intra-criteria, Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science, 6576, 564-578 (2011)
[22]	Greco, S.; Mousseau, V.; Słowiński, R., Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions, European Journal of Operational Research, 191, 2, 416-436 (2008) · Zbl 1147.90013
[23]	Greco, S.; Kadziński, M.; Mousseau, V.; Słowiński, R., \(ELECTRE^{GKMS}\): Robust ordinal regression for outranking methods, European Journal of Operational Research, 214, 10, 118-135 (2011) · Zbl 1218.90086
[24]	Greco, S.; Siskos, Y.; Slowinski, R., Entropy measures to control robustness in ordinal regression models, (Proceedings of the 77th EURO working group on MCDA, Rouen, France (2013))
[25]	Grigoroudis, E.; Siskos, Y., Customer satisfaction evaluation (2010), Springer: Springer New York · Zbl 1198.91006
[26]	Herssens, C.; Jureta, I. J.; Faulkner, S., Dealing with quality tradeoffs during service selection, (5th International conference on autonomic computing, ICAC 2008 (2008)), 77-86, art. no. 4550829
[27]	Huaylla, F.; Berrah, L.; Cliville, V., A decision-aiding approach for residential photovoltaic system choice: An application to the French context, Advances in Production Management Systems. Competitive Manufacturing for Innovative Products and Services, 397, 232-239 (2013)
[28]	Hugonnard, J. C.; Roy, B., Le plan d’extension du métro en banlieue Parisienne, (Jacquet-Lagrèze, E.; Siskos, J., Méthode de decision multicritère (1983), Hommes et Techniques: Hommes et Techniques Paris), 39-65
[29]	Hurson, Ch.; Siskos, Y., A synergy of multicriteria techniques to assess additive value models, European Journal of Operational Research, 238, 2, 540-551 (2014) · Zbl 1338.91053
[30]	Jabeur, K.; Martel, J. M.; Khélifa, S. B., A distance-based collective preorder integrating the relative importance of the group’s members, Group Decision and Negotiation, 13, 4, 327-349 (2004)
[31]	Jabeur, K.; Martel, J. M., An ordinal sorting method for group decision-making, European Journal of Operational Research, 180, 3, 1272-1289 (2007) · Zbl 1121.90356
[32]	Jamali, R.; Nejati, M., Women’s career progression barriers and organisational justice: A study of Iranian society, Business Strategy Series, 10, 5, 311-328 (2009)
[33]	Kadzinski, M.; Greco, S.; Slowinski, R., Extreme ranking in robust ordinal regression, Omega, 40, 488-501 (2012)
[34]	Kodikara, P. N.; Perera, B. J.C.; Kularathna, M. D.U. P., Stakeholder preference elicitation and modelling in multi-criteria decision analysis─a case study on urban water supply, European Journal of Operational Research, 206, 1, 209-220 (2010) · Zbl 1188.90129
[35]	Kostoglou, V.; Papathanasiou, J.; Moschidis, O.; Ladopoulou, P., Α comparative analysis of Greek universities’ presence on the World Wide Web using an analytical MCDM methodology, International Journal of Multicriteria Decision Making, 4, 3, 279-298 (2014)
[36]	Lahdelma, R.; Hokkanen, J.; Salminen, P., SMAA - Stochastic multiobjective acceptability analysis, European Journal of Operational Research, 106, 1, 137-143 (1998)
[37]	Lovasz, L., Hit-and-run mixes fast, Mathematical Programming, 86, 443-461 (1999) · Zbl 0946.90116
[38]	Madlener, R.; Kowalski, K.; Stagl, S., New ways for the integrated appraisal of national energy scenarios: The case of renewable energy use in Austria, Energy Policy, 35, 12, 6060-6074 (2007)
[39]	Manas, M.; Nedoma, J., Finding all vertices of a convex polyhedron, Numerische Mathematik, 14, 226-229 (1968) · Zbl 0165.51801
[40]	Marzouk, M.; Hamid, S. A.; El-Said, M., A methodology for prioritizing water mains rehabilitation in Egypt, HBRC Journal (2014), (in press). Available online 13 May 2014, http://dx.doi.org/10.1016/j.hbrcj.2014.03.002
[41]	Marzouk, M.; Nouh, A.; El-Said, M., Developing green bridge rating system using Simos’ procedure, HBRC Journal, 10, 2, 176-182 (2014)
[42]	Maystre, L.; Pictet, J.; Simos, J., Methodes multicriteres ELECTRE - Description, conseils pratiques et cas d’application a la gestion environnementale (1994), Presses Polytechniques et Universitaires Romandes: Presses Polytechniques et Universitaires Romandes Lausanne
[43]	Merad, M. M.; Verdel, T.; Roy, B.; Kouniali, S., Use of multi-criteria decision-aids for risk zoning and management of large area subjected to mining-induced hazards, Tunnelling and Underground Space Technology, 19, 2, 125-138 (2004)
[44]	Merad, M.; Dechy, N.; Marcel, F.; Linkov, I.; Bridges, T. S., Sustainable development and climate change challenges: Case of a public organization, Sustainable development and climate change challenges: Case of a public organization. Sustainable development and climate change challenges: Case of a public organization, Climate: Global change and local adaptation, 193-208 (2011), Chapter 11
[45]	Merad, M.; Dechy, N.; Serir, L.; Grabisch, M.; Marcel, F., Using a multi-criteria decision aid methodology to implement sustainable development principles within an organization, European Journal of Operational Research, 224, 3, 603-613 (2013)
[46]	Merad, M.; Dechy, N.; Marcel, F.; Linkov, I., Multiple-criteria decision-aiding framework to analyze and assess the governance of sustainability, Environment Systems and Decisions, 33, 2, 305-321 (2013)
[47]	Mousseau, V., Eliciting information concerning the relative importance of criteria, (Pardalos, P. M.; Siskos, Y.; Zopounidis, C., Advances in multicriteria analysis (1995), Kluwer Academic Publishers: Kluwer Academic Publishers Dortrecht), 17-43 · Zbl 0861.90085
[48]	Özcan, T.; Çelebi, N.; Esnaf, Ş., Comparative analysis of multi-criteria decision making methodologies and implementation of a warehouse location selection problem, Expert Systems with Applications, 38, 8, 9773-9779 (2011)
[49]	Pekelman, D.; Sen, S. K., Mathematical programming models for the determination of attribute weights, Management Science, 20, 8), 1217-1229 (1974) · Zbl 0303.90006
[50]	Pictet, J.; Bollinger, D., The silent negotiation or how to elicit collective information for group MCDA without excessive discussion, Journal of Multi-Criteria Decision Analysis, 13, 5-6, 199-211 (2005)
[51]	Pictet, J.; Bollinger, D., Extended use of the cards procedure as a simple elicitation technique for MAVT. Application to public procurement in Switzerland, European Journal of Operational Research, 185, 3, 1300-1307 (2008) · Zbl 1178.90193
[52]	Ribas, J. R.; da Silva Rocha, M., A decision support system for prioritizing investments in an energy efficiency program in favelas in the city of Rio de Janeiro, Journal of Multi-Criteria Decision Analysis (2014), (In press)
[53]	Saaty, T. L., The analytic hierarchy process (1994), McGraw Hill: McGraw Hill New York · Zbl 0816.90001
[54]	Scharlig, A., Pratiquer Electre et PROMETHEE - Un complément à décider sur plusieurs critères (1996), Presses Polytechniques et Universitaires Romandes: Presses Polytechniques et Universitaires Romandes Collection Diriger L’Entreprise, Lausanne
[55]	Shanian, A.; Savadogo, O., TOPSIS multiple-criteria decision support analysis for material selection of metallic bipolar plates for polymer electrolyte fuel cell, Journal of Power Sources, 159, 2, 1095-1104 (2006)
[56]	Shanian, A.; Milani, A. S.; Carson, C.; Abeyarante, R. C., A new application of ELECTRE III and revised Simos’ procedure for group material selection under weighting uncertainty, Knowledge-Based Systems, 21, 7, 709-720 (2008)
[57]	Shanian, A.; Milani, A. S.; Vermaak, N.; Bertoldi, K.; Scarinci, T.; Gerendas, M., A combined finite element-multiple criteria optimization approach for materials selection of gas turbine components, Journal of Applied Mechanics, 79, 6, 061019 (2012), Article number
[58]	Simos, J., L’évaluation environnementale: Un processus cognitif négocié (1990), Thèse de doctorat, DGF EPFL: Thèse de doctorat, DGF EPFL Lausanne
[59]	Simos, J., Evaluer l’impact sur l’environnement: Une approche originale par l’analyse multicritère et la négociation (1990), Presses Polytechniques et Universitaires Romandes: Presses Polytechniques et Universitaires Romandes Lausanne
[60]	Smith, R. L., Efficient Monte Carlo procedures for generating points uniformly distributed over bounded regions, Operations Research, 32, 1296-1308 (1984) · Zbl 0552.65004
[61]	Smith, N. A.; Tromble, R. W., Sampling uniformly from the unit simplex (2004), Department of computer science. Center for Language and Speech processing: Department of computer science. Center for Language and Speech processing Johns Hopkins University
[62]	Solymosi, T.; Dombi, J., A method for determining the weights of criteria: the centralized weights, European Journal of Operational Research, 22, 35-41 (1986)
[63]	Tervonen, T.; Valkenhoef, G. V.; Baştürk, N.; Postmus, D., Hit-and-run enables efficient weight generation for simulation-based multiple criteria decision analysis, European Journal of Operational Research, 224, 552-559 (2012) · Zbl 1292.91057
[64]	Vansnick, J.-C., On the problem of weights in multiple criteria decision making (the noncompensatory approach), European Journal of Operational Research, 24, 288-294 (1986) · Zbl 0579.90059
[65]	Wang, J.; Zionts, S., Using ordinal data to estimate cardinal values, Journal of Multi-Criteria Decision Analysis (2014), (in press)
[66]	Wilkens, I.; Schmuck, P., Transdisciplinary evaluation of energy scenarios for a German village using multi-criteria decision analysis, Sustainability, 4, 4, 604-629 (2012)
[67]	Xidonas, P.; Flamos, A.; Koussouris, S.; Askounis, D.; Psarras, J., On the appraisal of consumer credit banking products within the asset quality frame: A multiple criteria application, Operational Research, 7, 2, 255-283 (2007)