×

zbMATH — the first resource for mathematics

Preference disaggregation within the regularization framework for sorting problems with multiple potentially non-monotonic criteria. (English) Zbl 1430.90335
Summary: We propose a new approach to preference model learning for multiple criteria sorting within the regularization framework traditionally used in the statistical learning theory. It employs an additive piecewise-linear value function as a preference model, and infers the model’s parameters from the assignment examples concerning a subset of reference alternatives. As such, our approach belongs to the family of preference disaggregation approaches. We propose a new way of measuring the complexity of the preference model. Moreover, by accounting for the trade-off between model’s complexity and fitting ability, the proposed approach avoids the problem of over-fitting and enhances the generalization ability to non-reference alternatives. In addition, it is capable of dealing with potentially non-monotonic criteria, whose marginal value functions can be inferred from the assignment examples without using integer variables. The proposed preference learning approach is formulated as a binary classification problem and addressed using support vector machine. In this way, the respective optimization problems can be solved with some computationally efficient algorithms. Moreover, the prior knowledge about the preference directions on particular criteria are incorporated to the model, and a dedicated algorithm is developed to solve the extended quadratic optimization problem. An example of university classification in China is discussed to illustrate the applicability of proposed method and extensive simulation experiments are conducted to analyze its performance under a variety of problem settings.

MSC:
90B50 Management decision making, including multiple objectives
91B06 Decision theory
91B08 Individual preferences
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Boyd, S.; Vandenberghe, L., Convex optimization, (2004), Cambridge University Press · Zbl 1058.90049
[2] Cailloux, O.; Meyer, P.; Mousseau, V., Eliciting ELECTRE TRI category limits for a group of decision makers, European Journal of Operational Research, 223, 1, 133-140, (2012) · Zbl 1253.91046
[3] Chang, C.-C.; Lin, C.-J., LIBSVM: A library for support vector machines, ACM Transactions on Intelligent Systems and Technology, 2, 3, 27, (2011)
[4] Chen, Y.; Li, K. W.; Kilgour, D. M.; Hipel, K. W., A case-based distance model for multiple criteria ABC analysis, Computers & Operations Research, 35, 3, 776-796, (2008) · Zbl 1278.90014
[5] Christopher, M. B., Pattern recognition and machine learning, (2006), Springer-Verlag New York · Zbl 1107.68072
[6] Corrente, S.; Doumpos, M.; Greco, S.; Słowiński, R.; Zopounidis, C., Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions, Annals of Operations Research, 251, 1-2, 117-139, (2017) · Zbl 1408.90148
[7] Corrente, S.; Greco, S.; Kadziński, M.; Słowiński, R., Robust ordinal regression in preference learning and ranking, Machine Learning, 93, 2-3, 381-422, (2013) · Zbl 1300.68040
[8] Dembczyński, K.; Kotłowski, W.; Słowiński, R., Additive preference model with piecewise linear components resulting from dominance-based rough set approximations, (Rutkowski, L.; Tadeusiewicz, R.; Zadeh, L.; Zurada, J., Proceedings of the international conference on artificial intelligence and soft computing - ICAISC, (2006), Springer: Springer Berlin), 499-508 · Zbl 1298.68265
[9] Despotis, D.; Zopounidis, C., Building additive utilities in the presence of non-monotonic preferences, Advances in multicriteria analysis, 101-114, (1995), Springer · Zbl 0861.90009
[10] Dias, L.; Mousseau, V.; Figueira, J.; Climaco, J., An aggregation/disaggregation approach to obtain robust conclusions with ELECTRE TRI, European Journal of Operational Research, 138, 2, 332-348, (2002) · Zbl 1003.90512
[11] Doumpos, M., Learning non-monotonic additive value functions for multicriteria decision making, OR spectrum, 34, 1, 89-106, (2012) · Zbl 1238.90075
[12] Doumpos, M.; Zopounidis, C., Multicriteria decision aid classification methods, (2002), Kluwer Academic Publishers: Kluwer Academic Publishers Dordrecht · Zbl 1029.91015
[13] Doumpos, M.; Zopounidis, C., Regularized estimation for preference disaggregation in multiple criteria decision making, Computational Optimization and Applications, 38, 1, 61-80, (2007) · Zbl 1171.90427
[14] Doumpos, M.; Zopounidis, C., Preference disaggregation and statistical learning for multicriteria decision support: A review, European Journal of Operational Research, 209, 3, 203-214, (2011) · Zbl 1205.90147
[15] Doumpos, M.; Zopounidis, C.; Galariotis, E., Inferring robust decision models in multicriteria classification problems: An experimental analysis, European Journal of Operational Research, 236, 2, 601-611, (2014) · Zbl 1317.91022
[16] Eckhardt, A.; Kliegr, T., Preprocessing algorithm for handling non-monotone attributes in the UTA method, Preference Learning: Problems and Applications in AI, 28-32, (2012)
[17] Evgeniou, T.; Boussios, C.; Zacharia, G., Generalized robust conjoint estimation, Marketing Science, 24, 3, 415-429, (2005)
[18] Fan, R.-E.; Chang, K.-W.; Hsieh, C.-J.; Wang, X.-R.; Lin, C.-J., LIBLINEAR: A library for large linear classification, Journal of Machine Learning Research, 9, 1871-1874, (2008) · Zbl 1225.68175
[19] Ghaderi, M.; Ruiz, F.; Agell, N., A linear programming approach for learning non-monotonic additive value functions in multiple criteria decision aiding, European Journal of Operational Research, 259, 3, 1073-1084, (2017) · Zbl 1402.90083
[20] Greco, S.; Matarazzo, B.; Slowinski, R., Rough sets theory for multicriteria decision analysis, European Journal of Operational Research, 129, 1, 1-47, (2001) · Zbl 1008.91016
[21] Greco, S.; Mousseau, V.; Słowiński, R., Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions, European Journal of Operational Research, 191, 2, 416-436, (2008) · Zbl 1147.90013
[22] Greco, S.; Mousseau, V.; Słowiński, R., Multiple criteria sorting with a set of additive value functions, European Journal of Operational Research, 207, 3, 1455-1470, (2010) · Zbl 1206.91021
[23] Greco, S.; Mousseau, V.; Słowiński, R., Inference of parsimonious preference models in robust ordinal regression, Proceedings of the 22nd international conference on multiple criteria decision making, Málaga, Spain, (2013)
[24] He, H.; Garcia, E. A., Learning from imbalanced data, IEEE Transactions on Knowledge and Data Engineering, 21, 9, 1263-1284, (2009)
[25] Jacquet-Lagrèze, E.; Siskos, Y., Preference disaggregation: 20 years of MCDA experience, European Journal of Operational Research, 130, 2, 233-245, (2001) · Zbl 1068.90566
[26] Kadziński, M.; Cinelli, M.; Ciomek, K.; Coles, S.; Nadagouda, M.; Varma, R., Co-constructive development of a green chemistry-based model for the assessment of nanoparticles synthesis, European Journal of Operational Research, 264, 2, 472-490, (2018)
[27] Kadziński, M.; Ciomek, K., Integrated framework for preference modeling and robustness analysis for outranking-based multiple criteria sorting with ELECTRE and PROMETHEE, Information Sciences, 352, 167-187, (2016)
[28] Kadziński, M.; Ciomek, K.; Słowiński, R., Modeling assignment-based pairwise comparisons within integrated framework for value-driven multiple criteria sorting, European Journal of Operational Research, 241, 3, 830-841, (2015) · Zbl 1339.91043
[29] Kadziński, M.; Słowiński, R.; Greco, S., Robustness analysis for decision under uncertainty with rule-based preference model, Information Sciences, 328, 321-339, (2016)
[30] Kadziński, M.; Tervonen, T.; Figueira, J. R., Robust multi-criteria sorting with the outranking preference model and characteristic profiles, Omega, 55, 126-140, (2015)
[31] Kadziński, M.; Ghaderi, M.; Wasikowski, J.; Agell, N., Expressiveness and robustness measures for the evaluation of an additive value function in multiple criteria preference disaggregation methods: An experimental analysis, Computers & Operations Research, 87, 146-164, (2017) · Zbl 1394.90348
[32] Kliegr, T., UTA-NM: Explaining stated preferences with additive non-monotonic utility functions, Preference Learning, 56, (2009)
[33] Köksalan, M.; Özpeynirci, S. B., An interactive sorting method for additive utility functions, Computers & Operations Research, 36, 9, 2565-2572, (2009) · Zbl 1179.91057
[34] Liu, J.; Liao, X.; Huang, W.; Yang, J.-b., A new decision-making approach for multiple criteria sorting with an imbalanced set of assignment examples, European Journal of Operational Research, 265, 2, 598-620, (2018) · Zbl 1376.91060
[35] Nocedal, J.; Wright, S. J., Numerical optimization, (2004), Springer
[36] Nocedal, J.; Wright, S. J., Sequential quadratic programming, (2006), Springer
[37] Platt, J. C., Using analytic QP and sparseness to speed training of support vector machines, Advances in neural information processing systems, 557-563, (1999)
[38] Rezaei, J., Piecewise linear value functions for multi-criteria decision-making, Expert Systems with Applications, 98, 43-56, (2018)
[39] Tibshirani, R., Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society. Series B (Methodological), 267-288, (1996) · Zbl 0850.62538
[40] Vapnik, V., Statistical learning theory, (1998), Wiley, New York · Zbl 0935.62007
[41] Wong, E., Active-set methods for quadratic programming, (2011), University of California, San Diego
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.