×

Learning structures of Bayesian networks for variable groups. (English) Zbl 1418.68179

Summary: Bayesian networks, and especially their structures, are powerful tools for representing conditional independencies and dependencies between random variables. In applications where related variables form a priori known groups, chosen to represent different “views” to or aspects of the same entities, one may be more interested in modeling dependencies between groups of variables rather than between individual variables. Motivated by this, we study prospects of representing relationships between variable groups using Bayesian network structures. We show that for dependency structures between groups to be expressible exactly, the data have to satisfy the so-called groupwise faithfulness assumption. We also show that one cannot learn causal relations between groups using only groupwise conditional independencies, but also variable-wise relations are needed. Additionally, we present algorithms for finding the groupwise dependency structures.

MSC:

68T05 Learning and adaptive systems in artificial intelligence

Software:

UCI-ml; TETRAD
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] Aliferis, C. F.; Statnikov, A.; Tsamardinos, I.; Mani, S.; Koutsoukos, X. D., Local causal and Markov blanket induction for causal discovery and feature selection for classification Part I: algorithms and empirical evaluation, J. Mach. Learn. Res., 11, 171-234 (2010) · Zbl 1242.68197
[2] Bache, K.; Lichman, M., UCI Machine Learning Repository (2013)
[3] Burge, J.; Lane, T., Improving Bayesian network structure search with random variable aggregation hierarchies, (ECML (2006), Springer: Springer Berlin, Heidelberg), 66-77
[4] Chickering, D. M., Learning Bayesian networks is NP-Complete, (Learning from Data: Artificial Intelligence and Statistics (1996), Springer-Verlag), 121-130
[5] Chickering, D. M., Optimal structure identification with greedy search, J. Mach. Learn. Res., 3, 507-554 (2002) · Zbl 1084.68519
[6] Cooper, G. F.; Herskovits, E., A Bayesian method for the induction of probabilistic networks from data, Mach. Learn., 9, 4, 309-347 (1992) · Zbl 0766.68109
[7] Cussens, J., Bayesian network learning with cutting planes, (UAI (2011), AUAI Press), 153-160
[8] Davies, S.; Moore, A., Bayesian network for lossless dataset compression, (Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD (1999)), 387-391
[9] Entner, D.; Hoyer, P. O., Estimating a causal order among groups of variables in linear models, (ICANN (2012), Springer), 83-90
[10] Erdős, P.; Rényi, A., On random graphs i, Publ. Math., 6, 290-297 (1959) · Zbl 0092.15705
[11] Gilbert, E. N., Random graphs, Ann. Math. Stat., 30, 1141-1144 (1959) · Zbl 0168.40801
[12] Gyftodimos, E.; Flach, P. A., Hierarchical Bayesian networks: a probabilistic reasoning model for structured domains, (ICML-2002 Workshop on Development of Representations (2002))
[13] Heckerman, D.; Geiger, D.; Chickering, D. M., Learning Bayesian networks: the combination of knowledge and statistical data, Mach. Learn., 20, 3, 197-243 (1995) · Zbl 0831.68096
[14] Jaakkola, T.; Sontag, D.; Globerson, A.; Meila, M., Learning Bayesian network structure using LP relaxations, (AISTATS (2010)), 358-365
[15] Koller, D.; Pfeffer, A., Object-oriented Bayesian networks, (UAI (1997), Morgan Kaufmann Publishers Inc.), 302-313
[16] Meek, C., Causal inference and causal explanation with background knowledge, (UAI (1995), Morgan Kaufmann), 403-410
[17] Parviainen, P.; Kaski, S., Bayesian networks for variable groups, (JMLR: Workshop and Conference Proceedings, vol. 52 (2016)), 380-391
[18] Pearl, J., Causality: Models, Reasoning, and Inference (2000), Cambridge University Press · Zbl 0959.68116
[19] Segal, E.; Pe’er, D.; Regev, A.; Koller, D.; Friedman, N., Learning module networks, J. Mach. Learn. Res., 6, 557-588 (October 2005)
[20] Silander, T.; Myllymäki, P., A simple approach for finding the globally optimal Bayesian network structure, (UAI (2006), AUAI Press), 445-452
[21] Slobodianik, N.; Zaporozhets, D.; Madras, N., Strong limit theorems for the Bayesian scoring criterion in Bayesian networks, J. Mach. Learn. Res., 10, 1511-1526 (2009) · Zbl 1235.68192
[22] Spirtes, P.; Glymour, C.; Scheines, R., Causation, Prediction, and Search (2000), Springer Verlag · Zbl 0806.62001
[23] Verma, T. S.; Pearl, J., Equivalence and synthesis of causal models, (UAI (1990), Elsevier), 255-270
[24] Xiang, Y.; Poole, D.; Beddoes, M. P., Multiply sectioned Bayesian networks and junction forests for large knowledge-based systems, Comput. Intell., 9, 171-220 (1993)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.