algcomparison: comparing the performance of graphical structure learning algorithms with TETRAD.

*(English)*Zbl 07306917Summary: In this report we describe a tool for comparing the performance of graphical causal structure learning algorithms implemented in the TETRAD freeware suite of causal analysis methods. Currently the tool is available as package in the TETRAD source code (written in Java). Simulations can be done varying the number of runs, sample sizes, and data modalities. Performance on this simulated data can then be compared for a number of algorithms, with parameters varied and with performance statistics as selected, producing a publishable report. The package presented here may also be used to compare structure learning methods across platforms and programming languages, i.e., to compare algorithms implemented in TETRAD with those implemented in MATLAB, Python, or R.

Reviewer: Reviewer (Berlin)

##### MSC:

68T05 | Learning and adaptive systems in artificial intelligence |

PDF
BibTeX
XML
Cite

\textit{J. D. Ramsey} et al., J. Mach. Learn. Res. 21, Paper No. 238, 6 p. (2020; Zbl 07306917)

Full Text:
Link

##### References:

[1] | David A Bessler and Seongpyo Lee. Money and prices: US data 1869-1914 (a study with directed graphs).Empirical Economics, 27(3):427-446, 2002. |

[2] | Selva Demiralp and Kevin D Hoover. Searching for the causal structure of a vector autoregression.Oxford Bulletin of Economics and Statistics, 65(s1):745-767, 2003. |

[3] | Mathias Drton and Marloes H Maathuis. Structure learning in graphical modeling.Annual Review of Statistics and Its Application, 4:365-393, 2017. |

[4] | Imme Ebert-Uphoff and Yi Deng. Causal discovery for climate research using graphical models.Journal of Climate, 25(17):5648-5665, 2012. |

[5] | Clark Glymour, Richard Scheines, Peter Spirtes, and Kevin Kelly.Discovering Causal Structure: Artificial Intelligence, Philosophy of Science, and Statistical Modeling. Academic Press, 1987. |

[6] | Christina Heinze-Deml, Marloes H Maathuis, and Nicolai Meinshausen. Causal structure learning.Annual Review of Statistics and Its Application, 5:371-391, 2018. |

[7] | Markus Kalisch, Martin M¨achler, Diego Colombo, Marloes H Maathuis, and Peter B¨uhlmann. Causal inference using graphical models with the R packagepcalg.Journal of Statistical Software, 47(11):1-26, 2012. |

[8] | Colleen Mills-Finnerty, Catherine Hanson, and Stephen Jose Hanson. Brain network response underlying decisions about abstract reinforcers.NeuroImage, 103:48-54, 2014. |

[9] | Kevin Murphy. The Bayes Net Toolbox for Matlab.Computing Science and Statistics, 33 (2):1024-1034, 2001. |

[10] | Martina Rau, Richard Scheines, Vincent Aleven, and Nikol Rummel. Does representational understanding enhance fluency – or vice versa? Searching for mediation models. In Proceedings of the Sixth International Conference on Educational Data Mining, 2013. |

[11] | Richard Scheines, Peter Spirtes, Clark Glymour, Christopher Meek, and Thomas Richardson. The TETRAD project: Constraint based aids to causal model specification.Multivariate Behavioral Research, 33(1):65-117, 1998. |

[12] | Marco Scutari. Learning bayesian networks with thebnlearnR package.Journal of Statistical Software, 35(3):1-22, 2010. |

[13] | Bill Shipley, Martin J Lechowicz, Ian Wright, and Peter B Reich. Fundamental trade-offs generating the worldwide leaf economics spectrum.Ecology, 87(3):535-541, 2006. |

[14] | Stephen M Smith, Karla L Miller, Gholamreza Salimi-Khorshidi, Matthew Webster, Christian F Beckmann, Thomas E Nichols, Joseph D Ramsey, and Mark W Woolrich. Network modelling methods for fMRI.NeuroImage, 54(2):875-891, 2011. |

[15] | Peter Spirtes and Kun Zhang. Causal discovery and inference: concepts and recent methodological advances.Applied Informatics, 3(3), 2016. |

[16] | Peter Spirtes, Richard Scheines, and Clark Glymour. Simulation studies of the reliability of computer-aided model specification using the TETRAD II, EQS, and LISREL programs. Sociological Methods & Research, 19(1):3-66, 1990. |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.