×

Parallel multiphysics coupling: algorithmic and computational performances. (English) Zbl 1483.76048

Summary: Multiphysics problems involve the couplings of different sets of partial differential equations. Partitioned methods consider the individual solutions of each set, which upon iterating, converge to the monolithic solution. The main drawback of partitioned methods is the additional iterative loop, which can be done a la Jacobi (parallel) or a la Gauss-Seidel (sequential). The latter method has worse algorithmic properties than the last method, but makes better use of the computational resources. We will assess both the algorithmic and computational performances of these couplings, in the context of multiphysics surface coupling. To enhance the computational performance of the Gauss-Seidel method, we will introduce an overloading strategy together with an MPI barrier using DLB library. This approach makes the Gauss-Seidel method almost as parallel efficient as the Jacobi method. Our methodology is based on simple performance models, and the solution of multiphysics problems to show the validity of the proposed approach.

MSC:

76M99 Basic methods in fluid mechanics
65N55 Multigrid methods; domain decomposition for boundary value problems involving PDEs
65Y10 Numerical algorithms for specific classes of architectures
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Barcelona Supercomputing Center. n.d.“Dynamic Load Balancing Library.” https://pm.bsc.es/dlb.
[2] Beckert, A., Coupling Fluid (CFD) and Structural (FE) Models Using Finite Interpolation Elements, Aerospace Science and Technology, 4, 13-22 (2000) · Zbl 0999.74106 · doi:10.1016/S1270-9638(00)00111-5
[3] de Boer, A.; van Zuijlen, A.; Bijl, H., Review of Coupling Methods for Non-Matching Meshes, Computer Methods in Applied Mechanics and Engineering, 196, 1515-1525 (2007) · Zbl 1173.74485 · doi:10.1016/j.cma.2006.03.017
[4] Buis, S.; Piacentini, A.; Déclat, D., PALM: A Computational Framework for Assembling High-Performance Computing Applications, Concurrency and Computation: Practice and Experience, 18, 2, 231-245 (2006) · doi:10.1002/cpe.914
[5] Bungartz, H.-J.; Lindner, F.; Gatzhammer, B.; Mehl, M.; Scheufele, K.; Shukaev, A.; Uekermann, B., PreCICE - A Fully Parallel Library for Multi-Physics Surface Coupling, Computers & Fluids, 141, 250-258 (2016) · Zbl 1390.76004 · doi:10.1016/j.compfluid.2016.04.003
[6] Causin, P.; Gerbeau, J.; Nobile, F., Added-Mass Effect in the Design of Partitioned Algorithms for Fluid-Structure Problems, Computer Methods in Applied Mechanics and Engineering, 194, 4506-4527 (2005) · Zbl 1101.74027 · doi:10.1016/j.cma.2004.12.005
[7] Degroote, J.; Bathe, K.-J.; Vierendeels, J., Performance of a New Partitioned Procedure Versus a Monolithic Procedure in Fluid-Structure Interaction, Computers and Structures, 87, 11-12, 793-801 (2009) · doi:10.1016/j.compstruc.2008.11.013
[8] Dettmer, W.; Perić, D., A Computational Framework for Fluid-Structure Interaction: Finite Element Formulation and Applications, Computer Methods in Applied Mechanics and Engineering, 195, 5754-5779 (2006) · Zbl 1155.76354 · doi:10.1016/j.cma.2005.10.019
[9] Dippold, Joel.n.d.“Intel MPI Library – Legacy Documentation.” https://software.intel.com/en-us/articles/intel-mpi-library-documentation-overview.
[10] Duchaine, F.; Jauré, S.; Poitou, D.; Quémerais, E.; Staffelbach, G.; Morel, T.; Gicquel, L., Analysis of High Performance Conjugate Heat Transfer with the Openpalm Coupler, Computational Science & Discovery, 8, 1 (2015) · doi:10.1088/1749-4699/8/1/015003
[11] The Editors of Encyclopaedia Britannica. n.d.“Encyclopaedia Britannica: Electrocardiography.” https://www.britannica.com/science/electrocardiography.
[12] Errera, M.; Dugeai, A.; Girodroux-Lavigne, P.; Garaud, J.; Poinot, M.; Cerqueira, S.; Chaineray, G., Multi-Physics Coupling Approaches for Aerospace Numerical Simulations, AerospaceLab, 2, 1-16 (2011)
[13] Felippa, C. A.; Park, K.; Farhat, C., Partitioned Analysis of Coupled Mechanical Systems, Computer Methods in Applied Mechanics and Engineering, 190, 24-25, 3247-3270 (2001) · Zbl 0985.76075 · doi:10.1016/S0045-7825(00)00391-1
[14] Förster, C.; Wall, W. A.; Ramm, E., Artificial Added Mass Instabilities in Sequential Staggered Coupling of Nonlinear Structures and Incompressible Viscous Flow, Computer Methods in Applied Mechanics and Engineering, 196, 7, 1278-1293 (2007) · Zbl 1173.74418 · doi:10.1016/j.cma.2006.09.002
[15] Fournier, Y., Massively Parallel Location and Exchange Tools for Unstructured Mesh-Based CFD, International Journal of Computational Fluid Dynamics
[16] Funaro, D.; Quarteroni, A.; Zanolli, P., An Iterative Procedure with Interface Relaxation for Domain Decomposition Methods, SIAM Journal on Numerical Analysis, 25, 1213-1236 (1988) · Zbl 0678.65082 · doi:10.1137/0725069
[17] Garcia, M.; Labarta, J.; Corbalan, J., Hints to Improve Automatic Load Balancing with Lewi for Hybrid Applications, Journal of Parallel and Distributed Computing, 74, 9, 2781-2794 (2014) · doi:10.1016/j.jpdc.2014.05.004
[18] Garcia-Gasulla, M.; Houzeaux, G.; Ferrer, R.; Artigues, A.; López, V.; Labarta, J.; Vázquez, M., Mpi+ X: Task-based Parallelisation and Dynamic Load Balance of Finite Element Assembly, International Journal of Computational Fluid Dynamics, 33, 3, 115-136 (2019) · Zbl 07474475 · doi:10.1080/10618562.2019.1617856
[19] Garcia-Gasulla, M.; Mantovani, F.; Josep-Fabrego, M.; Eguzkitza, B.; Houzeaux, G., Runtime Mechanisms to Survive New HPC Architectures: A Use Case in Human Respiratory Simulations, The International Journal of High Performance Computing Applications (2019) · doi:1094342019842919
[20] Houzeaux, G.2002. “A Geometrical Domain Decomposition Method in Computational Fluid Dynamics.” PhD thesis, Supervisor: R. Codina. · Zbl 1118.76002
[21] Houzeaux, G.; Borrell, R.; Cajas, J.; Vázquez, M., Extension of the Parallel Sparse Matrix Vector Product (SPMV) for the Implicit Coupling of Pdes on Non-Matching Meshes, Computers & Fluids, 173, 216-225 (2018) · Zbl 1410.65134 · doi:10.1016/j.compfluid.2018.03.006
[22] Houzeaux, G.; Cajas, J.; Discacciati, M.; Eguzkitza, B.; Gargallo-Peiró, A.; Rivero, M.; Vázquez, M., Domain Decomposition Methods for Domain Composition Purpose: Chimera, Overset, Gluing and Sliding Mesh Methods, Archives of Computational Methods in Engineering, 24, 4, 1033-1070 (2017) · Zbl 1437.65220 · doi:10.1007/s11831-016-9198-8
[23] Houzeaux, G.; de la Cruz, R.; Owen, H.; Vázquez, M., Parallel Uniform Mesh Multiplication Applied to a Navier-Stokes Solver, Computers & Fluids, 80, 142-151 (2013) · Zbl 1284.76250 · doi:10.1016/j.compfluid.2012.04.017
[24] Houzeaux, G.; Garcia-Gasulla, M.; Cajas, J.; Artigues, A.; Olivares, E.; Labarta, J.; Vázquez, M., Dynamic Load Balance Applied to Particle Transport in Fluids, International Journal of Computational Fluid Dynamics, 30, 408-418 (2016) · Zbl 1497.76057 · doi:10.1080/10618562.2016.1227070
[25] Keyes, D. E.; McInnes, L. C.; Woodward, C.; Gropp, W.; Myra, E.; Pernice, M.; Bell, J., Multiphysics Simulations, Challenges and Opportunities, International Journal of High Performance Computing Applications, 27, 1, 4-83 (2012) · doi:10.1177/1094342012468181
[26] Küttler, U.; Wall, W. A., Fixed-Point Fluid-Structure Interaction Solvers with Dynamic Relaxation, Computational Mechanics, 43, 1, 61-72 (2008) · Zbl 1236.74284 · doi:10.1007/s00466-008-0255-5
[27] Llort, G., Servat, H., González, J., Giménez, J., and Labarta, J.. 2013. “On the Usefulness of Object Tracking Techniques in Performance Analysis.” SC ’13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, Denver, Colorado. New York, NY: Association for Computing Machinery. doi:10.1145/2503210.2503267.
[28] Malan, A. G.; Oxtoby, O. F., An Accelerated, Fully-Couple, Parallel 3D Hybrid Finite-Volume Fluid-Structure-Interaction Scheme, Computational Methods in Applied Mechanics and Engineering, 253, 1, 426-438 (2013) · Zbl 1297.74041 · doi:10.1016/j.cma.2012.09.004
[29] Marenostrum 4. 2020. Accessed 21 February 2020. https://www.bsc.es/marenostrum/marenostrum.
[30] Mehl, M.; Uekermann, B.; Bijl, H.; Blom, D.; Gatzhammer, B.; Van Zuijlen, A., Parallel Coupling Numerics for Partitioned Fluid-Structure Interaction Simulations, Computers and Mathematics with Applications, 71, 869-891 (2016) · Zbl 1443.65164 · doi:10.1016/j.camwa.2015.12.025
[31] Michopoulos, J. G.; Farhat, C.; Fish, J., Modeling and Simulation of Multiphysics Systems, Journal of Computing and Information Science in Engineering, 5, 3, 198-213 (2005) · doi:10.1115/1.2031269
[32] Miranda, F., and Abreu, C.. 2015. Handbook of Research on Computational Simulation and Modeling in Engineering. Advances in Systems Analysis, Software Engineering, and High Performance Computing Book Series, Engineering Science Reference. https://books.google.es/books?id=XIQQswEACAAJ.
[33] MPI Forum. 2012. MPI: A Message-Passing Interface Standard Version 3.0. Technical Report. http://mpi-forum.org/docs/mpi-3.0/mpi30-report.pdf.
[34] The Open MPI Project. n.d.“Open MPI Documentation.” https://www.open-mpi.org/doc.
[35] Piacentini, A., Morel, T., Thévenin, A., and Duchaine, F.. 2011. “O-Palm: An Open Source Dynamic Parallel Coupler.” In Proceedings of the IV International Conference on Computational Methods for Coupled Problems in Science and Engineering COUPLED PROBLEMS 2011, Kos Island, Greece, June 20-22, edited by M. Papadrakakis, E. Oñate, and B. Schrefler.
[36] Pillet, V., Labarta, J., Cortes, T., and Girona, S.. 1995. “Paraver: A Tool to Visualize and Analyze Parallel Code.” In Proceedings of WoTUG-18: Transputer and Occam Developments, Vol. 44, 17-31. IOS Press.
[37] PLE. 2020. “PLE (Parallel Location and Exchange) Documentation.” Accessed 21 February 2020. https://www.code-saturne.org/cms/sites/default/files/docs/ple/doxygen/index.html.
[38] Predari, M.2016. “Load Balancing for Parallel Coupled Simulations.” Theses, Université de Bordeaux, LaBRI; Inria Bordeaux Sud-Ouest. https://hal.inria.fr/tel-01518956.
[39] Quarteroni, A., and Valli, A.. 1999. Domain Decomposition Methods for Partial Differential Equations. Numerical Mathematics and Scientific Computation. Clarendon Press. https://books.google.es/books?id=CswwZ9Ca9IIC. · Zbl 0931.65118
[40] Radtke, L.; Larena-Avellaneda, A.; Debus, E. S.; Düster, A., Convergence Acceleration for Partitioned Simulations of the Fluid-Structure Interaction in Arteries, Computational Mechanics (2016) · Zbl 1382.74049 · doi:10.1007/s00466-016-1268-0
[41] Refloch, A.; Courbet, B.; Murrone, A.; Villedieu, P.; Laurent, C.; Gilbank, P.; Troyes, J., CEDRE Software, AerospaceLab, 2, 1-10 (2011)
[42] Saad, Y., Iterative Methods for Sparse Linear Systems (2003), Philadelphia: SIAM, Philadelphia · Zbl 1002.65042
[43] Santiago, A.; Aguado-Sierra, J.; Zavala-Aké, M.; Doste-Beltran, R.; Gómez, S.; Arís, R.; Cajas, J. C.; Casoni, E.; Vázquez, M., Fully Coupled Fluid-Electro-Mechanical Model of the Human Heart for Supercomputers, International Journal for Numerical Methods in Biomedical Engineering, 34, 12 (2018) · doi:10.1002/cnm.3140
[44] Santiago, A.; Zavala-Aké, M.; Borell, R.; Houzeaux, G.; Vázquez, M., HPC Compact Quasi-Newton Algorithm for Interface Problems, Journal of Fluids and Structures, 96, 103009 (2020) · doi:10.1016/j.jfluidstructs.2020.103009
[45] Tang, H.; Haynes, R.; Houzeaux, G., A Review of Domain Decomposition Methods for Simulation of Fluid Flows: Concepts, Algorithms, and Applications, Archives of Computational Methods in Engineering, 1-33 (2020) · doi:10.1007/s11831-019-09394-0
[46] Tang, Y.-H.; Kudo, S.; Bian, X.; Lia, Z.; Karniadakis, G. E., Multiscale Universal Interface: A Concurrent Framework for Coupling Heterogeneous Solvers, Journal of Computational Physics, 297, 13-31 (2015) · Zbl 1349.76738 · doi:10.1016/j.jcp.2015.05.004
[47] Wall, W. A.; Genkinger, S.; Ramm, E., A Strong Coupling Partitioned Approach for Fluid-structure Interaction with Free Surfaces, Computers & Fluids, 36, 1, 169-183 (2007) · Zbl 1181.76147 · doi:10.1016/j.compfluid.2005.08.007
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.