×

On the parallelization of unsteady BEM problems with variable mesh size. (English) Zbl 1244.76055

Summary: This paper presents code acceleration strategies for a boundary element method (BEM) simulation of an unsteady free-surface problem with a variable mesh size. The evolution of the film and droplet field emanating from a classical swirl injector/nozzle is used as a test case for the methodology. The unsteady free-surface problem (dynamic grid problem) presents challenges for load balancing the inversion of a matrix that is changing size with time. Since inversion of the matrix of linear equation coefficients represents the dominant computational cost for large problems, the parallelization of the second-order BEM code is implemented using a portable computation library, ScaLAPACK. A different processor grid topology using ScaLAPACK has been implemented and compared to the recommendation of ScaLAPACK guide. Implementation of ScaLAPACK in the solver routine of BEM has been successful and a significant simulation time reduction is demonstrated on an Opteron Dual Processor high-performance computing cluster employing two processors per node.

MSC:

76M15 Boundary element methods applied to problems in fluid mechanics
76B07 Free-surface potential flows for incompressible inviscid fluids
65Y05 Parallel numerical computation

Software:

MPI; ScaLAPACK; BLACS; LAPACK
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Hilbing, J. H.; Heister, S. D., Droplet size control in liquid jet breakup, Physics of Fluids, 8, 6, 1574-1581 (1996) · Zbl 1087.76013
[2] Hilbing, J. H.; Heister, S. D., Nonlinear simulation of a high-speed viscous liquid jet, Atomization and Sprays, 2, 1-24 (1997)
[3] Heister, S. D.; Rutz, M.; Hilbing, J. H., Effect of acoustic perturbations on liquid jet atomization, Journal of Propulsion and Power, 13, 82-88 (1997)
[4] Rump, K.; Heister, S. D., Modeling the effect of unsteady chamber conditions on atomization processes, Journal of Propulsion and Power, 14, 576-578 (1998)
[5] Heister, S. D., Boundary element methods for two-fluid free surface flows, Engineering Analysis with Boundary Elements, 19, 309-317 (1997)
[6] Yoon, S. S.; Heister, S. D., A nonlinear atomization model based on a boundary layer instability mechanism, Physics of Fluids, 16, 1, 47-61 (2004) · Zbl 1186.76592
[7] Park, H.; Yoon, S. S.; Heister, S. D., On the nonlinear stability of a swirling liquid jet, International Journal of Multiphase Flow, 32, 9, 1100-1109 (2006) · Zbl 1136.76604
[8] Park, H.; Heister, S. D., Nonlinear simulation of free surfaces and atomization in pressure swirl atomizer, Physics of Fluids, 18, 5 (2006)
[9] Symm, G. T., Boundary elements on a distributed array processor, Engineering Analysis with Boundary Elements, 1, 3, 162-165 (1984)
[10] Davies, A. J., The boundary element method on the icl dap, Parallel Computing, 8, 1/3, 335-343 (1988) · Zbl 0661.65117
[11] Davies, A. J., Fine-grained parallel boundary elements, Engineering Analysis with Boundary Elements, 19, 1, 13-16 (1997)
[12] Lobry, J.; Manneback, P., Parallel mr-bem using scalapack, Engineering Analysis with Boundary Elements, 19, 1, 41-48 (1997)
[13] Song, S. W.; Baddour, R. E., Parallel processing for boundary element computations on distributed systems, Engineering Analysis with Boundary Elements, 19, 1, 73-84 (1997)
[14] Davies, A. J., Parallel implementations of the boundary element method, Computers & Mathematics with Applications, 31, 6, 33-40 (1996) · Zbl 0853.65125
[15] Zhao, X. Y.; Liao, S. J., A short note on the general boundary element method for viscous flows with high Reynolds number, International Journal for Numerical Methods in Fluids, 42, 4, 349-359 (2003) · Zbl 1055.76037
[16] Cunha, M. T.F.; Telles, J. C.F.; Coutinho, A. L.G. A.; Panetta, J., On the parallelization of boundary element codes using standard and portable libraries, Engineering Analysis with Boundary Elements, 28, 7, 893-902 (2004) · Zbl 1075.65140
[17] Hilbing JH. Nonlinear modeling of atomization processes. PhD thesis, Purdue University, 1996.; Hilbing JH. Nonlinear modeling of atomization processes. PhD thesis, Purdue University, 1996.
[18] Hilbing, J. H.; Heister, S. D.; Spangler, C. A., A boundary-element method for atomization of a finite liquid jet, Atomization and Sprays, 5, 6, 621-638 (1995)
[19] Liggett, J. A.; Liu, P. L.F., The boundary integral equation method for porous media flow, George Allen and Unwin (1983) · Zbl 0622.76103
[20] Park H. Flow characteristics of viscous high-speed jets in axial/swirl injectors. PhD thesis, Purdue University, 2005.; Park H. Flow characteristics of viscous high-speed jets in axial/swirl injectors. PhD thesis, Purdue University, 2005.
[21] Abramowitz, M.; Stegun, F. A., Handbook of mathematical functions (1970), Dover Publications: Dover Publications New York
[22] Yoon SS, Heister SD. A fully nonlinear primary atomization. In: 38th AIAA/ASME/SAE/ASEE Joint Propulsion Conference and Exhibit, AIAA, 2002, Indianapolis, IN.; Yoon SS, Heister SD. A fully nonlinear primary atomization. In: 38th AIAA/ASME/SAE/ASEE Joint Propulsion Conference and Exhibit, AIAA, 2002, Indianapolis, IN.
[23] Medina DE. On droplets and boundary elements. Sibley School of Mechanical and Aerospace Engineering, Cornell University, Technical Report FDA-89-12, Ithaca, New York, 1989.; Medina DE. On droplets and boundary elements. Sibley School of Mechanical and Aerospace Engineering, Cornell University, Technical Report FDA-89-12, Ithaca, New York, 1989.
[24] Smirnov, V. I., A course of higher mathematics (1964), Pergamon Press: Pergamon Press New York · Zbl 0121.25904
[25] Yoon SS. A fully nonlinear model for atomization of high-speed jets. PhD thesis, Purdue University, 2002.; Yoon SS. A fully nonlinear model for atomization of high-speed jets. PhD thesis, Purdue University, 2002.
[26] Blackford, L. S.; Choi, J.; Cleary, A.; D’Azevedo, E.; Demmel, J.; Dhillon, I., ScaLAPACK users’ guide, Society for Industrial and Applied Mathematics (1997) · Zbl 0886.65022
[27] PGI CDK 7.2 Cluster Development Kit installation guide 〈http://www.pgroup.com/doc/pgicdkinstall.pdf; PGI CDK 7.2 Cluster Development Kit installation guide 〈http://www.pgroup.com/doc/pgicdkinstall.pdf
[28] Snir, M.; Otto, S. W.; Huss-Lederman, S.; Walker, D. W.; Dongarra, J. J., MPI: the complete reference (1996), MIT Press: MIT Press Cambridge, MA
[29] Dongarra JJ, Whaley RC. LAPACK working note 94: A user’s guide to the BLACS v1.1. University of Tennessee, Technical Report: UT-CS-95-281, Knoxville, Tennessee, 1995.; Dongarra JJ, Whaley RC. LAPACK working note 94: A user’s guide to the BLACS v1.1. University of Tennessee, Technical Report: UT-CS-95-281, Knoxville, Tennessee, 1995.
[30] Choi, J.; Dongarra, J. J.; Ostrouchov, L. S.; Petitet, A. P.; Walker, D. W.; Whaley, R. C., Design and implementation of the ScaLAPACK LU, QR, and Cholesky Factorization Routines, Scientific Programming, 5, 3, 173-184 (1996)
[31] Kim D, Yoon Y, Han P. Effect of flow condition and geometry on flow characteristics of a swirl injector. ILASS Americas 16th annual conference, Monterey, CA, 2003.; Kim D, Yoon Y, Han P. Effect of flow condition and geometry on flow characteristics of a swirl injector. ILASS Americas 16th annual conference, Monterey, CA, 2003.
[32] Dumouchel, C., On the experimental investigation on primary atomization of liquid streams, Experiments in Fluids, 45, 371-422 (2008)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.