×

Application of adaptively refined unstructured grids in DSMC to shock wave simulations. (English) Zbl 1410.76142

Summary: An efficient, new DSMC framework based on AMR/octree unstructured grids is demonstrated for the modeling of near-continuum, strong shocks in hypersonic flows. The code is able to capture the different length scales in such flows through the use of a linearized representation of the unstructured grid using the Morton-Z space filling curve for efficient access of collision cells. Strategies are developed to achieve a strong scaling of nearly ideal speed up to 4096 processors and 87% efficiency (weak scaling) for 8192 processors for a strong shock created by flow over a hemisphere. To achieve these very good scalings, algorithms were developed to weight the computational work of a processor by the use of profiled run time data, create maps to optimize processor point-to-point communications, and efficiently generate new DSMC particles every time step. Rigorous thermal non-equilibrium required for modeling high Mach number shocks was achieved through the accurate modeling of collision temperatures on a sampling grid designed to be compatible with the above approaches. The simulation of a nitrogen flow over a double wedge configuration for near-continuum conditions reveals complex hypersonic SWBLIs as well as three-dimensional gas-surface kinetic effects such as velocity and temperature slip. The simulations show that three-dimensional effects are important in predicting the size of the separation bubble, which in turn, influences gas-surface measurements such as pressure and heat flux.

MSC:

76L05 Shock waves and blast waves in fluid mechanics
65C05 Monte Carlo methods
76K05 Hypersonic flows
76P05 Rarefied gas flows, Boltzmann equation in fluid mechanics
76M28 Particle methods and lattice-gas methods
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Bird, G. A., Molecular gas dynamics and the direct simulation of gas flows. Oxford engineering science series, (1994), Clarendon Press; 2nd ed.
[2] Tumuklu, O.; Levin, D. A.; Gimelshein, S. F.; Austin, J. M., Modeling of near-continuum laminar boundary layer shocks using DSMC, AIP Conf Proc, 1786, 1, 050004, (2016)
[3] Tumuklu, O.; Levin, D. A.; Theofilis, V., Investigation of unsteady, hypersonic, laminar separated flows over a double cone geometry using a kinetic approach, Phys Fluids, 30, 4, (2018), 046103
[4] S. Ivanov, M.; V. Kashkovsky, A.; Gimelshein, S.; Markelov, G.; Alexeenko, A.; Bondar, Y., SMILE system for 2D/3D DSMC computations, Proceedings of 25th International Symposium on Rarefied Gas Dynamics, St Petersburg, Russia, 21-28, (2006)
[5] Tumuklu, O.; Levin, D. A.; Theofilis, V., On the temporal evolution in laminar separated boundary layer shock-interaction flows using DSMC, In: 55th AIAA Aerospace Sciences Meeting, (2017)
[6] LeBeau, G., A parallel implementation of the direct simulation Monte Carlo method, Comput Methods Appl Mech Eng, 174, 3, 319-337, (1999) · Zbl 0961.76076
[7] Nompelis, I.; Schwartzentruber, T. E., A parallel implementation strategy for multi-level Cartesian grid based DSMC codes, In: 51st AIAA Aerospace Sciences Meeting, (2013)
[8] Allen, J.; Hauser, T., Foamdsmc: an object oriented parallel DSMC solver for rarefied flow applications, 45th AIAA Aerospace Sciences Meetings; AIAA 2007-1106, (2007)
[9] Huang, F.; Jin, X.; Mei, W.; Cheng, X., A new parallel algorithm of DSMC method, Procedia Eng, 126, 622-627, (2015)
[10] Roohi, E.; Darbandi, M., Recommendations on performance of parallel DSMC algorithm in solving subsonic nanoflows, Appl Math Model, 36, 5, 2314-2321, (2012)
[11] Gallis, M. A.; Torczynski, J. R.; Plimpton, S. J.; Rader, D. J.; Koehler, T., Direct simulation Monte Carlo: the quest for speed, AIP Conf Proc, 1628, 1, 27-36, (2014)
[12] http://sparta.sandia.gov; http://sparta.sandia.gov
[13] White, C.; Borg, M. K.; Scanlon, T. J.; Longshaw, S. M.; John, B.; Emerson, D. R.; Reese, J. M., Dsmcfoam+: an openfoam based direct simulation Monte Carlo solver, Comput Phys Commun, 224, 22-43, (2018)
[14] Jambunathan, R.; Levin, D. A., Advanced parallelization strategies using hybrid MPI-CUDA octree DSMC method for modeling flow through porous media, Comput Fluids, 149, 70-87, (2017) · Zbl 1390.76675
[15] Su, C.-C.; Smith, M.; Kuo, F.-A.; Wu, J.-S.; Hsieh, C.-W.; Tseng, K.-C., Large-scale simulations on multiple graphics processing units (GPUs) for the direct simulation Monte Carlo method, J Comput Phys, 231, 23, 7932-7958, (2012)
[16] Kashkovsky, A. V.; Shershnev, A. A.; Ivanov, M. S., Efficient CUDA implementation in the DSMC method, AIP Conference Proceedings, 1501, 511-518, (2012)
[17] Zabelok, S.; Arslanbekov, R.; Kolobov, V., Adaptive kinetic-fluid solvers for heterogeneous computing architectures, J Comput Phys, 303, 455-469, (2015) · Zbl 1349.76754
[18] Korkut, B.; Li, Z.; Levin, D. A., 3-D simulation of ion thruster plumes using octree adaptive mesh refinement, IEEE Trans Plasma Sci, 43, 5, 1706-1721, (2015)
[19] Korkut, B.; Levin, D. A., Three-dimensional simulations of backflows from ion thruster plumes using unstructured grid refinement, J Propul Power, 33, 264-275, (2017)
[20] Korkut, B.; Levin, D. A.; Tumuklu, O., Simulations of ion thruster plumes in ground facilities using adaptive mesh refinement, J Propul Power, 33, 681-696, (2017)
[21] http://www.gab.com.au/page4.html; http://www.gab.com.au/page4.html
[22] Su, C.; Tseng, K.; Cave, H.; Wu, J.; Lian, Y.; Kuo, T., Implementation of a transient adaptive sub-cell module for the parallel-DSMC code using unstructured grids, Comput Fluids, 39, 7, 1136-1145, (2010) · Zbl 1242.76289
[23] Sawant, S. S.; Korkut, B.; Tumuklu, O.; Levin, D. A., Development of an AMR octree DSMC approach for shock dominated flows, 53rd AIAA Aerospace Sciences Meeting, (2015)
[24] Sawant, S. S.; Jambunathan, R.; Tumuklu, O.; Korkut, B.; Levin, D. A., Study of shock-shock interactions using an unstructured AMR octree DSMC code, 54th AIAA Aerospace Sciences Meetings, (2016)
[25] Sawant S. Development of an AMR octree DSMC approach for shock dominated flows. Master’s thesis, University of Illinois at Urbana-Champaign, http://hdl.handle.net/2142/89046; Sawant S. Development of an AMR octree DSMC approach for shock dominated flows. Master’s thesis, University of Illinois at Urbana-Champaign, http://hdl.handle.net/2142/89046
[26] Berger, M.; Colella, P., Local adaptive mesh refinement for shock hydrodynamics, J Comput Phys, 82, 1, 64-84, (1989) · Zbl 0665.76070
[27] Korkut B. Development of a scalable gas-dynamics solver with adaptive mesh refinement, Ph.D. thesis. The Pennsylvania State University. https://etda.libraries.psu.edu/catalog/26718; Korkut B. Development of a scalable gas-dynamics solver with adaptive mesh refinement, Ph.D. thesis. The Pennsylvania State University. https://etda.libraries.psu.edu/catalog/26718
[28] Karypis G., Kumar V. METIS: Unstructured Graph Partitioning and Sparse Matrix Ordering System, Version 4.0. http://www.cs.umn.edu/ metis; Karypis G., Kumar V. METIS: Unstructured Graph Partitioning and Sparse Matrix Ordering System, Version 4.0. http://www.cs.umn.edu/ metis
[29] Pellegrini F. Scotch and libScotch 5.1 user’s guide. http://www.labri.fr/perso/pelegrin/scotch/; Pellegrini F. Scotch and libScotch 5.1 user’s guide. http://www.labri.fr/perso/pelegrin/scotch/
[30] Cray Performance Measurement and Analysis Tools (CPMAT). https://bluewaters.ncsa.illinois.edu/cpmat; Cray Performance Measurement and Analysis Tools (CPMAT). https://bluewaters.ncsa.illinois.edu/cpmat
[31] Samet, H., The quadtree and related hierarchical data structures, ACM Computing Surveys (CSUR), 16, 2, 187-260, (1984)
[32] Frisken, S. F.; Perry, R. N., Simple and efficient traversal methods for quadtrees and octrees, Journal of Graphics Tools, 7, 3, 1-11, (2002) · Zbl 1098.68940
[33] Zhang, C.; Schwartzentruber, T. E., Robust cut-cell algorithms for DSMC implementations employing multi-level Cartesian grids, Comput Fluids, 69, 122-135, (2012) · Zbl 1365.76268
[34] Koura, K.; Matsumoto, H., Variable soft sphere molecular model for inverse-power-law or lennard-Jones potential, Phys Fluids A, 3, 10, 2459-2465, (1991) · Zbl 0825.76715
[35] Ivanov, M.; Rogasinsky, S., Analysis of numerical techniques of the direct simulation Monte Carlo method in the rarefied gas dynamics, Russian J Numer Anal Math Modell, 3, 6, 453-466, (1988) · Zbl 0825.65102
[36] Roohi, E.; Stefanov, S., Collision partner selection schemes in DSMC: from micro/nano flows to hypersonic flows, Phys Rep, 656, 1-38, (2016)
[37] Goshayeshi, B.; Roohi, E.; Stefanov, S., DSMC simulation of hypersonic flows using an improved SBT-TAS technique, J Comput Phys, 303, 28-44, (2015) · Zbl 1349.76154
[38] Goshayeshi, B.; Roohi, E.; Stefanov, S., A novel simplified Bernoulli trials collision scheme in the direct simulation Monte Carlo with intelligence over particle distances, Phys Fluids, 27, 10, 107104, (2015)
[39] Borgnakke, C.; Larsen, P. S., Statistical collision model for Monte Carlo simulation of polyatomic gas mixture, J Comput Phys, 18, 4, 405-420, (1975)
[40] III, F. E.L.; Haas, B. L.; Boyd, I. D., Resolution of differences between collision number definitions in particle and continuum simulations, Phys Fluids A, 3, 9, 2282-2284, (1991)
[41] Parker, J. G., Rotational and vibrational relaxation in diatomic gases, Phys Fluids, 2, 4, 449-462, (1959)
[42] Millikan, R. C.; White, D. R., Systematics of vibrational relaxation, J Chem Phys, 39, 12, 3209-3213, (1963)
[43] Park, C., Problems of rate chemistry in the flight regimes of aeroassisted orbital transfer vehicles, 19th Thermophysics Conference, 1730, (1984)
[44] Swantek, A. B.; Austin, J. M., Heat transfer on a double wedge geometry in hypervelocity air and nitrogen flows, 50th AIAA Aerospace Sciences Meeting, (2012)
[45] Patil, V. N.; Levin, D. A.; Gimelshein, S. F.; Austin, J. M., Study of shock-shock interactions for the HET facility double wedge configuration using the DSMC approach, 43rd AIAA Fluid Dynamics Conference; AIAA 2013-3202, (2013)
[46] Délery, J., Physical introduction. Cambridge aerospace series, 5-86, (2011), Cambridge University Press
[47] Harvey, J. K., Shock wave-boundary-layer interactions occurring in hypersonic flows in the upper atmosphere. Cambridge aerospace series, 336-372, (2011), Cambridge University Press · Zbl 1256.74003
[48] Martens, S.; Kinzie, K. W.; McLaughlin, D. K., Measurements of Kelvin-Helmholtz instabilities in a supersonic shear layer, AIAA J, 32, 8, 1633-1639, (1994)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.