A two-level parallelization algorithm for the direct simulation Monte Carlo method of problems of rarefied gas dynamics
-
Nikolay Y. Bykov
and
Stanislav A. Fyodorov
Abstract
A two-level parallelization algorithm is proposed for the direct simulation Monte Carlo (DSMC) method. The algorithm is based on the decomposition of the computational domain into subdomains, which in turn are divided into blocks. The algorithm is implemented in the DSMC software code using MPI and OpenMP technologies. The algorithm was tested on the problem of spherical gas expansion into a vacuum from an evaporating surface, which is of interest for astrophysical applications. The problem is characterized both by large gradients of physical parameters and large time of stationary solution achievement. The calculations were carried out on the resources of the Polytechnic – RSK Tornado supercomputer. When solving the problem, OpenMP technology is used to calculate blocks of subdomain by single process associated with single node, each containing 28 threads with shared memory. MPI technology is used to exchange data on migrating between subdomains particles among nodes with distributed memory. The speedup of the algorithm was 35 on 64 nodes of the supercomputer. Additionally, a single-level decomposition algorithm was tested, implemented only by MPI tools both for calculating subdomains within them. The high efficiency of the single-level algorithm for a relatively small number of threads is shown. The boundary of the preferred use of the two-level algorithm is defined.
Funding statement: The work was supported by the Russian Science Foundation (project 22-11-00078). Computing resources were provided by the Polytechnic Supercomputer Center.
References
[1] G. A. Bird, Molecular Gas Dynamics and the Direct Simulation of Gas Flows. Clarenton Press, Oxford, 1994.10.1093/oso/9780198561958.001.0001Search in Google Scholar
[2] G. A. Bird, The DSMC Method. CreateSpace Independent Publishing Platform, 2013.Search in Google Scholar
[3] A. V. Bulgakov, N. Y. Bykov, A. I. Safonov, Y. G. Shukhov, and S. V. Starinskiy, Silver vapor supersonic jets: Expansion dynamics, cluster formation, and film deposition. Materials 16 (2023), 4876.10.3390/ma16134876Search in Google Scholar PubMed PubMed Central
[4] N. Y. Bykov, Yu. E. Gorbachev, and G. A. Lukyanov, Parallel direct Monte Carlo simulation of gas outflow into vacuum from a pulsed source. Thermophysics and Aeromechanics 5 (1998), No. 3, 439–445.Search in Google Scholar
[5] N. Y. Bykov and Yu. E. Gorbachev, Cluster formation in copper vapor jet expanding into vacuum: the direct simulation Monte Carlo. Vacuum 163 (2019), 119–127.10.1016/j.vacuum.2019.02.007Search in Google Scholar
[6] N. Y. Bykov and V. V. Zakharov, Binary gas mixture outflow into vacuum through an orifice. Phys. Fluids 32 (2020), 067109.10.1063/5.0009548Search in Google Scholar
[7] N. Y. Bykov and V. V. Zakharov, Rarefied gas mixtures with large species mass ratio: Outflow into vacuum. Phys. Fluids 34 (2022), 057106.10.1063/5.0089628Search in Google Scholar
[8] N. Yu. Bykov and S. A. Fyodorov, Data parallelization algorithms for the direct simulation Monte Carlo method for parefied gas flows on the basis of OpenMP technology. Computational Mathematics and Mathematical Physics 63 (2023), No. 12, 2275–2296.10.1134/S0965542523120072Search in Google Scholar
[9] N. Y. Bykov, Yu. E. Gorbachev, and S. A. Fyodorov, Highly underexpanded rarefied jet flows. In: Front. Mech. Eng. 2023. Sec. Fluid Mechanics. 9. (2023).10.3389/fmech.2023.1216927Search in Google Scholar
[10] N. Y. Bykov, S. A. Fyodorov, and Yu. E. Gorbachev, Small cluster formation in a free argon jet. Phys. Fluids 36 (2024), 087134.10.1063/5.0222569Search in Google Scholar
[11] A. Frezzotti, A numerical investigation of the steady evaporation of a polyatomic gas. European Journal of Mechanics B/Fluids 26 (2007), 93–104.10.1016/j.euromechflu.2006.03.007Search in Google Scholar
[12] I. A. Grishin, V. V. Zakharov, and G. A. Lukyanov, Parallelization according to direct Monte Carlo simulation data in molecular gas dynamics. Preprint 3–98 Institute of High-Performance Computing and Databases, Saint-Petersburg, 1998.Search in Google Scholar
[13] D. Gao and T. E. Schwartzentruber, Optimizations and OpenMP implementation for the direct simulation Monte Carlo method. Comput. Fluids 42 (2011), 73–81.10.1016/j.compfluid.2010.11.004Search in Google Scholar
[14] M. Ivanov, G. Markelov, S. Taylor, and J.Watts, Parallel DSMC strategies for 3D computations. In: Proc. Parallel CFD’96 North Holland, Amsterdam, 1997, pp. 485–492.10.1016/B978-044482327-4/50128-5Search in Google Scholar
[15] S. Kirkpatrick and E. A. Stoll, Very fast shift-register sequence random number generator. J. Comput. Phys. 40 (1981) 517–526.10.1016/0021-9991(81)90227-8Search in Google Scholar
[16] A. L. Kusov, Unsteady rarefied-gas expansion on evaporation of a condensed material from its overheated surface. Fluid Dynamics 47 (2012), No. 4, 543–555.10.1134/S0015462812040138Search in Google Scholar
[17] A. L. Kusov and V. V. Lunev, Expansion waves accompanying material evaporation into a vacuum or a low-density medium. Fluid Dynamics 55 (2020), No. 2, 252–263.10.1134/S0015462820020081Search in Google Scholar
[18] G. A. Lukyanov and G. O. Khanlarov, Stationary expansion of water vapor from the surface of a sphere into a vacuum. Thermophysics and aeromechanics 7 (2000), No. 4, 511–521.Search in Google Scholar
[19] S. J. Plimpton, S. G. Moore, A. Borner, A. K. Stagg, T. P. Koehler, J. R. Torczynski, and M. A. Gallis, Direct simulation Monte Carlo on petaflop supercomputers and beyond. Phys. Fluids 31 (2019), 086101.10.1063/1.5108534Search in Google Scholar
[20] M. Shamseddine, I. Lakkis, A novel spatio-temporally adaptive parallel three-dimensional DSMC solver for unsteady rarefied micro/nano gas flows. Comput. Fluids 186 (2019), 1–14.10.1016/j.compfluid.2019.03.007Search in Google Scholar
[21] Y. Shou, M. Combi, G. Toth, V. Tenishev, N. Fougere, X. Jia, M. Rubin, Z. Huang, K. Hansen, T. Gombosi, and A. Bieler, A new 3D multi-fluid model: a study of kinetic effects and variations of physical conditions in the cometary coma. Astrophys. J. 833 (2016), 160–172.10.3847/1538-4357/833/2/160Search in Google Scholar
[22] T. E. Schwartzentruber and I. D. Boyd, Progress and future prospects for particle-based simulation of hypersonic flow. Prog. Aerosp. Sci. 72 (2015), 66–79.10.1016/j.paerosci.2014.09.003Search in Google Scholar
[23] S. Stefanov, E. Roohi, and A. Shoja-Sani, A novel transient-adaptive subcell algorithm with a hybrid application of different collision techniques in direct simulation Monte Carlo (DSMC). Phys. Fluids 34 (2022), 092003.10.1063/5.0104613Search in Google Scholar
[24] V. Tenishev and M. Combi, A global kinetic model for cometary comae: the evolution of the coma of the Rosetta target comet Churyumov–Gerasimenko. Astrophys. J. 685 (2008), 659–677.10.1086/590376Search in Google Scholar
[25] V. A. Titarev and E. M. Shakhov, Heat transfer and evaporation from a flat surface into a half-space with a sudden increase in body temperature. Fluid Dynamics 37 (2002), No. 1, 147–156.Search in Google Scholar
[26] V. A. Titarev and E. M. Shakhov, Numerical study of unsteady evaporation and heat transfer from a spherical surface. Fluid Dynamics 40 (2005), No. 1, 159–168.10.1007/s10697-005-0054-zSearch in Google Scholar
[27] Top 50 Supercomputers. URL: https//top50.supercomputers.ru/list (Access date: 30.10.2024).Search in Google Scholar
[28] OpenMP on a 2-socket system – Stack Overflow. URL: https//stackoverflow.com/questions/24219263/openmp-on-a-2-socketsystem (Access date: 30.10.2024).Search in Google Scholar
[29] sched_numa, mm_ Use active_nodes nodemask to limit numa migrations – kernel_git_torvalds_linux.git - Linux kernel source tree. URL: https//git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=10f39042711ba21773763f267b4943a2c66c8bef (Access date: 30.10.2024).Search in Google Scholar
© 2025 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- A two-level parallelization algorithm for the direct simulation Monte Carlo method of problems of rarefied gas dynamics
- Conservative correction of the sequential noniterative scheme for reactive transport problems with minerals precipitation–dissolution and variable media properties
- Numerical solution of BVP for the incompressible Navier–Stokes equations at large Reynolds numbers
- Low-rank Monte Carlo method for aggregation kinetics with particle sources
- Numerical simulation of propeller aerodynamics and tonal noise using parallel code ‘Gerbera’
Articles in the same Issue
- Frontmatter
- A two-level parallelization algorithm for the direct simulation Monte Carlo method of problems of rarefied gas dynamics
- Conservative correction of the sequential noniterative scheme for reactive transport problems with minerals precipitation–dissolution and variable media properties
- Numerical solution of BVP for the incompressible Navier–Stokes equations at large Reynolds numbers
- Low-rank Monte Carlo method for aggregation kinetics with particle sources
- Numerical simulation of propeller aerodynamics and tonal noise using parallel code ‘Gerbera’
