Anderson–Picard Based Nonlinear Preconditioning of the Newton Iteration for Non-Isothermal Flow Simulations
-
Elizabeth Hawkins
Abstract
We propose, analyze, and test a nonlinear preconditioning technique to improve the Newton iteration for non-isothermal flow simulations. We prove that by first applying an Anderson accelerated Picard step, Newton becomes unconditionally stable (under a uniqueness condition on the data) and its quadratic convergence is retained but has less restrictive sufficient conditions on the Rayleigh number and initial condition’s accuracy. Since the Anderson–Picard step decouples the equations in the system, this nonlinear preconditioning adds relatively little extra cost to the Newton iteration (which does not decouple the equations). Our numerical tests illustrate this quadratic convergence and stability on multiple benchmark problems. Furthermore, the tests show convergence for significantly higher Rayleigh number than both Picard and Newton, which illustrates the larger convergence basin of Anderson–Picard based nonlinear preconditioned Newton that the theory predicts.
Funding source: National Science Foundation
Award Identifier / Grant number: DMS-2011490
Funding statement: The author was partially supported by NSF grant DMS-2011490.
Acknowledgements
The author thanks Professor Leo Rebholz for helpful discussions regarding this work.
References
[1] D. Arnold and J. Qin, Quadratic velocity/linear pressure Stokes elements, Advances in Computer Methods for Partial Differential Equations VII, IMACS, Bruxelles (1992), 28–34. Search in Google Scholar
[2] M. Benzi and M. A. Olshanskii, An augmented Lagrangian-based approach to the Oseen problem, SIAM J. Sci. Comput. 28 (2006), no. 6, 2095–2113. 10.1137/050646421Search in Google Scholar
[3] J. Boland and W. Layton, Error analysis for finite element methods for steady natural convection problems, Numer. Funct. Anal. Optim. 11 (1990), no. 5–6, 449–483. 10.1080/01630569008816383Search in Google Scholar
[4]
S. Börm and S. Le Borne,
[5] X.-C. Cai and D. E. Keyes, Nonlinearly preconditioned inexact Newton algorithms, SIAM J. Sci. Comput. 24 (2002), no. 1, 183–200. 10.1137/S106482750037620XSearch in Google Scholar
[6] A. Çıbık and S. Kaya, A projection-based stabilized finite element method for steady-state natural convection problem, J. Math. Anal. Appl. 381 (2011), no. 2, 469–484. 10.1016/j.jmaa.2011.02.020Search in Google Scholar
[7] H. C. Elman, D. J. Silvester and A. J. Wathen, Finite Elements and Fast Iterative Solvers: With Applications in Incompressible Fluid Dynamics, Numer. Math. Sci. Comput., Oxford University, Oxford, 2014. 10.1093/acprof:oso/9780199678792.001.0001Search in Google Scholar
[8] C. Evans, S. Pollock, L. G. Rebholz and M. Xiao, A proof that Anderson acceleration improves the convergence rate in linearly converging fixed-point methods (but not in those converging quadratically), SIAM J. Numer. Anal. 58 (2020), no. 1, 788–810. 10.1137/19M1245384Search in Google Scholar
[9] V. Girault and P.-A. Raviart, Finite Element Methods for Navier–Stokes Equations, Springer Ser. Comput. Math. 5, Springer, Berlin, 1986. 10.1007/978-3-642-61623-5Search in Google Scholar
[10] T. Heister and G. Rapin, Efficient augmented Lagrangian-type preconditioning for the Oseen problem using grad-div stabilization, Internat. J. Numer. Methods Fluids 71 (2013), no. 1, 118–134. 10.1002/fld.3654Search in Google Scholar
[11] K. Huang, B. Mohanty, F. Leij and M. Genuchten, Solution of the nonlinear transport equation using modified Picard iteration, Adv. Water Res. 21 (1996), 237–249. 10.1016/S0309-1708(96)00046-2Search in Google Scholar
[12] V. John, Large Eddy Simulation of Turbulent Incompressible Flows, Lect. Notes Comput. Sci. Eng. 34, Springer, Berlin, 2004. 10.1007/978-3-642-18682-0Search in Google Scholar
[13] C. T. Kelley, Solving Nonlinear Equations with Newton’s Method, Fundam. Algorithms 1, Society for Industrial and Applied Mathematics, Philadelphia, 2003. 10.1137/1.9780898718898Search in Google Scholar
[14] W. Layton, Introduction to the Numerical Analysis of Incompressible Viscous Flows, Comput. Sci. Eng. 6, Society for Industrial and Applied Mathematics, Philadelphia, 2008. 10.1137/1.9780898718904Search in Google Scholar
[15] L. Liu, F.-N. Hwang, L. Luo, X.-C. Cai and D. E. Keyes, A nonlinear elimination preconditioned inexact Newton algorithm, SIAM J. Sci. Comput. 44 (2022), no. 3, A1579–A1605. 10.1137/21M1416138Search in Google Scholar
[16] L. Liu and D. E. Keyes, Convergence analysis for the multiplicative Schwarz preconditioned inexact Newton algorithm, SIAM J. Numer. Anal. 54 (2016), no. 5, 3145–3166. 10.1137/15M1028182Search in Google Scholar
[17] S. Mehl, Use of Picard and Newton iteration for solving nonlinear ground water flow equations, Groundwater 44 (2006), 583–594. 10.1111/j.1745-6584.2006.00207.xSearch in Google Scholar PubMed
[18] M. Mohebujjaman, M. Xiao and C. Zhang, A simple-to-implement nonlinear preconditioning of Newton’s method for solving the steady Navier–Stokes equations, preprint (2025), https://arxiv.org/abs/2501.08855. Search in Google Scholar
[19] S. Pollock and L. G. Rebholz, Anderson acceleration for contractive and noncontractive operators, IMA J. Numer. Anal. 41 (2021), no. 4, 2841–2872. 10.1093/imanum/draa095Search in Google Scholar
[20] S. Pollock, L. G. Rebholz, X. Tu and M. Xiao, Analysis of the Picard–Newton iteration for the Navier–Stokes equations: Global stability and quadratic convergence, J. Sci. Comput. 104 (2025), no. 1, Paper No. 25. 10.1007/s10915-025-02946-6Search in Google Scholar
[21] S. Pollock, L. G. Rebholz and M. Xiao, Anderson-accelerated convergence of Picard iterations for incompressible Navier–Stokes equations, SIAM J. Numer. Anal. 57 (2019), no. 2, 615–637. 10.1137/18M1206151Search in Google Scholar
[22] R. Temam, Navier–Stokes equations, Stud. Math. Appl. 2, North-Holland, Amsterdam, 1991. Search in Google Scholar
[23] A. Toth and C. T. Kelley, Convergence analysis for Anderson acceleration, SIAM J. Numer. Anal. 53 (2015), no. 2, 805–819. 10.1137/130919398Search in Google Scholar
[24] T. Zhang, J. Yuan and Z. Si, Decoupled two-grid finite element method for the time-dependent natural convection problem I: Spatial discretization, Numer. Methods Partial Differential Equations 31 (2015), no. 6, 2135–2168. 10.1002/num.21987Search in Google Scholar
© 2025 Institute of Mathematics of the National Academy of Science of Belarus, published by De Gruyter, Berlin/Boston
