14 Ensemble Kalman filter for neural network-based one-shot inversion
-
Philipp A. Guth
, Claudia Schillings and Simon Weissmann
Abstract
We study the use of novel techniques arising in machine learning for inverse problems. Our approach replaces the complex forward model by a neural network, which is trained simultaneously in a one-shot sense when estimating the unknown parameters from data, i. e., the neural network is trained only for the unknown parameter. By establishing a link to the Bayesian approach to inverse problems we develop an algorithmic framework that ensures the feasibility of the parameter estimate with respect to the forward model. We propose an efficient, derivative-free optimization method based on variants of the ensemble Kalman inversion. Numerical experiments show that the ensemble Kalman filter for neural network-based one-shot inversion is a promising direction combining optimization and machine learning techniques for inverse problems.
Abstract
We study the use of novel techniques arising in machine learning for inverse problems. Our approach replaces the complex forward model by a neural network, which is trained simultaneously in a one-shot sense when estimating the unknown parameters from data, i. e., the neural network is trained only for the unknown parameter. By establishing a link to the Bayesian approach to inverse problems we develop an algorithmic framework that ensures the feasibility of the parameter estimate with respect to the forward model. We propose an efficient, derivative-free optimization method based on variants of the ensemble Kalman inversion. Numerical experiments show that the ensemble Kalman filter for neural network-based one-shot inversion is a promising direction combining optimization and machine learning techniques for inverse problems.
Chapters in this book
- Frontmatter I
- Preface V
- Contents VII
- 1 Reduced basis model order reduction in optimal control of a nonsmooth semilinear elliptic PDE 1
- 2 Pointwise moving control for the 1-D wave equation 33
- 3 Limits of stabilizability for a semilinear model for gas pipeline flow 59
- 4 Minimal cost-time strategies for mosquito population replacement 73
- 5 The sterile insect technique used as a barrier control against reinfestation 91
- 6 Variational discretization approach applied to an optimal control problem with bounded measure controls 113
- 7 An optimal control problem for equations with p-structure and its finite element discretization 137
- 8 Unstructured space-time finite element methods for optimal sparse control of parabolic equations 167
- 9 An adaptive finite element approach for lifted branched transport problems 189
- 10 High-order homogenization of the Poisson equation in a perforated periodic domain 237
- 11 Least-squares approaches for the 2D Navier–Stokes system 285
- 12 Numerical issues and turnpike phenomenon in optimal shape design 343
- 13 Feedback stabilization of Cahn–Hilliard phase-field systems 367
- 14 Ensemble Kalman filter for neural network-based one-shot inversion 393
- 15 Deep learning in high dimension: ReLU neural network expression for Bayesian PDE inversion 419
- Index 463
Chapters in this book
- Frontmatter I
- Preface V
- Contents VII
- 1 Reduced basis model order reduction in optimal control of a nonsmooth semilinear elliptic PDE 1
- 2 Pointwise moving control for the 1-D wave equation 33
- 3 Limits of stabilizability for a semilinear model for gas pipeline flow 59
- 4 Minimal cost-time strategies for mosquito population replacement 73
- 5 The sterile insect technique used as a barrier control against reinfestation 91
- 6 Variational discretization approach applied to an optimal control problem with bounded measure controls 113
- 7 An optimal control problem for equations with p-structure and its finite element discretization 137
- 8 Unstructured space-time finite element methods for optimal sparse control of parabolic equations 167
- 9 An adaptive finite element approach for lifted branched transport problems 189
- 10 High-order homogenization of the Poisson equation in a perforated periodic domain 237
- 11 Least-squares approaches for the 2D Navier–Stokes system 285
- 12 Numerical issues and turnpike phenomenon in optimal shape design 343
- 13 Feedback stabilization of Cahn–Hilliard phase-field systems 367
- 14 Ensemble Kalman filter for neural network-based one-shot inversion 393
- 15 Deep learning in high dimension: ReLU neural network expression for Bayesian PDE inversion 419
- Index 463