Skip to main content
Article
Licensed
Unlicensed Requires Authentication

Sequential subspace optimization for nonlinear inverse problems

  • and EMAIL logo
Published/Copyright: June 29, 2016

Abstract

In this work we discuss a method to adapt sequential subspace optimization (SESOP), which has so far been developed for linear inverse problems in Hilbert and Banach spaces, to the case of nonlinear inverse problems. We start by revising the technique for linear problems. In a next step, we introduce a method using multiple search directions that are especially designed to fit the nonlinearity of the forward operator. To this end, we iteratively project the initial value onto stripes whose width is determined by the search direction, the nonlinearity of the operator and the noise level. We additionally propose a fast algorithm that uses two search directions. Finally, we will show convergence and regularization properties for the presented method.

MSC 2010: 65N21; 65J15; 65J22

References

[1] Bao G. and Li P., Inverse medium scattering for the Helmholtz equation at fixed frequency, Inverse Problems 21 (2005), no. 5, 1621–1641. 10.1088/0266-5611/21/5/007Search in Google Scholar

[2] Censor Y., Elfving T., Kopf N. and Bortfeld T., The multiple-sets split feasibility problem and its applications for inverse problems, Inverse Problems 21 (2005), no. 6, 2071–2084. 10.1088/0266-5611/21/6/017Search in Google Scholar

[3] Colton D. and Kress R., Inverse Acoustic and Electromagnetic Scattering Theory, 3rd ed., Springer, New York, 2013. 10.1007/978-1-4614-4942-3Search in Google Scholar

[4] Elad M., Matalon B. and Zibulevsky M., Coordinate and subspace optimization methods for linear least squares with non-quadratic regularization, Appl. Comput. Harmon. Anal. 23 (2007), no. 3, 346–367. 10.1016/j.acha.2007.02.002Search in Google Scholar

[5] Engl H., Hanke M. and Neubauer A., Regularization of Inverse Problems, Kluwer, Dordrecht, 2000. 10.1007/978-94-009-1740-8_3Search in Google Scholar

[6] Engl H. W., Kunisch K. and Neubauer A., Convergence rates for Tikhonov regularisation of non-linear ill-posed problems, Inverse Problems 5 (1989), no. 4, 523–540. 10.1088/0266-5611/5/4/007Search in Google Scholar

[7] Hanke M., Regularizing properties of a truncated Newton-CG algorithm for nonlinear inverse problems, Num. Funct. Anal. Optim. 18 (1997), 18–971. 10.1080/01630569708816804Search in Google Scholar

[8] Hanke M., Neubauer A. and Scherzer O., A convergence analysis of the Landweber iteration for nonlinear ill-posed problems, Numer. Math. 72 (1995), no. 1, 21–37. 10.1007/s002110050158Search in Google Scholar

[9] Kaltenbacher B., Some Newton-type methods for the regularization of nonlinear ill-posed problems, Inverse Problems 13 (1997), no. 3, 729–753. 10.1088/0266-5611/13/3/012Search in Google Scholar

[10] Kaltenbacher B., Neubauer A. and Scherzer O., Iterative Regularization Methods for Nonlinear Ill-Posed Problems, De Gruyter, Berlin, 2008. 10.1515/9783110208276Search in Google Scholar

[11] Kaltenbacher B., Schöpfer F. and Schuster T., Iterative methods for nonlinear ill-posed problems in Banach spaces: Convergence and applications to parameter identification problems, Inverse Problems 25 (2009), no. 6, Article ID 065003. 10.1088/0266-5611/25/6/065003Search in Google Scholar

[12] Kunisch K. and Ring W., Regularization of nonlinear illposed problems with closed operators, Numer. Funct. Anal. Optim. 14 (1993), no. 3–4, 389–404. 10.1080/01630569308816529Search in Google Scholar

[13] Lakhal A., A decoupling-based imaging method for inverse medium scattering for Maxwell’s equations, Inverse Problems 26 (2010), no. 1, Article ID 015007. 10.1088/0266-5611/26/1/015007Search in Google Scholar

[14] Lakhal A. and Louis A. K., Locating radiating sources for Maxwell’s equations using the approximate inverse, Inverse Problems 24 (2008), no. 4, Article ID 045020. 10.1088/0266-5611/24/4/045020Search in Google Scholar

[15] Louis A. K., Inverse und schlecht gestellte Probleme, Teubner, Stuttgart, 1989. 10.1007/978-3-322-84808-6Search in Google Scholar

[16] Narkiss G. and Zibulevsky M., Sequential subspace optimization method for large-scale unconstrained optimization, Technical report, Technion – The Israel Institute of Technology, Department of Electrical Engineering, Haifa, 2005. Search in Google Scholar

[17] Neubauer A., Tikhonov regularization of nonlinear ill-posed problems in Hilbert scales, Appl. Anal. 46 (1992), no. 1–2, 59–72. 10.1080/00036819208840111Search in Google Scholar

[18] Rieder A., On the regularization of nonlinear ill-posed problems via inexact Newton iterations, Inverse Problems 15 (1999), no. 1, 309–327. 10.1088/0266-5611/15/1/028Search in Google Scholar

[19] Rieder A., Keine Probleme mit inversen Problemen, Teubner, Stuttgart, 2003. 10.1007/978-3-322-80234-7Search in Google Scholar

[20] Scherzer O., The use of Morozov’s discrepancy principle for Tikhonov regularization for solving nonlinear ill-posed problems, Computing 51 (1993), no. 1, 45–60. 10.1007/BF02243828Search in Google Scholar

[21] Schöpfer F., Louis A. K. and Schuster T., Metric and Bregman projections onto affine subspaces and their computation via sequential subspace optimization methods, J. Inverse Ill-Posed Probl. 16 (2008), no. 5, 479–206. 10.1515/JIIP.2008.026Search in Google Scholar

[22] Schöpfer F. and Schuster T., Fast regularizing sequential subspace optimization in Banach spaces, Inverse Problems 25 (2009), no. 1, Article ID 015013. 10.1088/0266-5611/25/1/015013Search in Google Scholar

[23] Schuster T., Kaltenbacher B., Hofmann B. and Kazimierski K. S., Regularization Methods in Banach Spaces, De Gruyter, Berlin, 2012. 10.1515/9783110255720Search in Google Scholar

Received: 2016-2-22
Revised: 2016-4-12
Accepted: 2016-5-3
Published Online: 2016-6-29
Published in Print: 2017-2-1

© 2017 by De Gruyter

Downloaded on 23.4.2026 from https://www.degruyterbrill.com/document/doi/10.1515/jiip-2016-0014/html
Scroll to top button