On the convergence of recursive SURE for total variation minimization

References

[1] M. V. Afonso, J. M. Bioucas-Dias and M. A. T. Figueiredo, Fast image recovery using variable splitting and constrained optimization, IEEE Trans. Image Process. 19 (2010), no. 9, 2345–2356. 10.1109/TIP.2010.2047910Search in Google Scholar PubMed

[2] J.-F. Aujol, Some first-order algorithms for total variation based image restoration, J. Math. Imaging Vision 34 (2009), no. 3, 307–327. 10.1007/s10851-009-0149-ySearch in Google Scholar

[3] H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, CMS Books Math./Ouvrages Math. SMC, Springer, New York, 2011. 10.1007/978-1-4419-9467-7Search in Google Scholar

[4] A. Beck, First-Order Methods in Optimization, MOS-SIAM Ser. Optim.25, Society for Industrial and Applied Mathematics, Philadelphia, 2017. 10.1137/1.9781611974997Search in Google Scholar

[5] T. Blu and F. Luisier, The SURE-LET approach to image denoising, IEEE Trans. Image Process. 16 (2007), no. 11, 2778–2786. 10.1109/TIP.2007.906002Search in Google Scholar

[6] S. Boyd, N. Parikh, E. Chu, B. Peleato and J. Eckstein, Distributed optimization and statistical learning via the alternating direction method of multipliers, Found. Trends Mach. Learn. 3 (2011), no. 1, 1–122. 10.1561/9781601984616Search in Google Scholar

[7] S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University, Cambridge, 2004. 10.1017/CBO9780511804441Search in Google Scholar

[8] M. Burger, A. Sawatzky and G. Steidl, First order algorithms in variational image processing, Splitting Methods in Communication, Imaging, Science, and Engineering, Sci. Comput., Springer, Cham (2016), 345–407. 10.1007/978-3-319-41589-5_10Search in Google Scholar

[9] A. Chambolle, An algorithm for total variation minimization and applications, J. Math. Imaging Vision 20 (2004), no. 1–2, 89–97. 10.1023/B:JMIV.0000011321.19549.88Search in Google Scholar

[10] A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, J. Math. Imaging Vision 40 (2011), no. 1, 120–145. 10.1007/s10851-010-0251-1Search in Google Scholar

[11] C. Deledalle, S. Vaiter, G. Peyré, J. Fadili and C. Dossal, Proximal splitting derivatives for risk estimation, J. Phys. 386 (2012), Article ID 012003. 10.1088/1742-6596/386/1/012003Search in Google Scholar

[12] D. Dobson and O. Scherzer, Analysis of regularized total variation penalty methods for denoising, Inverse Problems 12 (1996), no. 5, 601–617. 10.1088/0266-5611/12/5/005Search in Google Scholar

[13] Y. C. Eldar, Generalized SURE for exponential families: Applications to regularization, IEEE Trans. Signal Process. 57 (2009), no. 2, 471–481. 10.1109/TSP.2008.2008212Search in Google Scholar

[14] M. A. T. Figueiredo, J. M. Bioucas-Dias and R. D. Nowak, Majorization-minimization algorithms for wavelet-based image restoration, IEEE Trans. Image Process. 16 (2007), no. 12, 2980–2991. 10.1109/TIP.2007.909318Search in Google Scholar PubMed

[15] R. Giryes, M. Elad and Y. C. Eldar, The projected GSURE for automatic parameter tuning in iterative shrinkage methods, Appl. Comput. Harmon. Anal. 30 (2011), no. 3, 407–422. 10.1016/j.acha.2010.11.005Search in Google Scholar

[16] T. Goldstein and S. Osher, The split Bregman method for L⁢1-regularized problems, SIAM J. Imaging Sci. 2 (2009), no. 2, 323–343. 10.1137/080725891Search in Google Scholar

[17] B. He and X. Yuan, Convergence analysis of primal-dual algorithms for a saddle-point problem: From contraction perspective, SIAM J. Imaging Sci. 5 (2012), no. 1, 119–149. 10.1137/100814494Search in Google Scholar

[18] B. He and X. Yuan, On the O⁢(1/n) convergence rate of the Douglas–Rachford alternating direction method, SIAM J. Numer. Anal. 50 (2012), no. 2, 700–709. 10.1137/110836936Search in Google Scholar

[19] Y. Huang, M. K. Ng and Y.-W. Wen, A fast total variation minimization method for image restoration, Multiscale Model. Simul. 7 (2008), no. 2, 774–795. 10.1137/070703533Search in Google Scholar

[20] J. Oliveira, M. Figueiredo and J. Bioucas-Dias, Adaptative total variation image deblurring: A majorization-minimization approach, Signal Process. 89 (2009), no. 9, 1683–1693. 10.1016/j.sigpro.2009.03.018Search in Google Scholar

[21] Z. A. Opial, Weak convergence of the sequence of successive approximations for nonexpansive mappings, Bull. Amer. Math. Soc. 73 (1967), 591–597. 10.1090/S0002-9904-1967-11761-0Search in Google Scholar

[22] S. Osher, M. Burger, D. Goldfarb, J. Xu and W. Yin, An iterative regularization method for total variation-based image restoration, Multiscale Model. Simul. 4 (2005), no. 2, 460–489. 10.1137/040605412Search in Google Scholar

[23] H. Pan and T. Blu, An iterative linear expansion of thresholds for ℓ1-based image restoration, IEEE Trans. Image Process. 22 (2013), no. 9, 3715–3728. 10.1109/TIP.2013.2270109Search in Google Scholar

[24] N. Parikh and S. S. Boyd, Proximal algorithms, Found. Trends Optim. 1 (2013), no. 3, 123–231. 10.1561/9781601987174Search in Google Scholar

[25] J.-C. Pesquet, A. Benazza-Benyahia and C. Chaux, A SURE approach for digital signal/image deconvolution problems, IEEE Trans. Signal Process. 57 (2009), no. 12, 4616–4632. 10.1109/TSP.2009.2026077Search in Google Scholar

[26] S. Ramani, Z. Liu, J. Rosen, J.-F. Nielsen and J. A. Fessler, Regularization parameter selection for nonlinear iterative image restoration and MRI reconstruction using GCV and SURE-based methods, IEEE Trans. Image Process. 21 (2012), no. 8, 3659–3672. 10.1109/TIP.2012.2195015Search in Google Scholar

[27] R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM J. Control Optim. 14 (1976), no. 5, 877–898. 10.1137/0314056Search in Google Scholar

[28] L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D 60 (1992), 259–268. 10.1016/0167-2789(92)90242-FSearch in Google Scholar

[29] C. M. Stein, Estimation of the mean of a multivariate normal distribution, Ann. Statist. 9 (1981), no. 6, 1135–1151. 10.1214/aos/1176345632Search in Google Scholar

[30] M. Tao and J. Yang, Alternating direction algorithms for total variation deconvolution in image reconstruction, preprint (2019), http://www.optimization-online.org/DB_HTML/2009/11/2463.html. 10.29007/rft1Search in Google Scholar

[31] C. R. Vogel and M. E. Oman, Iterative methods for total variation denoising, SIAM J. Sci. Comput. 17 (1996), 227–238. 10.1137/0917016Search in Google Scholar

[32] C. Vonesch, S. Ramani and M. Unser, Recursive risk estimation for non-linear image deconvolution with a wavelet-domain sparsity constraint, IEEE International Conference on Image Processing, IEEE Press, Piscataway (2008), 665–668. 10.1109/ICIP.2008.4711842Search in Google Scholar

[33] Y. Wang, J. Yang, W. Yin and Y. Zhang, A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci. 1 (2008), no. 3, 248–272. 10.1137/080724265Search in Google Scholar

[34] Y. Wang, W. Yin and Y. Zhang, A fast algorithm for image delurring with total variation regularization, CAAM Technical Report TR07-10, Rice University, Houston, 2007. Search in Google Scholar

[35] F. Xue, T. Blu, R. Du and J. Liu, An iterative SURE-LET approach to sparse reconstruction, Proceedings of the 41st IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE Press, Piscataway (2016), 4493–4497. 10.1109/ICASSP.2016.7472527Search in Google Scholar

[36] F. Xue, R. Du and J. Liu, A recursive predictive risk estimate for proximal algorithms, Proceedings of the 41st IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE Press, Piscataway (2016), 4498–4502. 10.1109/ICASSP.2016.7472528Search in Google Scholar

[37] F. Xue, F. Luisier and T. Blu, Multi-Wiener SURE-LET deconvolution, IEEE Trans. Image Process. 22 (2013), no. 5, 1954–1968. 10.1109/TIP.2013.2240004Search in Google Scholar PubMed

[38] F. Xue, A. G. Yagola, J. Liu and G. Meng, Recursive SURE for iterative reweighted least square algorithms, Inverse Probl. Sci. Eng. 24 (2016), no. 4, 625–646. 10.1080/17415977.2015.1054822Search in Google Scholar

[39] J. Yang, Y. Zhang and W. Yin, An efficient TVL1 algorithm for deblurring multichannel images corrupted by impulsive noise, SIAM J. Sci. Comput. 31 (2009), no. 4, 2842–2865. 10.1137/080732894Search in Google Scholar

[40] J. Yang, Y. Zhang and W. Yin, A fast alternating direction method for TVL1-L2 signal reconstruction from partial fourier data, IEEE J. Selected Topics Signal Process. 4 (2010), no. 2, 288–297. 10.1109/JSTSP.2010.2042333Search in Google Scholar