Shearlet-based Analysis of Image Inpainting and Convolutional Framelets

Date

2020-08

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

The main part of my dissertation deals with image inpainting - a classical problem in image analysis that I analyze from the point of view of microlocal analysis and the theory of sparse approximation. My most important result provides a new set of theoretical performance guarantees for the exact recovery of missing data in images where the information is dominated by curvilinear singularities. In fact, my study shows that a shearlet-based approach for the recovery of missing curvilinear edges in images is provably superior to methods based on conventional wavelets in a precises sense and gives a quantitative assessment on the size of the region that can reliably recovered. As a consequence, this result offers the theoretical underpinning for algorithms based on directional multiscale methods such as shearlets in applications to image inpainting. The arguments in my proofs rely on a new application of the microlocal properties of shearlets and techniques from oscillatory integrals that are inspired in part by a seminal paper by Donoho and Kutyniok, who first introduced methods from microlocal analysis in combination with ideas from sparse representations for problems of image analysis. The second part of my dissertation is a new study of convolutional framelets - a method recently introduced to provide a mathematical framework for the patch-based analysis of images - using tools from tensor analysis. This method gives an alternative approach to analyze framelets and a deeper insight into the mathematical properties of convolutional framelets. The first part of the dissertation follows rather closely some material published by the author in his first journal paper.

Description

Keywords

Shearlet, Inpainting

Citation

Portions of this document appear in: Guo, K., Labate, D., & Rodriguez Ayllon, J. (2020). Image inpainting using sparse multiscale representations: Image recovery performance guarantees. Applied and Computational Harmonic Analysis, 49(2), 343-380. doi:10.1016/j.acha.2020.05.001