11/4/21 CMSA Interdisciplinary Science Seminar

2021-11-04 18:46 - 20:46

Title: Exploring Invertibility in Image Processing and Restoration

Abstract: Today’s smartphones have enabled numerous stunning visual effects from denoising to beautification, and we can share high-quality JPEG images easily on the internet, but it is still valuable for photographers and researchers to keep the original raw camera data for further post-processing (e.g., retouching) and analysis. However, the huge size of raw data hinders its popularity in practice, so can we almost perfectly restore the raw data from a compressed RGB image and thus avoid storing any raw data? This question leads us to design an invertible image signal processing pipeline. Then we further explore invertibility in other image processing and restoration tasks, including image compression, reversible image conversion (e.g., image-to-video conversion), and embedding novel views in a single JPEG image. We demonstrate that customized invertible neural networks are highly effective in these inherently non-invertible tasks.