Kernel Modeling Super-Resolution on Real Low-Resolution Images

Citations Over TimeTop 10% of 2019 papers

Abstract

Deep convolutional neural networks (CNNs), trained on corresponding pairs of high- and low-resolution images, achieve state-of-the-art performance in single-image super-resolution and surpass previous signal-processing based approaches. However, their performance is limited when applied to real photographs. The reason lies in their training data: low-resolution (LR) images are obtained by bicubic interpolation of the corresponding high-resolution (HR) images. The applied convolution kernel significantly differs from real-world camera-blur. Consequently, while current CNNs well super-resolve bicubic-downsampled LR images, they often fail on camera-captured LR images. To improve generalization and robustness of deep super-resolution CNNs on real photographs, we present a kernel modeling super-resolution network (KMSR) that incorporates blur-kernel modeling in the training. Our proposed KMSR consists of two stages: we first build a pool of realistic blur-kernels with a generative adversarial network (GAN) and then we train a super-resolution network with HR and corresponding LR images constructed with the generated kernels. Our extensive experimental validations demonstrate the effectiveness of our single-image super-resolution approach on photographs with unknown blur-kernels.

Related Papers

• → An Object Detection and Pose Estimation Approach for Position Based Visual Servoing(2017)5 cited
• → Self-monitoring to improve robustness of 3D object tracking for robotics(2011)4 cited
• → Tracking in 3D: Image Variability Decomposition for Recovering Object Pose and Illumination(1999)15 cited
• → Foreground object segmentation from binocular stereo video(2005)2 cited
• → 6-DOF object localization by combining monocular vision and robot arm kinematics(2017)1 cited