Learning to Remove Soft Shadows

Citations Over TimeTop 10% of 2015 papers

Abstract

Manipulated images lose believability if the user's edits fail to account for shadows. We propose a method that makes removal and editing of soft shadows easy. Soft shadows are ubiquitous, but remain notoriously difficult to extract and manipulate. We posit that soft shadows can be segmented, and therefore edited, by learning a mapping function for image patches that generates shadow mattes. We validate this premise by removing soft shadows from photographs with only a small amount of user input. Given only broad user brush strokes that indicate the region to be processed, our new supervised regression algorithm automatically unshadows an image, removing the umbra and penumbra. The resulting lit image is frequently perceived as a believable shadow-free version of the scene. We tested the approach on a large set of soft shadow images, and performed a user study that compared our method to the state-of-the-art and to real lit scenes. Our results are more difficult to identify as being altered and are perceived as preferable compared to prior work.

Related Papers

• → Shadow Removal using GTA Road Dataset(2021)2 cited
• → Research on Shadow Map Based Shadow Generation(2010)1 cited
• LightCluster - Clustering Lights to Accelerate Shadow Computation.(2013)
• → 3333 Shadow communication system : Expression method of shadow using a grid for strengthening a feeling of existence(2008)
• → A Continuous Illumination Estimator for Shadow Removal(2023)