Generating Visible Spectrum Images from Thermal Infrared

Citations Over TimeTop 10% of 2018 papers

Abstract

Transformation of thermal infrared (TIR) images into visual, i.e. perceptually realistic color (RGB) images, is a challenging problem. TIR cameras have the ability to see in scenarios where vision is severely impaired, for example in total darkness or fog, and they are commonly used, e.g., for surveillance and automotive applications. However, interpretation of TIR images is difficult, especially for untrained operators. Enhancing the TIR image display by transforming it into a plausible, visual, perceptually realistic RGB image presumably facilitates interpretation. Existing grayscale to RGB, so called, colorization methods cannot be applied to TIR images directly since those methods only estimate the chrominance and not the luminance. In the absence of conventional colorization methods, we propose two fully automatic TIR to visual color image transformation methods, a two-step and an integrated approach, based on Convolutional Neural Networks. The methods require neither pre- nor postprocessing, do not require any user input, and are robust to image pair misalignments. We show that the methods do indeed produce perceptually realistic results on publicly available data, which is assessed both qualitatively and quantitatively.

Related Papers

• → Self-similarity-based image colorization(2014)11 cited
• → Colour to Grey by Maximum Signed Gradient(2019)2 cited
• → Color and Luminance: Independent Frequency Shifts(1981)28 cited
• → Improved adaptive color embedding and recovery using DC level shifting(2013)3 cited
• → Category knowledge can form prior constraints on scene recognition from luminance and chromatic cues(2010)