Back to List

Distort-and-Recover: Color Enhancement Using Deep Reinforcement Learning

Jongchan Park et al. — CVPR (2018)


Learning-based color enhancement approaches typically learn to map from input images to retouched images. Most of existing methods require expensive pairs of input-retouched images or produce results in a noninterpretable way. In this paper, we present a deep reinforcement learning (DRL) based method for color enhancement to explicitly model the step-wise nature of human retouching process. We cast a color enhancement process as a Markov Decision Process where actions are defined as global color adjustment operations. Then we train our agent to learn the optimal global enhancement sequence of the actions. In addition, we present a ‘distort-and-recover’ training scheme which only requires high-quality reference images for training instead of input and retouched image pairs. Given high-quality reference images, we distort the images’ color distribution and form distorted-reference image pairs for training. Through extensive experiments, we show that our method produces decent enhancement results and our DRL approach is more suitable for the ‘distortand-recover’ training scheme than previous supervised approaches. Supplementary material and code are available at

Read the full paper

Jongchan Park1, Joon-Young Lee2, Donggeun Yoo1,3, and In So Kweon3

1Lunit Inc. 2Adobe Research 3Korea Advanced Institute of Science and Technology (KAIST)

CVPR (2018)

Read more