OneRestore: A Universal Restoration Framework for Composite Degradation
Yu Guo1, 2, #    Yuan Gao1, #    Yuxu Lu3    Huilin Zhu1, 2    Ryan Wen Liu1, *    Shengfeng He2, *   
(# Co-first Author, * Corresponding Author)
1 Wuhan University of Technology    2 Singapore Management University   
3 The Hong Kong Polytechnic University   

ECCV 2024

🔥 Restoration Performance on Real Images 🔥

🖐 Controllable Restoration

Input Image
original
low+haze+snow

Press the buttons for controllable restoration:

                             
 

Abstract

In real-world scenarios, image impairments often manifest as composite degradations, presenting a complex interplay of elements such as low light, haze, rain, and snow. Despite this reality, existing restoration methods typically target isolated degradation types, thereby falling short in environments where multiple degrading factors coexist. To bridge this gap, our study proposes a versatile imaging model that consolidates four physical corruption paradigms to accurately represent complex, composite degradation scenarios. In this context, we propose OneRestore, a novel transformer-based framework designed for adaptive, controllable scene restoration. The proposed framework leverages a unique cross-attention mechanism, merging degraded scene descriptors with image features, allowing for nuanced restoration. Our model allows versatile input scene descriptors, ranging from manual text embeddings to automatic extractions based on visual attributes. Our methodology is further enhanced through a composite degradation restoration loss, using extra degraded images as negative samples to fortify model constraints. Comparative results on synthetic and real-world datasets demonstrate OneRestore as a superior solution, significantly advancing the state-of-the-art in addressing complex, composite degradations.

Method

Poster

Video

Acknowledgements

This project is supported by the Guangdong Natural Science Funds for Distinguished Young Scholar under Grant 2023B1515020097 and National Research Foundation Singapore under the AI Singapore Programme under Grant AISG3-GV-2023-011.

BibTex

@inproceedings{guo2024onerestore,
  title={OneRestore: A Universal Restoration Framework for Composite Degradation},
  author={Guo, Yu and Gao, Yuan and Lu, Yuxu and Liu, Ryan Wen and He, Shengfeng},
  booktitle={European Conference on Computer Vision},
  year={2024}
}

Contact

If you have any questions, please get in touch with me guoyu65896@gmail.com.