Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,38 @@
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
4 |
+
|
5 |
+
# InstructIR ✏️🖼️
|
6 |
+
## [High-Quality Image Restoration Following Human Instructions]()
|
7 |
+
|
8 |
+
|
9 |
+
[Marcos V. Conde](https://scholar.google.com/citations?user=NtB1kjYAAAAJ&hl=en), [Gregor Geigle](https://scholar.google.com/citations?user=uIlyqRwAAAAJ&hl=en), [Radu Timofte](https://scholar.google.com/citations?user=u3MwH5kAAAAJ&hl=en)
|
10 |
+
|
11 |
+
Computer Vision Lab, University of Wuerzburg | Sony PlayStation, FTG
|
12 |
+
|
13 |
+
### TL;DR: quickstart
|
14 |
+
InstructIR takes as input an image and a human-written instruction for how to improve that image. The neural model performs all-in-one image restoration. InstructIR achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement.
|
15 |
+
|
16 |
+
**🚀 You can start with the [demo tutorial](demo.ipynb)**
|
17 |
+
|
18 |
+
<details>
|
19 |
+
<summary> <b> Abstract</b> (click me to read)</summary>
|
20 |
+
<p>
|
21 |
+
Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement.
|
22 |
+
</p>
|
23 |
+
</details>
|
24 |
+
|
25 |
+
### Contacts
|
26 |
+
For any inquiries contact Marcos V. Conde: <a href="mailto:marcos.conde@uni-wuerzburg.de">marcos.conde [at] uni-wuerzburg.de</a>
|
27 |
+
|
28 |
+
|
29 |
+
### Citation BibTeX
|
30 |
+
|
31 |
+
```
|
32 |
+
@misc{conde2024instructir,
|
33 |
+
title={High-Quality Image Restoration Following Human Instructions},
|
34 |
+
author={Marcos V. Conde, Gregor Geigle, Radu Timofte},
|
35 |
+
year={2024},
|
36 |
+
journal={arXiv preprint},
|
37 |
+
}
|
38 |
+
```
|