Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,66 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- prs-eth/marigold-depth-v1-0
|
7 |
+
- stabilityai/stable-diffusion-2
|
8 |
+
tags:
|
9 |
+
- underwater restoration
|
10 |
+
- latent diffusion model
|
11 |
+
- image analysis
|
12 |
+
- computer vision
|
13 |
+
library_name: diffusers
|
14 |
+
---
|
15 |
+
<h1 align="center">SLURPP Single-Step Latent Diffusion Underwater Restoration</h1>
|
16 |
+
|
17 |
+
|
18 |
+
<p align="center">
|
19 |
+
</a>
|
20 |
+
<a title="Website" href="https://tianfwang.github.io/slurpp/" target="_blank" rel="noopener noreferrer" style="display: inline-block;">
|
21 |
+
<img src="https://img.shields.io/badge/%E2%99%A5%20Project%20-Website-blue" alt="Website">
|
22 |
+
</a>
|
23 |
+
<a title="arXiv" href="https://arxiv.org/abs/2507.07878" target="_blank" rel="noopener noreferrer" style="display: inline-block;">
|
24 |
+
<img src="https://img.shields.io/badge/%F0%9F%93%84%20Read%20-Paper-AF3436" alt="arXiv">
|
25 |
+
</a>
|
26 |
+
<a title="Github" href="https://github.com/kongdai123/SLURPP" target="_blank" rel="noopener noreferrer" style="display: inline-block;">
|
27 |
+
<img src="https://img.shields.io/github/stars/kongdai123/SLURPP?label=GitHub%20%E2%98%85&logo=github&color=C8C" alt="Github">
|
28 |
+
|
29 |
+
<a title="License" href="https://www.apache.org/licenses/LICENSE-2.0" target="_blank" rel="noopener noreferrer" style="display: inline-block;">
|
30 |
+
<img src="https://img.shields.io/badge/License-Apache--2.0-929292" alt="License">
|
31 |
+
</a>
|
32 |
+
</p>
|
33 |
+
|
34 |
+
|
35 |
+
This is a model card for the `slurpp` model for underwater image restoration and water medium estimation from a single image.
|
36 |
+
The model is fine-tuned from both `stable-diffusion-2` [model](https://huggingface.co/stabilityai/stable-diffusion-2) and `marigold-depth-v1-0` [model](https://huggingface.co/prs-eth/marigold-depth-v1-0).
|
37 |
+
|
38 |
+
This model is based on the paper:
|
39 |
+
|
40 |
+
Jiayi Wu, Tianfu Wang, Md Abu Bakr Siddique, Md Jahidul Islam, Cornelia Fermuller, Yiannis Aloimonos, Christopher A. Metzler "Single-Step Latent Diffusion Underwater Restoration," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
|
41 |
+
|
42 |
+
### Using the model
|
43 |
+
Please follow the inference script in the [github repo](https://github.com/kongdai123/SLURPP).
|
44 |
+
|
45 |
+
## Model Details
|
46 |
+
- **Developed by:** [Jiayi Wu](https://jiayi-wu-leo.github.io/), [Tianfu Wang](https://tianfwang.github.io/), [Md Abu Bakr Siddique](https://www.linkedin.com/in/bbkrsddque/), [Md Jahidul Islam](https://jahid.ece.ufl.edu/), [Cornelia Fermuller](https://users.umiacs.umd.edu/~fermulcm/), [Yiannis Aloimonos](https://robotics.umd.edu/clark/faculty/350/Yiannis-Aloimonos), [Christopher A. Metzler](https://www.cs.umd.edu/people/metzler).
|
47 |
+
- **Model type:** Diffusion-based single image underwater restoration and water medium prediction
|
48 |
+
- **Language:** English.
|
49 |
+
- **License:** [Apache License License Version 2.0](https://www.apache.org/licenses/LICENSE-2.0).
|
50 |
+
- **Model Description:** Given an input underwater image, our single-step latent diffusion method SLURPP jointly predicts the clear image, and the per-pixel underwater medium parameters, specifically the backscattering and transmission parameters.
|
51 |
+
- **Steps and scheduler**: Only one step is required with this model using trailing DDIM scheduler
|
52 |
+
- **Outputs**:
|
53 |
+
- **Clear**: The predicted clear image
|
54 |
+
- **Transmission/Illuminaiton**: The ammount of attenuation experienced by each object in the scene
|
55 |
+
- **Backscattering**: The amount additive light from illumination (ambient sunlight or artificial lights) that is scattered by the water volume
|
56 |
+
- **Resources for more information:** [Project Website](https://tianfwang.github.io/slurpp/), [Paper](https://arxiv.org/abs/2507.0787), [Code](https://github.com/kongdai123/SLURPP).
|
57 |
+
- **Cite as:**
|
58 |
+
|
59 |
+
```bibtex
|
60 |
+
@article{wu2025single,
|
61 |
+
title={Single-Step Latent Diffusion for Underwater Image Restoration},
|
62 |
+
author={Wu, Jiayi and Wang, Tianfu and Siddique, Md Abu Bakr and Islam, Md Jahidul and Fermuller, Cornelia and Aloimonos, Yiannis and Metzler, Christopher A},
|
63 |
+
journal={arXiv preprint arXiv:2507.07878},
|
64 |
+
year={2025}
|
65 |
+
}
|
66 |
+
```
|