|
--- |
|
license: other |
|
license_name: license |
|
license_link: LICENSE |
|
library_name: DepthCrafter |
|
arxiv: 2409.02095 |
|
tags: |
|
- vision |
|
pipeline_tag: depth-estimation |
|
widget: |
|
- inference: false |
|
--- |
|
|
|
## ___***DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos***___ |
|
<div align="center"> |
|
<img src='https://depthcrafter.github.io/img/logo.png' style="height:140px"></img> |
|
<a href='https://arxiv.org/abs/2409.02095'><img src='https://img.shields.io/badge/arXiv-2409.02095-b31b1b.svg'></a> <a href='https://depthcrafter.github.io'><img src='https://img.shields.io/badge/Project-Page-Green'></a> |
|
|
|
|
|
_**[Wenbo Hu<sup>1* †</sup>](https://wbhu.github.io), |
|
[Xiangjun Gao<sup>2*</sup>](https://scholar.google.com/citations?user=qgdesEcAAAAJ&hl=en), |
|
[Xiaoyu Li<sup>1* †</sup>](https://xiaoyu258.github.io), |
|
[Sijie Zhao<sup>1</sup>](https://scholar.google.com/citations?user=tZ3dS3MAAAAJ&hl=en), |
|
[Xiaodong Cun<sup>1</sup>](https://vinthony.github.io/academic), <br> |
|
[Yong Zhang<sup>1</sup>](https://yzhang2016.github.io), |
|
[Long Quan<sup>2</sup>](https://home.cse.ust.hk/~quan), |
|
[Ying Shan<sup>3, 1</sup>](https://scholar.google.com/citations?user=4oXBp9UAAAAJ&hl=en)**_ |
|
<br><br> |
|
<sup>1</sup>Tencent AI Lab |
|
<sup>2</sup>The Hong Kong University of Science and Technology |
|
<sup>3</sup>ARC Lab, Tencent PCG |
|
|
|
arXiv preprint, 2024 |
|
|
|
</div> |
|
|
|
If you find DepthCrafter useful, please help ⭐ the </a> |
|
<a style='font-size:18px;color: #FF5DB0' href='https://github.com/Tencent/DepthCrafter'>[Github Repo]</a>, |
|
which is important to Open-Source projects. Thanks! |
|
|
|
## 🔆 Introduction |
|
🤗 DepthCrafter can generate temporally consistent long depth sequences with fine-grained details for open-world videos, |
|
without requiring additional information such as camera poses or optical flow. |
|
|
|
## 🎥 Visualization |
|
We provide some demos of unprojected point cloud sequences, with reference RGB and estimated depth videos. |
|
Please refer to our [project page](https://depthcrafter.github.io) for more details. |
|
<img src="./assets/visualization.gif"> |
|
|
|
|
