-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
83d7466
commit 1068e91
Showing
17 changed files
with
3,284 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,201 @@ | ||
<!DOCTYPE html> | ||
<html> | ||
<head> | ||
<meta charset="utf-8"> | ||
<meta name="description" | ||
content="RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenes."> | ||
<meta name="keywords" content="RoDUS, NeRF"> | ||
<meta name="viewport" content="width=device-width, initial-scale=1"> | ||
<title>RoDUS | ||
</title> | ||
|
||
<!-- Global site tag (gtag.js) - Google Analytics --> | ||
<script async src="https://www.googletagmanager.com/gtag/js?id=G-PYVRSFMDRL"></script> | ||
<script> | ||
window.dataLayer = window.dataLayer || []; | ||
|
||
function gtag() { | ||
dataLayer.push(arguments); | ||
} | ||
|
||
gtag('js', new Date()); | ||
|
||
gtag('config', 'G-PYVRSFMDRL'); | ||
</script> | ||
|
||
<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro" | ||
rel="stylesheet"> | ||
|
||
<link rel="stylesheet" href="./static/css/bulma.min.css"> | ||
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css"> | ||
<link rel="stylesheet" href="./static/css/bulma-slider.min.css"> | ||
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css"> | ||
<link rel="stylesheet" | ||
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"> | ||
<link rel="stylesheet" href="./static/css/index.css"> | ||
|
||
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script> | ||
<script defer src="./static/js/fontawesome.all.min.js"></script> | ||
<script src="./static/js/bulma-carousel.min.js"></script> | ||
<script src="./static/js/bulma-slider.min.js"></script> | ||
<script src="./static/js/index.js"></script> | ||
</head> | ||
<body> | ||
|
||
|
||
<section class="hero"> | ||
<div class="hero-body"> | ||
<div class="container is-max-desktop"> | ||
<div class="columns is-centered"> | ||
<div class="column has-text-centered"> | ||
<h1 class="title is-2 publication-title">RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenes</h1> | ||
<div class="is-size-5 publication-authors"> | ||
<span class="author-block"> | ||
<a href="https://scholar.google.com/citations?user=epUgvTAAAAAJ">Thang-Anh-Quan Nguyen</a>,</span> | ||
<span class="author-block"> | ||
<a href="https://scholar.google.com/citations?user=bRgp2lUAAAAJ">Luis Roldão</a>,</span> | ||
<span class="author-block"> | ||
<a href="https://scholar.google.com/citations?user=S3zYmOYAAAAJ">Nathan Piasco</a>, | ||
</span> | ||
<br> | ||
<span class="author-block"> | ||
<a href="https://scholar.google.com/citations?user=0jLPiLYAAAAJ">Moussab Bennehar</a>, | ||
</span> | ||
<span class="author-block"> | ||
<a href="https://scholar.google.com/citations?user=fjUPMcYAAAAJ">Dzmitry Tsishkou</a>, | ||
</span> | ||
</div> | ||
|
||
<div class="is-size-5 publication-authors"> | ||
<span class="author-block">Huawei Paris Research Center</span> | ||
</div> | ||
|
||
<div class="column has-text-centered"> | ||
<div class="publication-links"> | ||
<!-- PDF Link. --> | ||
<span class="link-block"> | ||
<a href="https://arxiv.org/abs/2403.09419" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="fas fa-file-pdf"></i> | ||
</span> | ||
<span>Paper</span> | ||
</a> | ||
</span> | ||
<!-- Code Link. --> | ||
<span class="link-block"> | ||
<a href="https://github.com/ntaquan0125/RoDUS" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="fab fa-github"></i> | ||
</span> | ||
<span>Code</span> | ||
</a> | ||
</span> | ||
</div> | ||
|
||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</section> | ||
|
||
<section class="hero teaser"> | ||
<div class="container is-max-desktop is-centered has-text-centered"> | ||
<div class="hero-body"> | ||
<img src="./static/images/teaser.png" width="80%"/> | ||
<p> | ||
RoDUS is a neural scene representation designed to decompose 4D dynamic | ||
scenes into two elements: moving foreground and static background. This decomposition remains consistent across all photometric, geometric, and semantic aspects | ||
</p> | ||
</div> | ||
</div> | ||
</section> | ||
|
||
<section class="section"> | ||
<div class="container is-max-desktop"> | ||
<!-- Abstract. --> | ||
<div class="columns is-centered has-text-centered"> | ||
<div class="column is-four-fifths"> | ||
<h2 class="title is-3">Abstract</h2> | ||
<div class="content has-text-justified"> | ||
The task of separating dynamic objects from static environments using NeRFs has been widely studied in recent years. | ||
However, capturing large-scale scenes still poses a challenge due to their complex geometric structures and unconstrained dynamics. | ||
Without the help of 3D motion cues, previous methods often require simplified setups with slow camera motion and only a few/single dynamic actors, leading to suboptimal solutions in most urban setups. | ||
To overcome such limitations, we present RoDUS, a pipeline for decomposing static and dynamic elements in urban scenes, with thoughtfully separated NeRF models for moving and non-moving components. | ||
Our approach utilizes a robust kernel-based initialization coupled with 4D semantic information to selectively guide the learning process. | ||
This strategy enables accurate capturing of the dynamics in the scene, resulting in reduced artifacts caused by NeRF on background reconstruction, all by using self-supervision. | ||
Notably, experimental evaluations on KITTI-360 and Pandaset datasets demonstrate the effectiveness of our method in decomposing challenging urban scenes into precise static and dynamic components. | ||
</div> | ||
</div> | ||
</div> | ||
<!--/ Abstract. --> | ||
</div> | ||
</section> | ||
|
||
|
||
<section class="section"> | ||
<div class="container is-full-width has-text-centered"> | ||
<h2 class="title is-3">Results</h2> | ||
|
||
<h3 class="title is-4">Dynamic scene reconstruction and decomposition</h3> | ||
<div class="columns is-centered"> | ||
<div class="column"> | ||
<div class="content"> | ||
<video id="kitti_21" controls loop playsinline height="100%"> | ||
<source src="./static/videos/kitti_21.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
</div> | ||
|
||
<div class="column"> | ||
<div class="content"> | ||
<video id="kitti_21" controls loop playsinline height="100%"> | ||
<source src="./static/videos/kitti_22.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
</div> | ||
</div> | ||
|
||
<h3 class="title is-4">Static background extraction</h3> | ||
<div class="container is-max-desktop"> | ||
<video id="panda_static" controls loop playsinline height="100%"> | ||
<source src="./static/videos/static.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
</div> | ||
</section> | ||
|
||
|
||
<section class="section" id="BibTeX"> | ||
<div class="container is-max-desktop content"> | ||
<h2 class="title">BibTeX</h2> | ||
<pre><code>@article{nguyen2024rodus, | ||
title={RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenes}, | ||
author={Nguyen, Thang-Anh-Quan and Rold{\~a}o, Luis and Piasco, Nathan and Bennehar, Moussab and Tsishkou, Dzmitry}, | ||
journal={arXiv preprint arXiv:2403.09419}, | ||
year={2024} | ||
}</code></pre> | ||
</div> | ||
</section> | ||
|
||
|
||
<footer class="footer"> | ||
<div class="container"> | ||
<div class="columns is-centered"> | ||
<div class="content"> | ||
<p> | ||
We thank <a | ||
href="https://github.com/nerfies/nerfies.github.io">Nerfies</a> for the website template. | ||
</p> | ||
</div> | ||
</div> | ||
</div> | ||
</footer> | ||
|
||
</body> | ||
</html> |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
Oops, something went wrong.