aitube-model-mmaudio-1 / docs /video_gen.html
Rex Cheng
initial commit
dbac20f
raw
history blame
9.31 kB
<!DOCTYPE html>
<html lang="en">
<head>
<!-- Google tag (gtag.js) -->
<script async src="https://www.googletagmanager.com/gtag/js?id=G-0JKBJ3WRJZ"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-0JKBJ3WRJZ');
</script>
<link href='https://fonts.googleapis.com/css?family=Source+Sans+Pro' rel='stylesheet' type='text/css'>
<meta charset="UTF-8">
<title>MMAudio</title>
<link rel="icon" type="image/png" href="images/icon.png">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- CSS only -->
<link href="https://cdn.jsdelivr.net/npm/bootstrap@5.0.1/dist/css/bootstrap.min.css" rel="stylesheet"
integrity="sha384-+0n0xVW2eSR5OomGNYDnhzAbDsOXxcvSN1TPprVMTNDbiYZCxYbOOl7+AMvyTG2x" crossorigin="anonymous">
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.7.1/jquery.min.js"></script>
<link rel="stylesheet" href="style_videos.css">
</head>
<body>
<div id="moviegen_all">
<h2 id="moviegen" style="text-align: center;">Comparisons with Movie Gen Audio on Videos Generated by MovieGen</h2>
<p id="moviegen1" style="overflow: hidden;">
Example 1: Ice cracking with sharp snapping sound, and metal tool scraping against the ice surface.
<span style="float: right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Movie Gen Audio</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/d7Lb0ihtGcE"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Ours</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/F4JoJ2r2m8U"></iframe>
</div>
</div>
</div>
<br>
<!-- <p id="moviegen2">Example 2: Rhythmic splashing and lapping of water. <span style="float:right;"><a href="#index">Back to index</a></span> </p>
<table>
<thead>
<tr>
<th>Movie Gen Audio</th>
<th>Ours</th>
</tr>
</thead>
<tbody>
<tr>
<td width="50%">
<div class="video-container">
<iframe src="https://youtube.com/embed/5gQNPK99CIk"></iframe>
</div>
</td>
<td width="50%">
<div class="video-container">
<iframe src="https://youtube.com/embed/AbwnTzG-BpA"></iframe>
</div>
</td>
</tr>
</tbody>
</table> -->
<p id="moviegen2" style="overflow: hidden;">
Example 2: Rhythmic splashing and lapping of water.
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Movie Gen Audio</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/5gQNPK99CIk"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Ours</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/AbwnTzG-BpA"></iframe>
</div>
</div>
</div>
<br>
<p id="moviegen3" style="overflow: hidden;">
Example 3: Shovel scrapes against dry earth.
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Movie Gen Audio</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/PUKGyEve7XQ"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Ours</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/CNn7i8VNkdc"></iframe>
</div>
</div>
</div>
<br>
<p id="moviegen4" style="overflow: hidden;">
(Failure case) Example 4: Creamy sound of mashed potatoes being scooped.
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Movie Gen Audio</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/PJv1zxR9JjQ"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Ours</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/c3-LJ1lNsPQ"></iframe>
</div>
</div>
</div>
<br>
</div>
<div id="hunyuan_sora_all">
<h2 id="hunyuan" style="text-align: center;">Results on Videos Generated by Hunyuan</h2>
<p style="overflow: hidden;">
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Typing</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/8ln_9hhH_nk"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Water is rushing down a stream and pouring</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/5df1FZFQj30"></iframe>
</div>
</div>
</div>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Waves on beach</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/7wQ9D5WgpFc"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Water droplet</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/q7M2nsalGjM"></iframe>
</div>
</div>
</div>
<br>
<h2 id="sora" style="text-align: center;">Results on Videos Generated by Sora</h2>
<p style="overflow: hidden;">
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Ships riding waves</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/JbgQzHHytk8"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Train (no text prompt given)</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/xOW7zrjpWC8"></iframe>
</div>
</div>
</div>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Seashore (no text prompt given)</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/fIuw5Y8ZZ9E"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Surfing (failure: unprompted music)</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/UcSTk-v0M_s"></iframe>
</div>
</div>
</div>
<br>
<div id="mochi_ltx_all">
<h2 id="mochi" style="text-align: center;">Results on Videos Generated by Mochi 1</h2>
<p style="overflow: hidden;">
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Magical fire and lightning (no text prompt given)</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/tTlRZaSMNwY"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Storm (no text prompt given)</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/4hrZTMJUy3w"></iframe>
</div>
</div>
</div>
<br>
<h2 id="ltx" style="text-align: center;">Results on Videos Generated by LTX-Video</h2>
<p style="overflow: hidden;">
<span style="float:right;"><a href="#index">Back to index</a></span>
</p>
<div class="row g-1">
<div class="col-sm-6">
<div class="video-header">Firewood burning and cracking</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/P7_DDpgev0g"></iframe>
</div>
</div>
<div class="col-sm-6">
<div class="video-header">Waterfall, water splashing</div>
<div class="video-container">
<iframe src="https://youtube.com/embed/4MvjceYnIO0"></iframe>
</div>
</div>
</div>
<br>
</div>
</body>
</html>