File size: 1,496 Bytes
9a42933
5a7544b
 
 
 
9a42933
 
 
5a7544b
9a42933
 
f52fb0f
6c5a5b1
f52fb0f
 
 
 
 
 
 
 
 
6c5a5b1
bae5645
 
 
 
6c5a5b1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
---
title: AI Clip Factory
emoji: 🧞
colorFrom: yellow
colorTo: purple
sdk: docker
pinned: true
app_port: 3000
disable_embedding: true
---

# The AI Clip Factory

The AI Clip Factory is a space to create animated videos in an ultra simple and fun way. It is meant to be a child's play.

## Text-to-video model

The AI Clip Factory is a space about clip generation and providing a fun UI, and is not meant to promote a specific AI model.

As a consequence, a model currently defined as default may be replaced at anytime by a newer SOTA model.

Right now (2023-10-19) the default model is the base Hotshot-XL (use the official website for faster inference at [https://hotshot.co](https://hotshot.co)).

# Interpolation model

The default model used for interpolation is [ST-MFNet](https://github.com/zsxkib/ST-MFNet)

## Setup

If you run the app locally you need to create a `.env.local` file 
(If you deploy to Hugging Face, just set the environment variable from the settings)

### Video rendering engine

Note: the app is in heavy development, not all backends are supported

Set `VIDEO_ENGINE` to one of:

- `VIDEO_ENGINE="VIDEO_HOTSHOT_XL_API_GRADIO"`
- `VIDEO_ENGINE="VIDEO_HOTSHOT_XL_API_REPLICATE"`
- `VIDEO_ENGINE="VIDEO_HOTSHOT_XL_API_NODE"` <- not working yet
- `VIDEO_ENGINE="VIDEO_HOTSHOT_XL_API_OFFICIAL"` <- not working yet


### Authentication

If you intent to use a special provider (eg. Replicate) you need to setup your token

- `AUTH_REPLICATE_API_TOKEN="<YOUR SECRET>"`