nielsr HF staff commited on
Commit
2e15e1d
1 Parent(s): 54f3160

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md CHANGED
@@ -1,3 +1,43 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ # TVLT
6
+
7
+ Textless Vision-Language Transformer (TLVT) model, pre-trained-only. It was introduced in the paper [TVLT: Textless Vision-Language Transformer](https://arxiv.org/abs/2209.14156) by Tang et al. and first released in [this repository](https://github.com/zinengtang/TVLT).
8
+
9
+ Disclaimer: The team releasing TVLT did not write a model card for this model so this model card has been written by the Hugging Face team.
10
+
11
+ ## Model description
12
+
13
+ TVLT is based on the [MAE model](https://huggingface.co/docs/transformers/model_doc/vit_mae), but extends it to audio-visual pre-training.
14
+
15
+ ## Intended uses & limitations
16
+
17
+ It's recommended to fine-tune the model on a task that involves audio and/or video.
18
+
19
+ ### How to use
20
+
21
+ For code examples, we refer to the [documentation](https://huggingface.co/docs/transformers/main/en/model_doc/tvlt).
22
+
23
+ ### BibTeX entry and citation info
24
+
25
+ ```bibtex
26
+ @misc{https://doi.org/10.48550/arxiv.2209.14156,
27
+ doi = {10.48550/ARXIV.2209.14156},
28
+
29
+ url = {https://arxiv.org/abs/2209.14156},
30
+
31
+ author = {Tang, Zineng and Cho, Jaemin and Nie, Yixin and Bansal, Mohit},
32
+
33
+ keywords = {Computer Vision and Pattern Recognition (cs.CV), Artificial Intelligence (cs.AI), Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
34
+
35
+ title = {TVLT: Textless Vision-Language Transformer},
36
+
37
+ publisher = {arXiv},
38
+
39
+ year = {2022},
40
+
41
+ copyright = {arXiv.org perpetual, non-exclusive license}
42
+ }
43
+ ```