scutcyr commited on
Commit
6d6961b
1 Parent(s): ca7558c

update readme

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ ## Model Card: dstc11-simmc2.1-iflytek
5
+
6
+ ## Recent Update
7
+ - 👏🏻 2022.10.10: The repository `dstc11-simmc2.1-iflytek` for [DSTC11 Track1](https://github.com/facebookresearch/simmc2) is created.
8
+
9
+
10
+ ## Overview
11
+ The [SIMMC2.1](https://github.com/facebookresearch/simmc2) challenge aims to lay the foundations for the real-world assistant agents that can handle multimodal inputs, and perform multimodal actions. It has 4 tasks: Ambiguous Candidate Identification, Multimodal Coreference Resolution, Multimodal Dialog State Tracking, Response Generation. We consider the joint input of textual context, tokenized objects and scene as multi-modal input, as well as compare the performance of single task training and multi task joint training.
12
+
13
+ ## Model Date
14
+ Model was originally released in October 2022.
15
+
16
+ ## Model Type
17
+ The **mt-bart**, **mt-bart-sys** and **mt-bart-sys-nvattr** have the same model framework (transformer with multi-task head), which are finetuned on [SIMMC2.1](https://github.com/facebookresearch/simmc2) based on the pretrained [BART-Large](https://huggingface.co/facebook/bart-large) model. This [repository](https://github.com/scutcyr/dstc11-simmc2.1-iflytek) also contains code to finetune the model.
18
+
19
+
20
+ ## Using with Transformers
21
+ (1) You should first download the model from huggingface used the scripts:
22
+ ```bash
23
+ cd ~
24
+ mkdir pretrained_model
25
+ cd pretrained_model
26
+ git lfs install
27
+ git clone https://huggingface.co/scutcyr/dstc11-simmc2.1-iflytek
28
+ ```
29
+ (2) Then you should clone our code use the follow scripts:
30
+ ```bash
31
+ cd ~
32
+ git clone https://github.com/scutcyr/dstc11-simmc2.1-iflytek.git
33
+ ```
34
+ (3) Follow the [README](https://github.com/scutcyr/dstc11-simmc2.1-iflytek#readme) to use the model.