scutcyr
commited on
Commit
•
6d6961b
1
Parent(s):
ca7558c
update readme
Browse files
README.md
CHANGED
@@ -1,3 +1,34 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
+
## Model Card: dstc11-simmc2.1-iflytek
|
5 |
+
|
6 |
+
## Recent Update
|
7 |
+
- 👏🏻 2022.10.10: The repository `dstc11-simmc2.1-iflytek` for [DSTC11 Track1](https://github.com/facebookresearch/simmc2) is created.
|
8 |
+
|
9 |
+
|
10 |
+
## Overview
|
11 |
+
The [SIMMC2.1](https://github.com/facebookresearch/simmc2) challenge aims to lay the foundations for the real-world assistant agents that can handle multimodal inputs, and perform multimodal actions. It has 4 tasks: Ambiguous Candidate Identification, Multimodal Coreference Resolution, Multimodal Dialog State Tracking, Response Generation. We consider the joint input of textual context, tokenized objects and scene as multi-modal input, as well as compare the performance of single task training and multi task joint training.
|
12 |
+
|
13 |
+
## Model Date
|
14 |
+
Model was originally released in October 2022.
|
15 |
+
|
16 |
+
## Model Type
|
17 |
+
The **mt-bart**, **mt-bart-sys** and **mt-bart-sys-nvattr** have the same model framework (transformer with multi-task head), which are finetuned on [SIMMC2.1](https://github.com/facebookresearch/simmc2) based on the pretrained [BART-Large](https://huggingface.co/facebook/bart-large) model. This [repository](https://github.com/scutcyr/dstc11-simmc2.1-iflytek) also contains code to finetune the model.
|
18 |
+
|
19 |
+
|
20 |
+
## Using with Transformers
|
21 |
+
(1) You should first download the model from huggingface used the scripts:
|
22 |
+
```bash
|
23 |
+
cd ~
|
24 |
+
mkdir pretrained_model
|
25 |
+
cd pretrained_model
|
26 |
+
git lfs install
|
27 |
+
git clone https://huggingface.co/scutcyr/dstc11-simmc2.1-iflytek
|
28 |
+
```
|
29 |
+
(2) Then you should clone our code use the follow scripts:
|
30 |
+
```bash
|
31 |
+
cd ~
|
32 |
+
git clone https://github.com/scutcyr/dstc11-simmc2.1-iflytek.git
|
33 |
+
```
|
34 |
+
(3) Follow the [README](https://github.com/scutcyr/dstc11-simmc2.1-iflytek#readme) to use the model.
|