Merge branch 'main' of https://huggingface.co/johnBamma/icefall-asr-ksponspeech-zipformer-2024-06-24
Browse files
README.md
CHANGED
@@ -5,4 +5,45 @@ language:
|
|
5 |
pipeline_tag: automatic-speech-recognition
|
6 |
tags:
|
7 |
- icefall
|
8 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
pipeline_tag: automatic-speech-recognition
|
6 |
tags:
|
7 |
- icefall
|
8 |
+
---
|
9 |
+
|
10 |
+
See https://github.com/k2-fsa/icefall/pull/1664
|
11 |
+
|
12 |
+
# icefall-asr-ksponspeech-zipformer-2024-06-24
|
13 |
+
|
14 |
+
KsponSpeech is a large-scale spontaneous speech corpus of Korean.
|
15 |
+
This corpus contains 969 hours of open-domain dialog utterances,
|
16 |
+
spoken by about 2,000 native Korean speakers in a clean environment.
|
17 |
+
|
18 |
+
All data were constructed by recording the dialogue of two people
|
19 |
+
freely conversing on a variety of topics and manually transcribing the utterances.
|
20 |
+
|
21 |
+
The transcription provides a dual transcription consisting of orthography and pronunciation,
|
22 |
+
and disfluency tags for spontaneity of speech, such as filler words, repeated words, and word fragments.
|
23 |
+
|
24 |
+
The original audio data has a pcm extension.
|
25 |
+
During preprocessing, it is converted into a file in the flac extension and saved anew.
|
26 |
+
|
27 |
+
KsponSpeech is publicly available on an open data hub site of the Korea government.
|
28 |
+
The dataset must be downloaded manually.
|
29 |
+
|
30 |
+
For more details, please visit:
|
31 |
+
|
32 |
+
- Dataset: https://aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=realm&dataSetSn=123
|
33 |
+
- Paper: https://www.mdpi.com/2076-3417/10/19/6936
|
34 |
+
|
35 |
+
### zipformer (Zipformer + pruned statelss transducer)
|
36 |
+
|
37 |
+
#### [zipformer](./zipformer)
|
38 |
+
|
39 |
+
Number of model parameters: 74,778,511, i.e., 74.78 M
|
40 |
+
|
41 |
+
##### Training on KsponSpeech (with MUSAN)
|
42 |
+
|
43 |
+
The CERs are:
|
44 |
+
|
45 |
+
| decoding method | eval_clean | eval_other | comment |
|
46 |
+
|----------------------|------------|------------|---------------------|
|
47 |
+
| greedy search | 10.60 | 11.56 | --epoch 30 --avg 9 |
|
48 |
+
| fast beam search | 10.59 | 11.54 | --epoch 30 --avg 9 |
|
49 |
+
| modified beam search | 10.35 | 11.35 | --epoch 30 --avg 9 |
|