pszemraj commited on
Commit
4708e22
1 Parent(s): b8aa019

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # mega-small-2048 on simple wikipedia
19
 
20
- This model is a fine-tuned version of [pszemraj/random-mega-small-2048](https://huggingface.co/pszemraj/random-mega-small-2048) on the `pszemraj/simple_wikipedia_LM` dataset.
21
  It achieves the following results on the evaluation set:
22
  - Loss: 3.4773
23
  - Accuracy: 0.4591
 
17
 
18
  # mega-small-2048 on simple wikipedia
19
 
20
+ MEGA for masked LM 'small' (12 layers, 512 hidden size, 2048 ctz with chunks of 1024) on the `pszemraj/simple_wikipedia_LM` dataset.
21
  It achieves the following results on the evaluation set:
22
  - Loss: 3.4773
23
  - Accuracy: 0.4591