huseinzol05 commited on
Commit
c28553d
•
1 Parent(s): c89a70f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -3,7 +3,9 @@ language:
3
  - ms
4
  ---
5
 
6
- # MaLLaM 🌙 5B (Malaysia Large Language Model), Pretrain 5B 4096 context length Mistral on Malaysian text
 
 
7
 
8
  README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral
9
 
 
3
  - ms
4
  ---
5
 
6
+ # MaLLaM 🌙 5B (Malaysia Large Language Model), Pretrain 5B 4096 context length on Malaysian text
7
+
8
+ Pretrain from scratch 5B parameters using Mistral architecture on 90B Malaysian text tokens.
9
 
10
  README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral
11