prince-canuma
/

Llama-3-6B-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

prince-canuma commited on May 20

Commit

f689a81

•

1 Parent(s): e53da6f

Upload tokenizer

Files changed (1) hide show

tokenizer.json +1 -0

tokenizer.json CHANGED Viewed

@@ -2407,6 +2407,7 @@
     "end_of_word_suffix": null,
     "fuse_unk": false,
     "byte_fallback": false,
     "vocab": {
       "!": 0,
       "\"": 1,

     "end_of_word_suffix": null,
     "fuse_unk": false,
     "byte_fallback": false,
+    "ignore_merges": true,
     "vocab": {
       "!": 0,
       "\"": 1,