guillermoruiz
/

bilma_MX

Inference Endpoints

Model card Files Files and versions Community

guillermoruiz commited on Mar 26

Commit

562cfb9

•

1 Parent(s): c66fe71

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +3 -0

tokenizer.json CHANGED Viewed

@@ -64,6 +64,9 @@
       {
         "type": "NFD"
       },
       {
         "type": "StripAccents"
       },

       {
         "type": "NFD"
       },
+      {
+        "type": "Lowercase"
+      },
       {
         "type": "StripAccents"
       },