Commit History

update(tokenizer): convert to `GPT2Tokenizer`
8562553

jon-tow commited on

revert(config): use `float16` default torch dtype
a2eb1af
verified

jon-tow commited on

merge: upload transformers implementation (#6)
ebf5f38
verified

jon-tow commited on

Update README.md
39d1453
verified

marcob commited on

feat: add initial tech report
39849ba
verified

jon-tow commited on

fix(README): clarify usage of bias terms
64c3d6a
verified

jon-tow commited on

fix(modeling): use correct `base_model_prefix` name
1909ae1
verified

jon-tow commited on

fix(tokenizer): expose `errors`
21ee10d
verified

jon-tow commited on

feat: add dropout support
810b45c

jon-tow commited on

fix: make `eos_token`/`pad_token` overridable and add `pickle` support
4c846d7

jon-tow commited on

update(README): add extra lang tags
720763e
verified

jon-tow commited on

fix: add default special tokens
9f2def9
verified

jon-tow commited on

fix: add default special tokens
ca32832
verified

jon-tow commited on

fix: revert zephyr tokenizer config change
192936b
verified

jon-tow commited on

fix: add chat template to tokenizer config
507254d
verified

reciprocate commited on

feat: add `LICENSE`
e6185e1

jon-tow commited on

feat(tokenizer): expose merge ranks and special tokens for GGUF
a8f2f28
verified

jon-tow commited on

init: release
3aeae29

jon-tow commited on

initial commit
a3cceb4
verified

jon-tow commited on