|
--- |
|
library_name: transformers |
|
base_model: Isotonic/TinyMixtral_4x220M-UniversalNER |
|
--- |
|
|
|
# Model card of Tiny_JOxIE_4x220M_UniversalNER_base |
|
## This is my Token customized TitanML/tiny-mixtral model |
|
|
|
[Origional Model][https://huggingface.co/TitanML/tiny-mixtral] |
|
|
|
This is based on TitanML/tiny-mixtral model with added custom special Tokens. |
|
|
|
<br> |
|
|
|
### New added Special Tokens |
|
|
|
```text |
|
'<|functions|>', |
|
'<|gökdeniz|>', |
|
'<|user|>', |
|
'<|josie|>', |
|
'<|assistant|>', |
|
'<|function_call|>', |
|
'<|function_response|>', |
|
'<|image|>', |
|
'<|long_term_memory|>', |
|
'<|short_term_memory|>', |
|
'<|home_state|>', |
|
'<|current_states|>', |
|
'<|context|>' |
|
``` |
|
<br> |
|
|
|
### New BOS and EOS Tokens |
|
|
|
```text |
|
BOS = '<|startoftext|>' |
|
EOS = '<|endoftext|>' |
|
``` |
|
<br> |
|
|
|
### New added Normal Tokens |
|
|
|
```text |
|
['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity'] |
|
``` |
|
|
