FINE TUNING with PEFT MIXTRAL
#17
by
TK4000
- opened
How to finetune this dolphin model ? or the base model ? just like all other model with transformer ? or I need to do some adjustment before training ?
Hello, please check this notebook: https://github.com/brevdev/notebooks/blob/e815947d907460c3ed123d49ac6aeab67a9adf22/mixtral-finetune-own-data.ipynb
You can also refer to this tutorial: https://www.youtube.com/watch?v=kmkcNVvEz-k
