training every expert of mixtral-8x7b

#55

by chin-cyber - opened Apr 25

Apr 25

hi , can we finetune all 8 experts on all 8 different domain/tasks in finetuning the model. if yes how to do it

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment