llamafactory

/

tiny-random-Llama-3-valuehead

like 0

Follow

LLaMA Factory 24

from trl import AutoModelForCausalLMWithValueHead

AutoModelForCausalLMWithValueHead.from_pretrained()

Thanks so much for your reply @hiyouga —ah sorry, had imported AutoModelForCausalLMWithValueHead earlier... still getting the same error.

Thanks @hiyouga , this is very helpful, would you mind providing a complete code snippet on how to download your model including value head?

@niklasstoehr I have tried in my own computer, just using the following code to load the model. You can safely ignore the warnings

from trl import AutoModelForCausalLMWithValueHead

AutoModelForCausalLMWithValueHead.from_pretrained("llamafactory/tiny-random-Llama-3-valuehead")