Why users always need to download both safetensors and bin at the same time even thought we just need one?

#67
by lucasjin - opened

This is a little bit anony actually, I know I can downloaded it and delete incase it waste my drive space.

But This actually not make sense, why we need download it all the time??

"users always need to download both"

Not sure who those "users" you're talking to are.
I've never read or heard that both were necessary. They're not. Take whatever file you want. 1 is ENOUGH...

You may use the huggingface-cli tool on command line and exclude the old pickle file (*.bin) as follows:

huggiingface-cli download meta-llama/Llama-2-70b-hf --exclude "*.bin"

Substitute the llama model id with anything else as you see fit.

Sign up or log in to comment