hf-scripts / README.md
Anthonyg5005's picture
Update README.md
dfe6c1e verified
|
raw
history blame
2.28 kB
metadata
license: unlicense
language:
  - en

scripts

Personal scripts to automate some tasks.
Will try to keep external module use to a minimum, other than huggingface_hub.
Feel free to send in pull requests or use this code however you'd like.
GitHub mirror

For GitHub: Would recommend creating pull requests and discussions on the offical huggingface repo

existing scripts

work in progress/not tested (unfinished branch)

  • Push to hf hub
  • Manage branches (Use Kaggle secret)

other recommended scripts

usage

  • Manage branches

    • Run script and follow prompts. You will be required to be logged in to HF Hub. If you are not logged in, you will need a WRITE token. You can get one in your HuggingFace settings. May get some updates in the future for handling more situations. All active updates will be on the unfinished branch.
  • Download models

    • Make sure you have requests and tqdm installed. You can install them with 'pip install requests tqdm'. To use the script, open a terminal and run 'python download-model.py USER/MODEL:BRANCH'. There's also a '--help' flag to show the available arguments. To download from private repositories, make sure to login using 'huggingface-cli login' or HF_TOKEN environment variable.

extras

  • HF login snippet
    • The login method that I wrote to make fetching the token better.
  • HF login snippet kaggle
    • Same as before but for cloud ipynb like Colab and Kaggle (Kaggle secret support) [not tested]