README.md

🦙🎛️ LLaMA-LoRA

Making evaluating and fine-tuning LLaMA models with low-rank adaptation (LoRA) easy.

Features

• 1-click up and running in Google Colab.
  • Loads and stores data in Google Drive.
• Evaluate various LLaMA LoRA models stored in your folder or from Hugging Face.
  
• Fine-tune LLaMA models with different prompt templates and training dataset format.
  
  • Load JSON and JSONL datasets from your folder, or even paste plain text directly into the UI.
  • Supports Stanford Alpaca seed_tasks, alpaca_data and OpenAI "prompt"-"completion" format.

Acknowledgements

• https://github.com/tloen/alpaca-lora
• https://github.com/lxe/simple-llama-finetuner
• ...

TBC