An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper
•
2310.12962
•
Published
•
14
Fine-tuning
Note Our experiments with EFT show that scaling up fine-tuning tends to improve helpfulness, while scaling up pre-training tends to improve factuality.