Instruction Tuning Datasets - a skymizer Collection

skymizer 's Collections

Instruction Tuning Datasets

Pre-Training Datasets

Domain-Specific Datasets

Alignment Algorithm Papers

Other Awesome datasets

Instruction Tuning Datasets

updated 14 days ago

For both SFT and DPO

tatsu-lab/alpaca

Viewer • Updated May 22, 2023 • 52k • 26.5k • 707

Note SFT
elichen3051/alpaca52k-alignment-handbook

Viewer • Updated Jun 7 • 52k • 42 • 1
yahma/alpaca-cleaned

Viewer • Updated Apr 10, 2023 • 51.8k • 21.9k • 596

Note SFT
HuggingFaceH4/ultrachat_200k

Viewer • Updated Oct 16 • 515k • 12.5k • 477

Note SFT
openbmb/UltraFeedback

Viewer • Updated Dec 29, 2023 • 64k • 1.52k • 337

Note SFT
HuggingFaceH4/ultrafeedback_binarized

Viewer • Updated Oct 16 • 187k • 6.91k • 246

Note SFT; DPO
HuggingFaceH4/deita-10k-v0-sft

Viewer • Updated Mar 1 • 20k • 216 • 31

Note SFT
HuggingFaceH4/orca_dpo_pairs

Viewer • Updated Apr 14 • 12.9k • 193 • 25

Note DPO
HuggingFaceH4/cai-conversation-harmless

Viewer • Updated Feb 2 • 44.8k • 188 • 14

Note SFT; DPO
shahules786/orca-chat

Viewer • Updated Jul 25, 2023 • 198k • 158 • 110

Note SFT
lmsys/lmsys-chat-1m

Viewer • Updated Jul 27 • 1M • 23.5k • 607

Note SFT; DPO
What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Paper • 2312.15685 • Published Dec 25, 2023 • 16
HuggingFaceH4/no_robots

Viewer • Updated Apr 18 • 10k • 1.52k • 456

Note SFT
HuggingFaceH4/SystemChat

Viewer • Updated Mar 12 • 7.02k • 62 • 9
HuggingFaceH4/deita-6k-v0-sft

Viewer • Updated Jan 9 • 12k • 39
Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 10.4k • 1.34k
Open-Orca/slimorca-deduped-cleaned-corrected

Viewer • Updated May 9 • 182k • 534 • 15
allenai/WildChat-1M

Viewer • Updated Oct 17 • 838k • 3.37k • 291
mlabonne/orpo-dpo-mix-40k

Viewer • Updated Oct 17 • 44.2k • 1.28k • 254
argilla/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 60.9k • 8.72k • 125
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jul 16 • 7.56k • 900 • 177
argilla/OpenHermesPreferences

Viewer • Updated Mar 1 • 989k • 1.37k • 199

Note DPO
OpenAssistant/oasst2

Viewer • Updated Jan 11 • 135k • 1.37k • 215