SongTonyLi/Llama-3.2-3B-Instruct-CPT-D1_chosen-then-SFT-D2_chosen-pref-mix
Text Generation
•
Updated
•
325
Song Li
SongTonyLi
AI & ML interests
None yet
Organizations
models
150
SongTonyLi/Llama-3.2-3B-Instruct-CPT-D1_chosen-pref-mix
Text Generation
•
Updated
•
30
SongTonyLi/Llama-3.2-3B-Instruct-CPT-D_chosen-pref-mix
Text Generation
•
Updated
•
325
SongTonyLi/Llama-3.2-3B-Instruct-SFT-D1_chosen-then-D2_chosen-pref-mix
Text Generation
•
Updated
•
340
SongTonyLi/Llama-3.2-3B-Instruct-SFT-D1_chosen-pref-mix
Text Generation
•
Updated
•
22
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-then-SFT-D2_chosen-pref-mix2
Text Generation
•
Updated
•
273
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-pref-mix2
Text Generation
•
Updated
•
11
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D_chosen-pref-mix2
Text Generation
•
Updated
•
341
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D1_chosen-then-D2_chosen-pref-mix2
Text Generation
•
Updated
•
338
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D1_chosen-pref-mix2
Text Generation
•
Updated
•
13
datasets
23
SongTonyLi/llama_1B_dolly_15k_data
Viewer
•
Updated
•
15k
•
41
SongTonyLi/llama_1B_stem_data
Viewer
•
Updated
•
151k
•
34
SongTonyLi/supernova_17k
Viewer
•
Updated
•
178k
•
35
SongTonyLi/tachibana_coding_10k
Viewer
•
Updated
•
104k
•
40
SongTonyLi/Magpie-Pro-Ultra-40K
Viewer
•
Updated
•
41.4k
•
32
SongTonyLi/Magpie-Pro-hard-8K
Viewer
•
Updated
•
8k
•
36
SongTonyLi/llama-1b-preference-merge-mix
Viewer
•
Updated
•
142k
•
36
•
1
SongTonyLi/dpo-mix_skywork_infinity
Viewer
•
Updated
•
131k
•
33
•
1
SongTonyLi/dpo-mix-shuffled
Viewer
•
Updated
•
44.2k
•
30
SongTonyLi/merged_orca_skywork_capybara_infinity_midL2_preference
Viewer
•
Updated
•
88k
•
30