This collection contains safetyQA dataset for safe SPIN training and trained models
Yifan Wang
AmberYifan
AI & ML interests
None yet
Recent Activity
updated
a model
5 days ago
AmberYifan/Llama-2-7b-sft-dpo-10k
updated
a model
5 days ago
AmberYifan/Llama-2-7b-sft-gen-dpo-10k
updated
a model
5 days ago
AmberYifan/Llama-2-7b-sft-gen-dpo-10k
Organizations
Collections
1
models
129
AmberYifan/Llama-2-7b-sft-dpo-10k
Text Generation
•
Updated
•
22
AmberYifan/Llama-2-7b-sft-gen-dpo-10k
Text Generation
•
Updated
•
14
AmberYifan/Llama-2-7b-sft-spin-10k
Text Generation
•
Updated
•
39
AmberYifan/Mistral-7B-v0.1-sft-spin-10k
Text Generation
•
Updated
•
18
AmberYifan/Mistral-7B-v0.1-sft-dpo-10k
Text Generation
•
Updated
•
28
AmberYifan/Mistral-7B-v0.1-sft-gen-dpo-10k
Text Generation
•
Updated
•
31
AmberYifan/mistral-v0.1-7b-sft-ultrachat-safeRLHF
Text Generation
•
Updated
•
63
AmberYifan/llama2-7b-sft-ultrachat-safeRLHF
Text Generation
•
Updated
•
90
AmberYifan/mistral-v0.1-7b-sft-ultrachat
Text Generation
•
Updated
•
30
AmberYifan/llama2-7b-sft-ultrachat
Text Generation
•
Updated
•
29
datasets
25
AmberYifan/mistral-v0.1-spin-hhrlhf
Viewer
•
Updated
•
5.5k
•
8
AmberYifan/sft-spin-filter
Updated
•
2
AmberYifan/sft-spin-kcenter-5k
Viewer
•
Updated
•
5.5k
•
14
AmberYifan/gsm8k-sft
Viewer
•
Updated
•
8.79k
•
11
AmberYifan/sft-spin-v
Viewer
•
Updated
•
50.5k
•
11
AmberYifan/safeRLHF-SFT
Viewer
•
Updated
•
83.4k
•
13
AmberYifan/SPIN-trans-DPOformat
Viewer
•
Updated
•
55k
•
9
AmberYifan/spin-v-diverse
Viewer
•
Updated
•
55k
•
23
AmberYifan/dpo-v
Viewer
•
Updated
•
55k
•
12
AmberYifan/spin-v
Viewer
•
Updated
•
55k
•
9