Eli Chen

elichen3051's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted an article 10 days ago

view article

Article

Efficient LLM Pretraining: Packed Sequences and Masked Attention

By •

Oct 7

• 7

updated a dataset 12 days ago

skymizer/axolotl-tiny-set

Viewer • Updated 12 days ago • 3.23k • 19

updated a dataset 13 days ago

skymizer/fineweb-edu-dedup-5B

Viewer • Updated 13 days ago • 4.83M • 46

updated a model 13 days ago

skymizer/llama3.2-1B-cpt-5B-pretokenized-flash-attn-re

Text Generation • Updated 13 days ago • 18

updated a dataset 13 days ago

skymizer/fineweb-edu-dedup-45B

Viewer • Updated 13 days ago • 43.4M • 124 • 1

liked a dataset 13 days ago

argilla/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 60.9k • 8.72k • 125

updated a dataset 13 days ago

skymizer/pretraining-10K-examples

Viewer • Updated 13 days ago • 10k • 35

updated 3 datasets 15 days ago

skymizer/packed_pretraining_5B_llama3.2_seq_len_2048

Viewer • Updated 15 days ago • 2.25M • 77

skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048

Viewer • Updated 15 days ago • 22.5M • 33

skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048

Viewer • Updated 15 days ago • 22.5M • 33

liked a dataset 15 days ago

emozilla/yarn-train-tokenized-8k-llama

Viewer • Updated Nov 16, 2023 • 213k • 166 • 1

updated 3 datasets 15 days ago

skymizer/pretraining-5B-tokenized-padded-packed-2048

Viewer • Updated 15 days ago • 2.25M • 35

skymizer/pretraining-5B-tokenized-padded-packed-2048

Viewer • Updated 15 days ago • 2.25M • 35

skymizer/pretraining-tiny-tokenized-padded

Viewer • Updated 15 days ago • 11.1k • 36

updated 2 datasets 16 days ago

skymizer/pretraining-5B-tokenized-padded

Viewer • Updated 16 days ago • 5.73M • 55

skymizer/pretraining-50B-tokenized-padded

Viewer • Updated 16 days ago • 57.3M • 21