Jay P

jayomb's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 6 months ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3 • 97

upvoted 2 papers 6 months ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15 • 87

Piccolo2: General Text Embedding with Multi-task Hybrid Loss Training

Paper • 2405.06932 • Published May 11 • 16

upvoted an article 7 months ago

view article

Article

Fine-tune Llama 3 with ORPO

By •

Apr 22

• 226

upvoted 2 papers 7 months ago

Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck

Paper • 2404.07647 • Published Apr 11 • 4

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Paper • 2404.05892 • Published Apr 8 • 31

upvoted a collection 8 months ago

OpenCulture

Collection

A multilingual dataset of public domain books and newspapers. • 27 items • Updated 3 days ago • 113

upvoted 2 papers 8 months ago

Knowledge Fusion of Large Language Models

Paper • 2401.10491 • Published Jan 19 • 3

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26 • 26