Nyaribari Reuben

foscraft
ยท

AI & ML interests

LLMs, VLMs , Vision

Recent Activity

Reacted to DavidGF's post with ๐Ÿ”ฅ 23 days ago
๐ŸŽ‰ Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT and https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO. Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities. ๐Ÿ”ฌ Technical Breakthroughs: ๐Ÿ’  Innovative three-phase Fine-Tuning approach ๐Ÿ’  Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance ๐Ÿ’  Balance of German and English language capabilities ๐Ÿ’  Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620 ๐Ÿ‡ฉ๐Ÿ‡ช German Language Excellence: What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to: ๐Ÿ’  Enhance German language understanding and generation (SFT Version > DPO Version) ๐Ÿ’  Maintain authentic German linguistic nuances ๐Ÿ’  Improve cross-lingual capabilities ๐Ÿ’  Preserve cultural context awareness ๐Ÿ“Š Training Innovation: Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including: ๐Ÿ’  Mathematics-focused content (proprietary classifier-selected) ๐Ÿ’  High-quality German training data ๐Ÿ’  Specialized function calling datasets ๐Ÿ’  Premium multilingual content ๐ŸŽ Community Contribution: We're also releasing two new datasets in a few days: 1๏ธโƒฃ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples 2๏ธโƒฃ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call irrelevance handling Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation!ย ๐Ÿš€
View all activity

Organizations

foscraft's activity