Hugging Face's logo
Rajdeep Borgohain's picture
TFLOPS icon 31.2 TFLOPS
9 27 20

Rajdeep Borgohain

rbgo
clem's profile picture 21world's profile picture
·

AI & ML interests

Solving language barriers.

Recent Activity

Reacted to m-ric's post with 👍 10 days ago
🔍 Meta teams use a fine-tuned Llama model to fix production issues in seconds One of Meta's engineering teams shared how they use a fine-tuned small Llama (Llama-2-7B, so not even a very recent model) to identify the root cause of production issues with 42% accuracy. 🤔 42%, is that not too low? ➡️ Usually, whenever there's an issue in production, engineers dive into recent code changes to find the offending commit. At Meta's scale (thousands of daily changes), this is like finding a needle in a haystack. 💡 So when the LLM-based suggestion is right, it cuts incident resolution time from hours to seconds! How did they do it? 🔄 Two-step approach: ‣ Heuristics (code ownership, directory structure, runtime graphs) reduce thousands of potential changes to a manageable set ‣ Fine-tuned Llama 2 7B ranks the most likely culprits 🎓 Training pipeline: ‣ Continued pre-training on Meta's internal docs and wikis ‣ Supervised fine-tuning on past incident investigations ‣ Training data mimicked real-world constraints (2-20 potential changes per incident) 🔮 Now future developments await: ‣ Language models could handle more of the incident response workflow (runbooks, mitigation, post-mortems) ‣ Improvements in model reasoning should boost accuracy further Read it in full 👉 https://www.tryparity.com/blog/how-meta-uses-llms-to-improve-incident-response
updated a dataset 19 days ago
rbgo/llm-inference-benchmark
liked a Space about 1 month ago
lj1995/GPT-SoVITS-v2
View all activity

Organizations

Inferless's profile picture Social Post Explorers's profile picture

Collections 4