Running
on
CPU Upgrade
14
π₯
Albert Villanova del Moral
albertvillanova
AI & ML interests
ML Engineer @ Hugging Face: Evaluations (Science)
Recent Activity
updated
a Space
about 12 hours ago
demo-leaderboard-backend/leaderboard
New activity
1 day ago
demo-leaderboard-backend/leaderboard:Remove user_name and model_path from submit.py
updated
a dataset
1 day ago
albertvillanova/tmp-file-upload
Organizations
albertvillanova's activity
updated
a
Space
about 12 hours ago
Remove user_name and model_path from submit.py
#16 opened 1 day ago
by
albertvillanova
albertvillanova
updated
a
dataset
1 day ago
Create lighteval/_versions.yml
3
#28 opened 3 months ago
by
SaylorTwift
SaylorTwift
updated
a
Space
8 days ago
posted
an
update
8 days ago
Post
1137
π¨ How green is your model? π± Introducing a new feature in the Comparator tool: Environmental Impact for responsible #LLM research!
π open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
π The Comparator calculates COβ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... π οΈ
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!
π open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
π The Comparator calculates COβ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... π οΈ
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!
updated
a
dataset
10 days ago
updated
a
Space
10 days ago
upvoted
a
collection
19 days ago
upvoted
a
collection
22 days ago
updated
a
Space
22 days ago
posted
an
update
23 days ago
Post
1262
π New feature of the Comparator of the π€ Open LLM Leaderboard: now compare models with their base versions & derivatives (finetunes, adapters, etc.). Perfect for tracking how adjustments affect performance & seeing innovations in action. Dive deeper into the leaderboard!
π οΈ Here's how to use it:
1. Select your model from the leaderboard.
2. Load its model tree.
3. Choose any base & derived models (adapters, finetunes, merges, quantizations) for comparison.
4. Press Load.
See side-by-side performance metrics instantly!
Ready to dive in? π Try the π€ Open LLM Leaderboard Comparator now! See how models stack up against their base versions and derivatives to understand fine-tuning and other adjustments. Easier model analysis for better insights! Check it out here: open-llm-leaderboard/comparator π
π οΈ Here's how to use it:
1. Select your model from the leaderboard.
2. Load its model tree.
3. Choose any base & derived models (adapters, finetunes, merges, quantizations) for comparison.
4. Press Load.
See side-by-side performance metrics instantly!
Ready to dive in? π Try the π€ Open LLM Leaderboard Comparator now! See how models stack up against their base versions and derivatives to understand fine-tuning and other adjustments. Easier model analysis for better insights! Check it out here: open-llm-leaderboard/comparator π
posted
an
update
30 days ago
Post
3100
π Exciting update! You can now compare multiple models side-by-side with the Hugging Face Open LLM Comparator! π
open-llm-leaderboard/comparator
Dive into multi-model evaluations, pinpoint the best model for your needs, and explore insights across top open LLMs all in one place. Ready to level up your model comparison game?
open-llm-leaderboard/comparator
Dive into multi-model evaluations, pinpoint the best model for your needs, and explore insights across top open LLMs all in one place. Ready to level up your model comparison game?
upvoted
an
article
about 1 month ago
Article
Let's talk about LLM evaluation
By
β’
β’
134
upvoted
2
collections
about 1 month ago
posted
an
update
about 1 month ago
Post
1217
π¨ Instruct-tuning impacts models differently across families! Qwen2.5-72B-Instruct excels on IFEval but struggles with MATH-Hard, while Llama-3.1-70B-Instruct avoids MATH performance loss! Why? Can they follow the format in examples? π Compare models:
open-llm-leaderboard/comparator
updated
a
Space
about 1 month ago
Dataset Viewer issue: TypeError: Couldn't cast array
6
#5 opened 2 months ago
by
albertvillanova
albertvillanova
upvoted
an
article
about 1 month ago
Article
SmolLM - blazingly fast and remarkably powerful
β’
271