huggingface/evaluation-guidebook

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

2.2k stars · 126 forks · Jupyter Notebook

This repo isn't software code, so code checks are limited.

Healthy

Healthy: no known risks in the checks that ran.

Why

No rule fired.

What would change this

Partly checked: people (Only 1 human commits were found, too few to judge who maintains the project.)
A dormant maintenance status, a deprecated or archived package, a successor link, or a critical advisory would change this.

Maintenance

Complete

Steady

Human commits, 30 days: 0
Human commits, 90 days: 0
Human commits, 365 days: 1
Bot share of commits, 365 days: 0%
Last commit: Dec 3, 2025 (10 months ago)
Last human commit: Dec 3, 2025 (10 months ago)
Authors, 90 days: 0
Last release: none found
Median PR merge time: 2 hours

Responsiveness: of 0 recent issues, n/a got a maintainer reply. Median first response: n/a.

Only 0 recent issues can be checked for a response, too few to measure response time.

Sources: Commits, Releases, Merged pull requests, Issues

People

Partial

Owner: Organization
Commits sampled: 1 since Oct 15, 2025
Authors for half of commits: 1
Authors for 80% of commits: 1
Contributors: 13

Top committers

clefourrier: 100% of commits

Only 1 human commits were found, too few to judge who maintains the project.

Sources: Commits, Contributors

Stars

Complete

Organic, confidence medium

Bars show stars gained each week. Orange bars overlap a burst.

Bursts

Apr 29, 2025 to May 1, 2025: about 111 more stars than usual, peak 68 in one day, a spike that tapers off. Outside explanation: a jump in forks.
Sep 20, 2025 to Sep 22, 2025: about 41 more stars than usual, peak 22 in one day, a spike that tapers off. We couldn't check for an outside explanation.
Oct 30, 2025 to Nov 10, 2025: about 215 more stars than usual, peak 46 in one day, a spike that tapers off. Outside explanation: a jump in forks.

Anyone can buy stars for any repo; bursts alone don't prove the owner did.

The star history looks organic.
Engagement is not compared for non-code or mirror repositories.

Sources: How star history is analyzed

Risk

Complete

Flags

No risk flags.

License

Now: No license found
A year ago: Not known

Packages

No published packages found.

Sources: GitHub: huggingface/evaluation-guidebook

Badge

Add this to a README to show the current verdict:

[![RepoRadar](https://reporadar.ai/huggingface/evaluation-guidebook/badge.svg)](https://reporadar.ai/huggingface/evaluation-guidebook)

Earlier verdicts

Oct 15, 2026: Healthy
Oct 14, 2026: Healthy

Computed 2 hours ago · method 2026.10.2