open-compass/VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

4.4k stars · 780 forks · Python

Healthy

Healthy: actively maintained by 23 people, no known risks.

Why

No rule fired.

What would change this

Maintenance

Complete

Active

Human commits, 30 days
40
Human commits, 90 days
68
Human commits, 365 days
271
Bot share of commits, 365 days
0%
Last commit
Oct 14, 2026 (20 hours ago)
Last human commit
Oct 14, 2026 (20 hours ago)
Authors, 90 days
23
Last release
Mar 24, 2025 (1 year ago)
Median PR merge time
3 days

Responsiveness: of 17 recent issues, 24% got a maintainer reply. Median first response: 12 days.

Sources: Commits, Releases, Merged pull requests, Issues

People

Complete
Owner
Organization
Commits sampled
271 since Oct 15, 2025
Authors for half of commits
13
Authors for 80% of commits
53
Contributors
292

Top committers

Sources: Commits, Contributors

Stars

Complete

Organic, confidence medium

Stars per week, 2023-11-26 to 2026-10-11. 0 weeks overlap a burst.Peak 56 a week2023-11-262026-10-11
Bars show stars gained each week. Orange bars overlap a burst.

Anyone can buy stars for any repo; bursts alone don't prove the owner did.

Sources: How star history is analyzed

Risk

Complete

Flags

No risk flags.

License

Now
Apache-2.0 (OSI-approved)
A year ago
Apache-2.0 (OSI-approved)

Packages

No published packages found.

Sources: GitHub: open-compass/VLMEvalKit

Badge

Add this to a README to show the current verdict:

[![RepoRadar](https://reporadar.ai/open-compass/VLMEvalKit/badge.svg)](https://reporadar.ai/open-compass/VLMEvalKit)

Earlier verdicts

Computed 6 hours ago · method 2026.10.2