-
Open VLM Leaderboard
🌎948VLMEvalKit Evaluation Results Collection
-
Open VLM Video Leaderboard
🌎129VLMEvalKit Eval Results in video understanding benchmark
-
Open LMM Reasoning Leaderboard
🥇44A Leaderboard that demonstrates LMM reasoning capabilities
-
MMBench Leaderboard
🚀24Explore MMBench Leaderboard data
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
View all Papers
Organization Card
👋 join us on Discord and WeChat
follow us on Github
OpenCompass is a platform focused on evaluation of AGI, include Large Language Model and Multi-modality Model. We aim to:
- develop high-quality libraries to reduce the difficulties in evaluation
- provide convincing leaderboards for improving the understanding of the large models
- create powerful toolchains targeting a variety of abilities and tasks
- build solid benchmarks to support the large model research
-
Open VLM Leaderboard
🌎948VLMEvalKit Evaluation Results Collection
-
Open VLM Video Leaderboard
🌎129VLMEvalKit Eval Results in video understanding benchmark
-
Open LMM Reasoning Leaderboard
🥇44A Leaderboard that demonstrates LMM reasoning capabilities
-
MMBench Leaderboard
🚀24Explore MMBench Leaderboard data
CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
spaces
18
pinned
Sleeping
2
ATLAS Benchmark
🧪
ATLAS for Frontier Scientific Benchmark
pinned
Running
on
CPU Upgrade
28
RISEBench Gallery
👀
A Gallery of Generation Results on RISEBench
pinned
Running
6
Open LMM Spatial Leaderboard
🥇
A Leaderboard for LMM spatial understanding capabilities
pinned
Running
26
Open LMM Subjective Leaderboard
🌎
VLMEvalKit Subjectivce Benchmark Results
pinned
Running
3
CompassAcademic Leaderboard Full Version
🦀
Compass Academic Leaderboard Full Version
pinned
Running
44
Open LMM Reasoning Leaderboard
🥇
A Leaderboard that demonstrates LMM reasoning capabilities
models
13
opencompass/CompassVerifier-32B
33B
•
Updated
•
79
•
7
opencompass/CompassVerifier-7B
8B
•
Updated
•
1.03k
•
4
opencompass/CompassVerifier-3B
3B
•
Updated
•
1.05k
•
5
opencompass/CompassJudger-2-7B-Instruct
Text Ranking
•
8B
•
Updated
•
319
•
3
opencompass/CompassJudger-2-32B-Instruct
Text Ranking
•
33B
•
Updated
•
364
•
2
opencompass/anah-7b
Text Classification
•
8B
•
Updated
•
16
opencompass/anah-20b
Text Classification
•
20B
•
Updated
•
14
opencompass/anah-v2
Text Classification
•
8B
•
Updated
•
74
•
4
opencompass/CompassJudger-1-14B-Instruct
Text Generation
•
15B
•
Updated
•
31
•
2
opencompass/CompassJudger-1-32B-Instruct
Text Generation
•
33B
•
Updated
•
356
•
17
datasets
16
opencompass/ATLAS
Viewer
•
Updated
•
798
•
71
opencompass/NeedleBench
Viewer
•
Updated
•
6.8k
•
20.1k
•
5
opencompass/ReasonZoo
Updated
•
91
opencompass/VerifierBench
Viewer
•
Updated
•
2.82k
•
62
•
3
opencompass/LiveMathBench
Viewer
•
Updated
•
483
•
300
•
10
opencompass/CodeForce_SAGA
Viewer
•
Updated
•
5.57k
•
160
•
1
opencompass/CodeCompass
Updated
•
92
•
1
opencompass/compass_academic_predictions
Viewer
•
Updated
•
4.42M
•
71
opencompass/Creation-MMBench
Viewer
•
Updated
•
765
•
271
•
3
opencompass/anah
Viewer
•
Updated
•
783
•
117
•
3