BenchMIRT: What are LLM benchmarks actually measuring?
• 22
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
View all activity
Papers
Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction
Articles
Organization Card
spaces 20
pinned
Running
29
AstaBench Leaderboard
🥇
Explore AstaBench benchmark leaderboards
pinned
Running on Zero
MCP
Featured
33
Molmo-Point Demo
🎯
MolmoPoint - Image & Video Pointing & Tracking
pinned
Running on Zero
MCP
5
MolmoPoint-GUI Demo
🖥
MolmoPoint - GUI Image Pointing
pinned
Running
Agents
436
Reward Bench Leaderboard
📐
Explore and compare model scores on RewardBench benchmarks
pinned
Runtime error
Agents
3
HREF Leaderboard
📐
Browse and search HREF leaderboard data
pinned
Running
Agents
95
Zebra Logic Bench
🦓
Display model leaderboard and explore sample puzzles
models 970
allenai/ACE2S-SHiELD-plus
Updated • 9 • 5
allenai/OlmoEarth-v1_2-Small
Image Feature Extraction • Updated • 3.05k • 4
allenai/OlmoEarth-v1_2-Base
Image Feature Extraction • Updated • 8.84k • 7
allenai/ACE2S-SHiELD-plus-supplemental-checkpoints
Updated • 40
allenai/OlmoEarth-v1-Base
Updated • 53.6k • 41
allenai/OlmoEarth-v1-Large
Updated • 669 • 22
allenai/OlmoEarth-v1-Tiny
Updated • 1.23k • 11
allenai/OlmoEarth-v1-Nano
Updated • 11.4k • 16
allenai/SamudrACE-E3SMv3
Updated • 34 • 3
allenai/StdMoE_1b14b_1T
Text Generation • 14B • Updated • 328 • 5
datasets 1,287
allenai/asta-summary-citation-counts
Viewer • Updated • 115M • 1.08k • 11
allenai/aimip-phase1-submissions
Viewer • Updated • 4 • 5
allenai/asta-bench-submissions
Updated • 239 • 3
allenai/BenchMIRT-item-statistics
Viewer • Updated • 29.6k • 790 • 1
allenai/BenchMIRT-model-statistics
Viewer • Updated • 100 • 745
allenai/asta-bench-results
Viewer • Updated • 100 • 494 • 1
allenai/BenchMIRT
Updated • 714 • 1
allenai/BenchMIRT-eval-data
Viewer • Updated • 34.3k • 73
allenai/olmoearth_lcc
Preview • Updated • 1.11k • 1
allenai/olmo-eval-wildjailbreak
Viewer • Updated • 2.25k • 152