---
title: Terminal Bench Importer
emoji: 🚀
colorFrom: blue
colorTo: purple
sdk: docker
app_file: app.py
pinned: false
---

This Space automatically processes submissions to the [Terminal-Bench 2.0 Leaderboard](https://huggingface.co/datasets/alexgshaw/terminal-bench-2-leaderboard).

## How it works

1. **On Pull Request**: Validates the submission and posts a comment with results (pass/fail)
2. **On Merge**: Imports validated submissions to the leaderboard database

## Required Secrets

Configure these in Space Settings > Repository secrets:

- `SUPABASE_URL` - Supabase project URL
- `SUPABASE_SECRET_KEY` - Supabase service role key
- `HF_TOKEN` - HuggingFace token with write access (for posting comments)
- `WEBHOOK_SECRET` - Secret for webhook verification

## Webhook Configuration

Configure at [HuggingFace Webhooks Settings](https://huggingface.co/settings/webhooks):

- **Target**: `alexgshaw/terminal-bench-2-leaderboard`
- **URL**: `https://alexgshaw-terminal-bench-importer.hf.space/webhooks/handle_submission`
- **Events**: `repo.content`, `discussion`