Accepted evidence
Submit by email to gigabrainchallenge@163.com with your ZIP package and metadata JSON (max ZIP size: 200 MB).
Submission format
Zip your run package with the task/episode folder structure shown in the Submission section. Maximum ZIP file size is 200 MB.
Update cadence
Submissions ingest daily, verification weekly, leaderboard publish weekly (UTC).
Leaderboard
Loading results.json...
| Rank | Team / Model | Round 1 | Round 2 | Round 3 | Best | Submitted | Status |
|---|
Submission
Step 1
Prepare videos, metadata JSON, and contact details.
Step 2
Email your ZIP package and metadata JSON to gigabrainchallenge@163.com with team/contact information.
Step 3
Ensure each ZIP attachment is 200 MB or less. We verify evidence and publish validated results in weekly leaderboard updates.
outputs/
--video_quality_eval/
--task1/
--episode_0.mp4
--...
--...
--evaluator_test/
--task1/
--episode_0.mp4
--...
--...
Submission JSON schema
{
"team_name": "Your Team Name",
"contact_email": "team@example.com",
"affiliation": "Example University",
"model_name": "Your Model Name",
"model_version": "v1.1",
"eval_setting": "Open-vocab tabletop; seed=5; 50 episodes",
"composite_score": 89.3,
"videos": [
{ "label": "long-horizon demo", "url": "https://huggingface.co/spaces/your-space/video1" }
],
"notes": "Any deviations from reference protocol."
}
Ranking updates and governance
- Ingest daily: new submissions are queued.
- Validate weekly: videos and metadata are checked.
- Publish weekly: rankings refresh after validation.
- Tie-break: best score, then earlier submission.