Coding · coding
CodingComing soon · v0.2
Implementing and fixing code in real repositories, graded by hidden tests.
- Source
- Authored
- Score
- ModelAxes score, λ = 1
- Ladder
- Not decided yet
- Items
- Not built yet
- Dimensions
- —
No results yet: this benchmark is planned and is not part of any score. Everything on this page describes the plan and may change before it ships.
The plan
Early planOnly the idea is settled. How items are built and scored is still open.
What it will measure
Writing, fixing and reviewing code in real repositories, graded by tests the model never sees.
How items will be built
- Not specified yet.