Datasets
RL environments in Harbor format, each with a verifier and a reference solution.
Cybersecurity
Private
Binary Audit
Hunt for backdoors hidden in stripped builds of real open-source software, and point to the function that holds each one.
- Tasks
- 19
- Languages
- C, Go, Rust
- Baseline
- 0.18 pass rate
Agentic coding
Private
SWE Sweep
Find and fix the real bugs in an old release of an open-source project. No bug reports, no failing tests.
- Repositories
- 121
- Bugs
- 1,584
- Best baseline
- 0.40
Custom environments: hello@chrysalislabs.in