pepy.tech

swebench

4.1.0
7.65M

The official SWE-bench package - a benchmark for evaluating LMs on software engineering