pepy.tech

swebench

4.0.3
2.87M

The official SWE-bench package - a benchmark for evaluating LMs on software engineering