iHore/SWE-bench_Verified
8
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update eval.yaml (#4)

Browse Source 
- Update eval.yaml (f969e1b0b82b7791849e2aa8331931061c574b32)


Co-authored-by: Nathan Habib <SaylorTwift@users.noreply.huggingface.co>
This commit is contained in:
Ofir Press
2026-02-27 20:36:38 +00:00
committed by system
co-authored by Nathan Habib
parent 880e32832a
commit 91aa3ed51b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
eval.yaml
+1 -1
View File
@@ -1,6 +1,6 @@
name: SWE-Bench Verified name: SWE-Bench Verified
description: SWE-bench Verified is a curated, human-annotated subset of 500 issues from the original SWE-bench, designed to accurately evaluate AI models on real-world software engineering tasks. It fixes issues in the original dataset by ensuring all tasks are solvable, well-defined, and properly tested by human developers. description: SWE-bench Verified is a curated, human-annotated subset of 500 issues from the original SWE-bench, designed to accurately evaluate AI models on real-world software engineering tasks. It fixes issues in the original dataset by ensuring all tasks are solvable, well-defined, and properly tested by human developers.
evaluation_framework: swe-bench-verified evaluation_framework: swe-bench
tasks: tasks:
- id: swe_bench_%_resolved - id: swe_bench_%_resolved