Add eval.yaml (#4 )

- Add eval.yaml (0bffd3f4825f713e220b52e99eb3209fd98b4162) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
Upload dataset
2026-02-23 20:54:47 +00:00 · 2026-02-09 20:38:03 +00:00 · 2026-02-09 20:23:33 +00:00 · 2026-02-09 20:23:33 +00:00 · 2026-02-09 20:23:32 +00:00 · 2026-02-09 20:10:24 +00:00
6 changed files with 17 additions and 13 deletions
@@ -31,17 +31,19 @@ dataset_info:
    dtype: string
  - name: selected_test_files_to_run
    dtype: string
  - name: dockerhub_tag
    dtype: string
  splits:
  - name: test
-    num_bytes: 23284899
+    num_bytes: 23667808
    num_examples: 731
-  download_size: 120086340
+  download_size: 7816820
-  dataset_size: 416515483
+  dataset_size: 23667808
 configs:
 - config_name: default
  data_files:
  - split: test
-    path: external_hf_v2.csv
+    path: data/test-*
 ---
@@ -0,0 +1,8 @@
 name: SWE-Bench Pro
 description: SWE-Bench Pro is an advanced, 1,865-task benchmark for evaluating AI coding agents on realistic, complex, long-horizon software engineering tasks. It improves upon the original SWE-Bench by focusing on non-trivial patches across 41+ repositories, aiming to address data contamination, task and complexity.
 evaluation_framework: swe-bench-pro
 tasks:
  - id: SWE_Bench_Pro
    config: default
    split: test
Author	SHA1	Message	Date
Jeff DaandNiels Rogge	7ab5114912	Add eval.yaml (#4 ) - Add eval.yaml (0bffd3f4825f713e220b52e99eb3209fd98b4162) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>	2026-02-23 20:54:47 +00:00
Jeff Da	2dd05cab15	Upload dataset	2026-02-09 20:38:03 +00:00
Jeff Da	feb7159156	Remove old CSV file: test.csv	2026-02-09 20:23:33 +00:00
Jeff Da	b662601616	Remove old CSV file: external_hf_v2.csv	2026-02-09 20:23:33 +00:00
Jeff Da	f60c8c4f21	Remove old CSV file: external_hf.csv	2026-02-09 20:23:32 +00:00
Jeff Da	badd723528	Upload dataset	2026-02-09 20:10:24 +00:00
Jeff Da	9c13b199fe	Upload external_hf_v2.csv	2025-09-25 02:25:12 +00:00
Jeff Da	94a5076080	Upload external_hf_v2.csv	2025-09-25 02:15:34 +00:00
Jeff Da	d8d6c2ea5f	Update README.md	2025-09-25 02:15:20 +00:00
Jeff Da	a3f0ce9b30	Update README.md	2025-09-23 19:43:17 +00:00