Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15 • 272 • 701 eth-sri/smiles-eval Viewer • Updated Aug 15 • 167 • 124 zai-org/humaneval-x Updated Oct 25, 2022 • 1.57k • 92 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15 • 473 • 32 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25 • 2.2k • 115 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25 • 299 • 46 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25 • 433 • 209 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25 • 2.52k • 87 • 2
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15 • 272 • 701 eth-sri/smiles-eval Viewer • Updated Aug 15 • 167 • 124 zai-org/humaneval-x Updated Oct 25, 2022 • 1.57k • 92 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15 • 473 • 32 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25 • 2.2k • 115 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25 • 299 • 46 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25 • 433 • 209 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25 • 2.52k • 87 • 2