conftrace_

execution-based evaluation

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

code generation (4) large language model (3) code translation (2) open-domain code (1) natural language to graph query (1) version-conditioned code generation (1) library version incompatibility (1) data science (1) natural language to code (1) jupyter notebook (1)

Papers

GitChameleon 2.0: Evaluating AI Code Generation Against Python Library Version Incompatibilities ACL 2026 GQLBench: A Large-Scale Cross-Domain, Cross-Dialect Benchmark for NL2GQL ACL 2026 XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval ACL 2024 Execution-Based Evaluation for Open-Domain Code Generation EMNLP 2023 LEVER: Learning to Verify Language-to-Code Generation with Execution ICML 2023 Measuring the Impact of Programming Language Distribution ICML 2023 Execution-based Evaluation for Data Science Code Generation Models EMNLP 2022