TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution
Researchers introduce TestEvo-Bench, a benchmark for evaluating AI agents' ability to co-evolve software tests and code changes in real-world repositories.
Software tests and code evolve together: a code change should be followed by new or updated tests that record the new software behavior. Yet existing test generation and update benchmarks often isolate the test from the code change, and rely on static metadata that does not verify whether a test is executable or semantically tied to the code change. This makes it difficult to evaluate whether a test automation agent understands how a code change should propagate into the test suite.
We introduce TestEvo-Bench, a benchmark of test and code co-evolution tasks mined from software repositories,
Source: TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution. Read the full piece at the source.
Summary and analysis generated by AI (mistral). Always verify against the original sources.
Measuring the Economic Effects of AI - Economic Innovation Group
