When Generative AI Writes Test Cases: Scenario-Driven Evaluation of Generated Tests

Abstract excerpt

<title>Abstract</title> <p> Software developers increasingly turn to Generative AI (GenAI) to generate unit tests. Moreover, they can interact with GenAI in different ways, e.g., directly prompting to generate a test suite or asking for higher-level test scenarios.However, we lack the means to compare the effectiveness of these strategies.Commonly used metrics, e.g., coverage or pass@k, give limited insight into...

Topics

Open a Topic to create a Post that cites this publication.

• Mutation
• Software

Identifiers and source

Literature Corpus work

00b221fd-281b-5a51-bccc-296ef8e146e5

DOI

10.21203/rs.3.rs-9238547/v1