Article

A Reference Framework for Empirical Studies on LLM-Based Code Generation: A Review-Grounded Synthesis

2026-07-06

Abstract excerpt

<title>Abstract</title> <p>Large language models are increasingly used for code generation and related software engineering tasks, but empirical studies evaluating these systems remain difficult to compare. Existing studies vary in their tasks, problem sources, application contexts, quality attributes, metrics, empirical methods, model configurations, environments, and generated artifacts. This fragmentation limi...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: bcc980c4-efd5-599a-9912-b132e63428a0
DOI: 10.21203/rs.3.rs-9892855/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Reference Framework for Empirical Studies on LLM-Based Code Generation: A Review-Grounded SynthesisDOI 10.21203/rs.3.rs-9892855/v1Read

AI-Driven Code Documentation: Comparative Evaluation of LLMs for Commit Message GenerationSemantic proximity Read

Execution Grounded Multiagent Systems for Reliable Backend Code Generation with Large Language Models'Semantic proximity Read

Investigating Reproducibility Challenges in LLM Bugfixing on the HumanEvalFix BenchmarkSemantic proximity Read

A Systematic Literature Review on Generative AI in Software Engineering: Code Generation and RefactoringSemantic proximity Read

What Makes a Programming Problem Hard for a Language Model? An Empirical Study of Item Difficulty Across Code LLMs on Two BenchmarksSemantic proximity Read

AnnCoder: A mti-Agent-Based Code Generation and Optimization ModelSemantic proximity Read

Behavioral Augmentation of UML Class Diagrams: An Empirical Study of Large Language Models for Method GenerationSemantic proximity Read

Intent-Driven Code Synthesis: Redefining Software Development with TransformersSemantic proximity Read

Efficient Program Optimization through Knowledge-Enhanced LoRA Fine-Tuning of Large Language ModelsSemantic proximity Read

A Hybrid Retrieval-Augmented Generation and Language Model Framework for Evidence-Grounded Review SystemsSemantic proximity Read

Who Broke the Pipeline? Traceability andAccountability in Multi-Agent LLM SoftwareEngineering PipelinesSemantic proximity Read

Transformation of Large Language Models: A State of ArtSemantic proximity Read