Article

Human Researchers are Superior to Large Language Models in Writing a Systematic Review in a Comparative Multitask Assessment

2025-06-13

Abstract excerpt

<title>Abstract</title> <p><bold>Background</bold> The capability of Large Language Models (LLMs) to support and facilitate research activities has sparked growing interest in their integration into scientific workflows. This paper aims to evaluate and compare against human researchers the performance of 6 different LLMs in conducting the various tasks necessary to produce a systematic literature review.<bold>Met...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 52b6c153-22fb-5bdc-bb5e-25dfbae2aeed
DOI: 10.21203/rs.3.rs-6863946/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Human Researchers are Superior to Large Language Models in Writing a Systematic Review in a Comparative Multitask AssessmentDOI 10.21203/rs.3.rs-6863946/v1Read

Automation of Systematic Reviews with Large Language ModelsSemantic proximity Read

Collaborative Large Language Models for Automated Data Extraction in Living Systematic ReviewsSemantic proximity Read

Large Language Model-Assisted Data Extraction in Systematic Reviews: A Case Study of Automated Comparative Performance EvaluationSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read

Fully Automated Systematic Review Generation via Large Language Models: Quality Assessment and Implications for Scientific PublishingSemantic proximity Read

RAPID: Reliable and efficient Automatic generation of submission rePorting checklists with Large language moDelsSemantic proximity Read

Assessing the feasibility and acceptability of a bespoke large language model pipeline to extract data from different study designs for public health evidence reviewsSemantic proximity Read

The use of a large language models to create plain language summaries of evidence reviews in healthcare: a feasibility studySemantic proximity Read

Automated reproducibility assessments in the social and behavioral sciences using large language modelsSemantic proximity Read

How good are large language models for automated data extraction from randomized trials?Semantic proximity Read

Sensitivity, specificity and avoidable workload of using a large language models for title and abstract screening in systematic reviews and meta-analysesSemantic proximity Read