Article

Evaluating Generative AI to Extract Qualitative Data from Peer-Reviewed Documents

2024-08-26

Abstract excerpt

<title>Abstract</title> <p>Uptake of AI tools in knowledge production processes is rapidly growing. Here, we explore the ability of generative AI tools to reliably extract qualitative data from peer-reviewed documents. Specifically, we evaluate the capacity of multiple AI tools to analyse literature and extract relevant information for a systematic literature review, comparing the results to those of human review...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 8712e5a2-73b0-599b-a2ac-5a13205818d8
DOI: 10.21203/rs.3.rs-4922498/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Generative AI to Extract Qualitative Data from Peer-Reviewed DocumentsDOI 10.21203/rs.3.rs-4922498/v1Read

Will generative AI help solve systematic literature reviews? Evidence from a 2-year research programmeSemantic proximity Read

Development of a Rapid Assessment Method for Responsible Use of Generative AI in Scientific Research: Application to the Ugandan Research ContextSemantic proximity Read

Large Language Model-Assisted Data Extraction in Systematic Reviews: A Case Study of Automated Comparative Performance EvaluationSemantic proximity Read

An AI-Human Collaborative Review of AI-Human Collaborative ReviewsSemantic proximity Read

Human-AI Collaboration to Identify Literature for Evidence SynthesisSemantic proximity Read

Nested Human-in-the-Loop AI: A Chain of Code Prompting Framework for Research Tool Development with GenAISemantic proximity Read

Artificial Intelligence in Systematic Reviews: Overcoming Reproducibility, Bias and Validation ChallengesSemantic proximity Read

A Hybrid Retrieval-Augmented Generation and Language Model Framework for Evidence-Grounded Review SystemsSemantic proximity Read

Assessing the feasibility and acceptability of a bespoke large language model pipeline to extract data from different study designs for public health evidence reviewsSemantic proximity Read

Artificial Intelligence’s Contribution to Biomedical Literature Search: Revolutionizing or Complicating?Semantic proximity Read

Revisiting the Role of Review Articles in the Age of AI- Agents: Integrating AI-Reasoning and AI- Synthesis Reshaping the Future of Scientific PublishingSemantic proximity Read

GeneKnow: An auditable AI framework for source-grounded biological evidence synthesisSemantic proximity Read