Article

Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based Workflow

2026-05-22

Abstract excerpt

<p>Large Language Models (LLMs) are increasingly used as research tools to facilitate the fast and automated extraction of text features. In psychological studies, they have been used to quantify the degree to which verbal stimulus materials reflect certain psychological constructs. However, the application of LLMs entails a high degree of flexibility regarding prompt design (e.g., instruction details and examples...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0006e92b-94bb-51a1-a155-10038cc3c357
DOI: 10.31234/osf.io/xphm9_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based WorkflowDOI 10.31234/osf.io/xphm9_v1Read

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersSemantic proximity Read

Integrating large language models into the psychological sciencesSemantic proximity Read

Perils and Opportunities in Using Large Language Models in Psychological ResearchSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read

One and a Half Year of ChatGPT: An Umbrella Review of Large Language Model (LLM) Perception Across Time and Research FieldsSemantic proximity Read

Using LLMs for Pre-Annotation of Emotional Manipulation Techniques in a Low-Resource Language Corpus: Are We There Yet?Semantic proximity Read

First the Rules, Then the Summary: Piloting a Design for Accurate LLM-Generated Clinical SummariesSemantic proximity Read

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Evaluating Large Language Models for Psychometric Simulation Studies in R: Integrating Best Practices in Simulation and Prompt DesignSemantic proximity Read

HumanELY: Human evaluation of LLM yield, using a novel web-based evaluation toolSemantic proximity Read