Article

Validity of Large Language Models for Sentiment Analysis: Evidence of performance comparable to human coders

2023-12-28

Abstract excerpt

<p>Assessing the sentiment of content is a major focus of communication science. Previous research has compared the performance of ‘gold-standard’ methods – exemplified by trained human coders – with approaches such as crowd-sourcing, data dictionaries, and machine learning. Aggregated crowd-sourced assessments and trained human coders perform best, but trained coders may not be scalable and crowd-sourcing may rai...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 484d7c52-4277-553f-8631-54a010ca0494
DOI: 10.31234/osf.io/kcuwy

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Validity of Large Language Models for Sentiment Analysis: Evidence of performance comparable to human codersDOI 10.31234/osf.io/kcuwyRead

A Multi-Model, Multi-Domain Benchmark of Large Language Model Agreement with Humans and with Each Other in Sentiment ClassificationSemantic proximity Read

How Well Do Large Language Models Agree with Humans — and Each Other? A Multi-Model, Multi-Domain Sentiment Benchmark StudySemantic proximity Read

Contrasting Linguistic Patterns in Human and LLM-Generated News TextSemantic proximity Read

Advancing Sentiment Analysis in Gujarati: Performance Enhancement through a Hybrid Annotation FrameworkSemantic proximity Read

Balancing AI and Human Judgment for Text Refinement: A Step Toward Intercultural Competence in Language ProcessingSemantic proximity Read

Detecting AI Generated Content in Short Form TextSemantic proximity Read

Discerning Human and AI-Generated Content in Short- Form TextSemantic proximity Read

Using LLMs for Pre-Annotation of Emotional Manipulation Techniques in a Low-Resource Language Corpus: Are We There Yet?Semantic proximity Read

Enhancing Text Quality with Human-Machine Collaboration: A Refinement ApproachSemantic proximity Read

The Extended Moral Foundations Dictionary (eMFD): Development and Applications of a Crowd-Sourced Approach to Extracting Moral Intuitions from TextSemantic proximity Read

Linguistic Markers of Inherently False AI Communication and Intentionally False Human Communication: Evidence from Hotel ReviewsSemantic proximity Read

Benchmarking of Commercial Large Language Models: ChatGPT, Mistral, and LlamaSemantic proximity Read