Article

Reliability of LLM-based Citation Sentiment Analysis under Structural Pressure: A Holistic Pressure Index Approach for Scientometric Inference

2026-05-05

Abstract excerpt

<title>Abstract</title> <p>The evaluation of Large Language Models (LLMs) in sentiment analysis tasks primarily relies on standard accuracy metrics, which do not account for how demanding the conditions are under which a prediction is generated. This study introduces the Holistic Pressure Index (HPI) as a measure for quantifying the structural and semantic pressure exerted on models during Citation Sentiment Anal...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: a852e9e5-0850-55e8-8391-7a5125ec5a4a
DOI: 10.21203/rs.3.rs-9462261/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Reliability of LLM-based Citation Sentiment Analysis under Structural Pressure: A Holistic Pressure Index Approach for Scientometric InferenceDOI 10.21203/rs.3.rs-9462261/v1Read

A Multi-Model, Multi-Domain Benchmark of Large Language Model Agreement with Humans and with Each Other in Sentiment ClassificationSemantic proximity Read

How Well Do Large Language Models Agree with Humans — and Each Other? A Multi-Model, Multi-Domain Sentiment Benchmark StudySemantic proximity Read

What Makes Science Newsworthy? Predicting and Interpreting Media Coverage of Scientific Papers with Large Language ModelsSemantic proximity Read

Uncertainty-Aware Assessment of LLM-Enhanced Topic Models: An Experton-Based Approach to InterpretabilitySemantic proximity Read

Dissecting the persuasiveness of AI writing in climate change articles: Emotion frames, perceived message qualities, and linguistic traitsSemantic proximity Read

LLM Aspect Prediction: Reviewing Academic Papers from Different Aspects with Large Language ModelSemantic proximity Read

Validity of Large Language Models for Sentiment Analysis: Evidence of performance comparable to human codersSemantic proximity Read

Contrasting Linguistic Patterns in Human and LLM-Generated News TextSemantic proximity Read

WITHDRAWN: Alignment-Induced Flattening in Large Language Models: A 33-Item Reading Comprehension Measure of Atypical Perspective-Taking Across Five Model FamiliesSemantic proximity Read

CCF Database: A Machine-Learning-Annotated Corpus of 266,271 Canadian Climate Articles (1978–2024)Semantic proximity Read

Beyond Keywords: Leveraging Generative LLMs and Label Aggregation to Classify Economic Policy Uncertainty in News ArticlesSemantic proximity Read

Evaluating information-theoretic measures of word prediction in naturalistic sentence readingSemantic proximity Read