Back to search

Article

Moving beyond word frequency based on tally counting: AI-generated familiarity estimates of words and phrases are a better index of language knowledge

2024-08-28

Abstract excerpt

<p>This study investigates the potential of large language models (LLMs) to estimate familiarity of words and multi-word expressions (MWEs). We validated LLM estimates for isolated words using existing human familiarity ratings and found strong correlations. LLM familiarity estimates were found to perform even better in predicting lexical decisions and naming performance in megastudies than the best available word...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work
dddc6b87-8a61-5e83-ae88-1cc4d2eef03c
DOI
10.31234/osf.io/w94x3
Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest
Interactive article relationship graphSelect a related publication card to move it into the centre and load its closest explainable connections. Solid lines are source-backed structured connections. Dashed lines are semantic discovery signals and are not scientific evidence.
Moving beyond word frequency based on tally counting: AI-generated familiarity estimates of words and phrases are a better index of language knowledgeDOI 10.31234/osf.io/w94x3
Moving beyond word frequency based on tally counting: AI-generated familiarity estimates of words and phrases are a better index of language knowledgeSemantic proximity
AI-generated estimates of Dutch words and expressionsSemantic proximity
Word Familiarity Norms as a Test Case: Toward Methodological Standards for Word Norming ResearchSemantic proximity
Emergent Mental Lexicon Functions in ChatGPTSemantic proximity
Core vocabulary reveals differences between human word prediction and large language modelsSemantic proximity
Miller's Monkey Updated: Communicative Efficiency and the Statistics of Words in Natural LanguageSemantic proximity
Core vocabulary reveals differences between human word prediction and large language modelsSemantic proximity
Crowdsourced and AI-generated Age of Acquisition (AoA) Norms for Vocabulary in Print: Extending the Kuperman et al. (2012) normsSemantic proximity
Crowdsourced and AI-generated Age of Acquisition (AoA) Norms for Vocabulary in Print: Extending the Kuperman et al. (2012) normsSemantic proximity
Meaning Beyond Lexicality: Capturing Pseudoword Definitions with Language ModelsSemantic proximity
AI-generated estimates of familiarity, concreteness, valence and arousal for over 100,000 Spanish wordsSemantic proximity
Can Large Language Models Help Augment English Psycholinguistic Datasets?Semantic proximity
Select a neighboring publication to make it the new centre.