When Transformer models are more compositional than humans: The case of the depth charge illusion

Abstract excerpt

<p>State-of-the-art Transformer-based language models like GPT-3 are very good at generating syntactically well-formed and semantically plausible text. However, it is unclear to what extent these models encode the compositional rules of human language and to what extent their impressive performance is due to the use of relatively shallow heuristics, which have also been argued to be a factor in human language proc...

Topics

Open a Topic to create a Post that cites this publication.

• COVID-19 diagnosis using AI

Identifiers and source

Literature Corpus work

c090e5e2-2445-5b4d-abec-ed145506f4f9

DOI

10.31234/osf.io/gx4q5