Article

Beyond Text Generation: Assessing Large Language Models' Ability to Follow Rules and Reason Logically

2024-10-09

Abstract excerpt

<title>Abstract</title> <p>The growing interest in advanced large language models (LLMs) has sparked debate about how best to use them to enhance human productivities, including teaching and learning outcomes. However, a neglected issue in the debate concerning the applications of LLMs is whether these chatbots can follow strict rules and use reason to solve problems in novel contexts. To address this knowledge g...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: fc2a542b-e0de-5d25-96cf-a3851b635ca4
DOI: 10.21203/rs.3.rs-5084169/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Beyond Text Generation: Assessing Large Language Models' Ability to Follow Rules and Reason LogicallyDOI 10.21203/rs.3.rs-5084169/v1Read

A Categorical Archive of ChatGPT FailuresSemantic proximity Read

Private Local Large Language Model for Generating Context-Aware Responses About the Regulations of Book Four of the Civil Code of Catalonia and the Notary Profession of SpainSemantic proximity Read

Towards Trustworthy and Effective AI for Academic Policy Navigation: Human Evaluation of a Source-Aware, Domain-Optimized RAG-Based ChatbotSemantic proximity Read

ChatGPT vs. Bard: A Comparative StudySemantic proximity Read

ChatGPT's Expanding Horizons and Transformative Impact Across Domains: A Critical Review of Capabilities, Challenges, and Future DirectionsSemantic proximity Read

LLMs4All: A Review of Large Language Models Across Academic DisciplinesSemantic proximity Read

Nonlinear Transformation of Probabilities by Large Language ModelsSemantic proximity Read

Out-of-the-box bioinformatics capabilities of large language models (LLMs)Semantic proximity Read

Benchmarking of Commercial Large Language Models: ChatGPT, Mistral, and LlamaSemantic proximity Read

Evaluating Logical Reasoning Ability of Large Language ModelsSemantic proximity Read

AI Language Model Rivals Expert Ethicist in Perceived Moral ExpertiseSemantic proximity Read

AI Language Model Rivals Expert Ethicist in Perceived Moral ExpertiseSemantic proximity Read