Article

Towards Trustworthy and Effective AI for Academic Policy Navigation: Human Evaluation of a Source-Aware, Domain-Optimized RAG-Based Chatbot

2025-09-05

Abstract excerpt

<title>Abstract</title> <p>Navigating institutional policies remains a challenge for students and staff due to complex legalistic language, hierarchical structures, and dispersed documentation. While Large Language Models (LLMs) such as GPT-4o offer fluent natural language capabilities, their susceptibility to hallucination limits their perceived trustworthiness in academic contexts where factual accuracy and tra...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 502fb8bd-a64e-5e2b-88f1-a0518b2a9817
DOI: 10.21203/rs.3.rs-7535973/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Towards Trustworthy and Effective AI for Academic Policy Navigation: Human Evaluation of a Source-Aware, Domain-Optimized RAG-Based ChatbotDOI 10.21203/rs.3.rs-7535973/v1Read

Beyond Text Generation: Assessing Large Language Models' Ability to Follow Rules and Reason LogicallySemantic proximity Read

ChatGPT's Expanding Horizons and Transformative Impact Across Domains: A Critical Review of Capabilities, Challenges, and Future DirectionsSemantic proximity Read

Progress, Challenges, Threats and Prospects of ChatGPT in Science and Education: How Will AI Impact the Academic Environment?Semantic proximity Read

Private Local Large Language Model for Generating Context-Aware Responses About the Regulations of Book Four of the Civil Code of Catalonia and the Notary Profession of SpainSemantic proximity Read

Chatting with Pythons: using ChatGPT and Python computer code to screen abstracts for systematic literature reviews in complex disciplinesSemantic proximity Read

AI Usage Cards: Responsibly Reporting AI-generated ContentSemantic proximity Read

Comparative Analysis of AI-Generated Research Content: Evaluating ChatGPT and Google GeminiSemantic proximity Read

AI Content Self-Detection for Transformer-based large Language ModelsSemantic proximity Read

Collectively Negotiating Trust and Mistrust in Generative AI: Evidence from Reddit Discussions of ChatGPT and ClaudeSemantic proximity Read

Passing the Turing Test: Fine-tuned AI feedback is less detectable than human or prompt-engineered feedbackSemantic proximity Read

A Framework for Ethical AI-Generated Content GovernanceSemantic proximity Read