Article

RLHF-Aligned Open LLMs: A Comparative Survey

2025-06-30

Abstract excerpt

We survey recent open-weight large language models (LLMs) fine-tuned via Reinforcement Learning from Human Feedback (RLHF) and related AI-assisted methods, focusing on LLaMA 2 (7B/13B chat variants), LLaMA 3 (8B, 70B), Mistral 7B, Mixtral 8×7B (Sparse-MoE), Falcon 7B-Instruct, OpenAssistant-based models, Alpaca 7B, and Zephyr 7B. Closed models (GPT-4, Claude 3) are included for reference. For each model, we descri...

Topics

Open a Topic to create a Post that cites this publication.

COVID-19 diagnosis using AI

Identifiers and source

Literature Corpus work: 54d9b434-8bdd-5e8f-af8e-d40ba5545837
DOI: 10.20944/preprints202506.2381.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

RLHF-Aligned Open LLMs: A Comparative SurveyDOI 10.20944/preprints202506.2381.v1Read

Approximated Variational Bayesian Inverse Reinforcement Learning for Large Language Model AlignmentSemantic proximity Read

Basics of Large Language Models - transformers to LLMsSemantic proximity Read

Conversations From Make-Believe: An Attentive Encoder–Decoder Chatbot Trained on Scripted DialogueSemantic proximity Read

ChatGPT vs. Bard: A Comparative StudySemantic proximity Read

Adaptive Contextual Preference Alignment for Large Language ModelsSemantic proximity Read

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models: A Case Study on ChatGPTSemantic proximity Read

Iterative improvements from feedback for language modelsSemantic proximity Read

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation SystemsSemantic proximity Read

KM-Chat: A Large-Scale Synthetic Question-Answer Dataset for Open-Domain Conversational AISemantic proximity Read

Reasoning in Large Language Models: From Chain-of-Thought to Massively Decomposed Agentic ProcessesSemantic proximity Read

Explainable Automatic Evaluation: Interpretable Decision-Making in Large Language Model AutoratersSemantic proximity Read

Boost Large Language Model Performance through Self-Training with Reward Guided Tree SearchSemantic proximity Read