Article

Boost Large Language Model Performance through Self-Training with Reward Guided Tree Search

2024-07-16

Abstract excerpt

Large language models have changed the field of natural language processing by enabling sophisticated language generation tasks, yet there remains a persistent challenge in enhancing their performance through autonomous learning. Introducing Process Reward Guided Tree Search to the GPT-Neo architecture offers a novel and significant advancement by enabling the model to self-train and optimize its performance witho...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 98669e1a-e900-595f-a8a0-e905f6f9e9d7
DOI: 10.22541/au.172116715.57325819/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Boost Large Language Model Performance through Self-Training with Reward Guided Tree SearchDOI 10.22541/au.172116715.57325819/v1Read

Upscaling A Smaller LLM to More Parameters via Manual Regressive DistillationSemantic proximity Read

Large Language Models Robustness Against PerturbationSemantic proximity Read

Foresight Is Not Enough: Sentence-Level Future Signals, Self-Loop Hard Negatives, and the Calibration Gap in Small Language ModelsSemantic proximity Read

Optimizing Large Language Model Scaling with Micro Batch Pipeline and Inference ParallelismSemantic proximity Read

Enhancing Contextual Understanding in Large Language Models with Dynamic Dependency Structures: A Methodological ApproachSemantic proximity Read

Unified Efficient Fine-Tuning Techniques for Open-Source Large Language ModelsSemantic proximity Read

SuperGLUE: The AI raceSemantic proximity Read

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models: A Case Study on ChatGPTSemantic proximity Read

Dynamic Probabilistic Contextual Realignment in Transformer-Based Large Language Models for Semantic ConsistencySemantic proximity Read

RLHF-Aligned Open LLMs: A Comparative SurveySemantic proximity Read

Optimizing Human-Controlled Preference Alignment in Large Language Models via Dense Token Masking: A Methodological ApproachSemantic proximity Read

Parameter-Efficient Fine-Tuning in Large Models: A Survey of MethodologiesSemantic proximity Read