Article

From Pre-Trained Language Models to Agentic AI: Evolution and Architectures for Autonomous Intelligence

2025-07-22

Abstract excerpt

In this position paper, we present a comprehensive analysis of the evolution of artificial intelligence from pre-trained language models to agentic AI systems designed for autonomous intelligence. This evolution is structured across seven technical stages, beginning with the transformer architecture and Mixture of Experts (MoE), and extending through instruction fine-tuning, reinforcement learning from human feedb...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 29a848fe-a620-5123-a0b4-1c32bb781c40
DOI: 10.20944/preprints202507.1809.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

From Pre-Trained Language Models to Agentic AI: Evolution and Architectures for Autonomous IntelligenceDOI 10.20944/preprints202507.1809.v1Read

Beyond Words: The Evolution of Large Language Models in Context-AwareSemantic proximity Read

Reasoning in Large Language Models: From Chain-of-Thought to Massively Decomposed Agentic ProcessesSemantic proximity Read

Basics of Large Language Models - transformers to LLMsSemantic proximity Read

Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science PerformanceSemantic proximity Read

Autonomous Scientific Discovery Through Hierarchical AI Scientist SystemsSemantic proximity Read

Transformation of Large Language Models: A State of ArtSemantic proximity Read

SORT-AI: A Structural Safety and Reliability Framework for Advanced AI Systems with Retrieval-Augmented Generation as a Diagnostic TestbedSemantic proximity Read

Cognitive Architectures for Tomorrow: A Comprehensive Survey of Memory Management Paradigms in Agentic AI SystemsSemantic proximity Read

A Process-Centric Survey of AI for Scientific Discovery Through the EXHYTE FrameworkSemantic proximity Read

Toward a reusable architecture for intelligent agentsSemantic proximity Read

Reverse Prompting: A Memory-Efficient Paradigm for LLM Agents Through Structural RegenerationSemantic proximity Read

Execution Grounded Multiagent Systems for Reliable Backend Code Generation with Large Language Models'Semantic proximity Read