Article

Enhancements to Large Language Models: Introducing Dynamic Syntactic Insertion for Improved Model Robustness and Generalization

2024-10-14

Abstract excerpt

The growing complexity and scale of modern deep learning models have improved the ability to generate and understand human language, yet challenges persist in achieving robust generalization and syntactic flexibility. Dynamic Syntactic Insertion (DSI) addresses these limitations through the novel introduction of random syntactic variations during the finetuning phase, enhancing the model's capacity to process dive...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: ffc009b6-c6b4-5266-9073-16257448a1f0
DOI: 10.22541/au.172893965.55552410/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Enhancements to Large Language Models: Introducing Dynamic Syntactic Insertion for Improved Model Robustness and GeneralizationDOI 10.22541/au.172893965.55552410/v1Read

Upscaling A Smaller LLM to More Parameters via Manual Regressive DistillationSemantic proximity Read

Engineering A Large Language Model From ScratchSemantic proximity Read

Dynamic Contextual Interpolation for More Efficient Model Generalization in Large Language ModelsSemantic proximity Read

Unified Efficient Fine-Tuning Techniques for Open-Source Large Language ModelsSemantic proximity Read

Optimizing Large Language Model Scaling with Micro Batch Pipeline and Inference ParallelismSemantic proximity Read

SuperGLUE: The AI raceSemantic proximity Read

Semantic Calibration of Contextual Embedding in Large Language Model Generative Pathways Using Contextual-Distillation MechanismsSemantic proximity Read

BLM-Hum1800: A Human-Validated Benchmark for Linguistic Competence in English and FrenchSemantic proximity Read

A Comparative Survey of Large Language Models: Foundation, Instruction-Tuned, and Multimodal VariantsSemantic proximity Read

Dynamic Probabilistic Contextual Realignment in Transformer-Based Large Language Models for Semantic ConsistencySemantic proximity Read

Semantic Contextual Embedding for Domain-Specific Task Transfer in Large Language ModelsSemantic proximity Read

Large Language Models Robustness Against PerturbationSemantic proximity Read