Article

Boosting Domain Knowledge Understanding of LLMs through Fine-Tuning with a Novel KNN Algorithm

2024-06-11

Abstract excerpt

<title>Abstract</title> <p>Transformer-based architectures have revolutionized natural language processing, demonstrating exceptional capabilities in generating and understanding human-like text. Despite these advancements, challenges persist in enabling models to effectively interpret and generate domain-specific knowledge with high accuracy. The novel integration of a k-nearest neighbour (KNN) algorithm with th...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: d8c8426f-6dd3-5d15-8f8f-9e330f2f4c9c
DOI: 10.21203/rs.3.rs-4552165/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Boosting Domain Knowledge Understanding of LLMs through Fine-Tuning with a Novel KNN AlgorithmDOI 10.21203/rs.3.rs-4552165/v1Read

Knowledge Accuracy and Reducing Hallucinations in LLMs via Dynamic Domain Knowledge InjectionSemantic proximity Read

Semantic Contextual Embedding for Domain-Specific Task Transfer in Large Language ModelsSemantic proximity Read

Larger models yield better results? Streamlined severity classification of ADHD-related concerns using BERT-based knowledge distillationSemantic proximity Read

Mitigate Large Language Model Hallucinations with Probabilistic Inference in Graph Neural NetworksSemantic proximity Read

Upscaling A Smaller LLM to More Parameters via Manual Regressive DistillationSemantic proximity Read

GatorTron: A Large Language Model for Clinical Natural Language ProcessingSemantic proximity Read

Multi-Step Transfer Learning in Natural Language Processing in the Health DomainSemantic proximity Read

Enhancing LLM Accuracy and Reducing Hallucinations using Query Refinement Technique and Knowledge GraphsSemantic proximity Read

Toward Safer Mining: MS-GLM for Coal Mine Safety via Domain-Adaptive Pretraining and Multi-Task Instruction TuningSemantic proximity Read

TurkishMedLLM: A Source-Grounded and Safety-Aware Turkish Medical LLM for Clinical Decision Support and Digital Health ApplicationsSemantic proximity Read

Private Local Large Language Model for Generating Context-Aware Responses About the Regulations of Book Four of the Civil Code of Catalonia and the Notary Profession of SpainSemantic proximity Read

Beyond Words: The Evolution of Large Language Models in Context-AwareSemantic proximity Read