Article

Encoding of pretrained large language models mirrors the genetic architectures of human psychological traits

2025-03-27

Abstract excerpt

Recent advances in large language models (LLMs) have prompted a frenzy in utilizing them as universal translators for biomedical terms. However, the black box nature of LLMs has forced researchers to rely on artificially designed benchmarks without understanding what exactly LLMs encode. We demonstrate that pretrained LLMs can already explain up to 51% of the genetic correlation between items from a psychometrical...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 86c29c4d-8d20-5e4f-a262-900455ef613a
DOI: 10.1101/2025.03.27.25324744

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Encoding of pretrained large language models mirrors the genetic architectures of human psychological traitsDOI 10.1101/2025.03.27.25324744Read

Large Language Models for Psychiatric Phenotype Extraction from Electronic Health RecordsSemantic proximity Read

Large language models improve transferability of electronic health record-based predictions across countries and coding systemsSemantic proximity Read

The empirical structure of psychopathology is represented in large language modelsSemantic proximity Read

Language or Syndrome? Investigating the Origins of the General Psychopathology Factor through Large Language Model EmbeddingsSemantic proximity Read

Using language models and ontology topology to perform semantic mapping of traits between biomedical datasets.Semantic proximity Read

Mental Health Benchmarks for Large Language Models: A Systematic Scoping ReviewSemantic proximity Read

Using a Fine-tuned Large Language Model for Symptom-based Depression EvaluationSemantic proximity Read

Integrating questionnaire measures for transdiagnostic psychiatric phenotyping using word2vec.Semantic proximity Read

Evaluating large language models for predicting psychiatric acute readmissions from clinical notes of population-based EHRSemantic proximity Read

Evaluating Large Language Models for Assessment of Psychosis RiskSemantic proximity Read

BioGPT-ClinVar: Parameter-Efficient Fine-Tuning of a Biomedical LLM for Genomic Variant InterpretationSemantic proximity Read

Disentangling Symptom Heterogeneity in Large-Scale Psychiatric Text: Domain-Adapted vs. Instruction-Tuned TransformersSemantic proximity Read