Article

Enformer: An encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records

2023-06-15

Abstract excerpt

Deep learning transformer-based models using longitudinal electronic health records (EHRs) have shown a great success in prediction of clinical diseases or outcomes. Pretraining on a large dataset can help such models map the input space better and boost their performance on relevant tasks through finetuning with limited data. In this study, we present Enformer, a generative encoder-decoder model with transformer...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: ffbdca9f-056c-5a87-bbbb-224a88d8cff6
DOI: 10.21203/rs.3.rs-2922823/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Enformer: An encoder-decoder generative model to enhance prediction of disease outcomes using electronic health recordsDOI 10.21203/rs.3.rs-2922823/v1Read

ExCaPT: Explainable Cancer Prediction with Transformer-based modelsSemantic proximity Read

Learning the natural history of human disease with generative transformersSemantic proximity Read

SurvivEHR: a competing risks, time-to-event foundation model for multiple long-term conditions from primary care electronic health recordsSemantic proximity Read

Large Language Models forecast Patient Health Trajectories enabling Digital TwinsSemantic proximity Read

Disease Risk Prediction Using Structured EHR Data: Can Generalist Large Language Models Match Specialized Clinical Foundation Models? A Comparative Evaluation with Fine-TuningSemantic proximity Read

Deep Representation Learning for Risk Prediction in Electronic Health Records Using Self-Supervised MethodsSemantic proximity Read

Predicting Behavioral Determinants of Health from Clinical Text Using Transformer Models and BiLSTMSemantic proximity Read

Leveraging GPT-4 for Identifying Cancer Phenotypes in Electronic Health Records: A Performance Comparison between GPT-4, GPT-3.5-turbo, Flan-T5 and spaCy’s Rule-based & Machine Learning-based methodsSemantic proximity Read

Large-scale identification of social and behavioral determinants of health from clinical notes: Comparison of Latent Semantic Indexing and Generative Pretrained Transformer (GPT) modelsSemantic proximity Read

Causal Transformer for Learning Embeddings from Structured Medical History Records and Multi-Source Data Integration for Complex Disease Risk Prediction.Semantic proximity Read

Integrating Polygenic Risk Improves Generative Forecasting of Disease Trajectories.Semantic proximity Read

PANCDetect: Early Detection of Pancreatic Cancer from Multimodal EHR data with LLM EmbeddingsSemantic proximity Read