Article

HydraMPP: A lightweight library for distributed massive parallel processing in Python - threading at scale

2026-06-08

Abstract excerpt

We now exist in the era of massive datasets from genomics, large language models, and all the known knowledge of humanity right at our fingertips. Much of this data is becoming more accessible; however, processing such data remains an ongoing issue across systems including high performance computing (HPC) infrastructures. Massively parallel computing (MPP) has solved this using a divide and conquer approach by spl...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e20058ae-908c-5759-85fb-568551b4132d
DOI: 10.64898/2026.06.04.730204

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

HydraMPP: A lightweight library for distributed massive parallel processing in Python - threading at scaleDOI 10.64898/2026.06.04.730204Read

BigMPI4py: Python module for parallelization of Big Data objectsSemantic proximity Read

MaRe: Processing Big Data with application containers on Apache Spark.Semantic proximity Read

Benchmarking undedicated cloud computing providers for analysis of genomic datasetsSemantic proximity Read

BioHackEU22 Report for Project 16: Make your own or favourite software available on your cluster with EasyBuild/EESSISemantic proximity Read

HP2NET: Empowering Efficient Phylogenetic Network Analysis through High-Performance ComputingSemantic proximity Read

Organizing and running bioinformatics hackathons within Africa: The H3ABioNet cloud computing experienceSemantic proximity Read

Benchmarking undedicated cloud computing providers for analysis of genomic datasets.Semantic proximity Read

Cloudgene: a graphical execution platform for MapReduce programs on private and public clouds.Semantic proximity Read

Subduing the hepatitis E Python.Semantic proximity Read

SLOW5: a new file format enables massive acceleration of nanopore sequencing data analysisSemantic proximity Read

A high productivity/low maintenance approach to high-performance computation for biomedicine: four case studies.Semantic proximity Read

Design considerations for workflow management systems use in production genomics research and the clinicSemantic proximity Read