Discover Community Create You

Loading publication...

Noodle always counts identifier-free feature events for service operation. With your permission, Google Analytics can also estimate audience and engagement. Search text, publication identifiers, cookies, IP addresses and browser fingerprints are never included in Noodle's first-party event counters.

Privacy details

Article

MaRe: Processing Big Data with application containers on Apache Spark.

GigaScience - 1 May 2020

Capuccini Marco, Dahlö Martin, Toor Salman, Spjuth Ola

Abstract excerpt

BACKGROUND: Life science is increasingly driven by Big Data analytics, and the MapReduce programming model has been proven successful for data-intensive analyses. However, current MapReduce frameworks offer poor support for reusing existing processing tools in bioinformatics pipelines. Furthermore, these frameworks do not have native support for application containers, which are becoming popular in scientific...

Read the complete abstract on PubMed

Topics

Share this publication in a Topic to start or enrich a Post.

Share to Databases, Factual
Share to Algorithms
Share to Computational Biology

Methodology Data sources Editorial policy Privacy About Contact Helena Bioinformatics

Share to Polymorphism, Single Nucleotide

Share to Software

Share to Workflow

Source

Open in PubMed Open full text

Identifiers

PMID: 32369166
DOI: 10.1093/gigascience/giaa042
PMCID: PMC7199472

Provenance

PubMed metadata and Literature Corpus relationships. Corpus snapshot updated 6 Sept 2026. Manifest publication-graph-cohort-2026-09-06.1.

Source receipt: pubmed, retrieved 6 Sept 2026.

Related research

Semantic proximity does not establish scientific evidence.

Research trail→

Click a neighbor to travelStep 1 · 12 closest

MaRe: Processing Big Data with application containers on Apache Spark.PMID 32369166Read ↗

Cloudgene: a graphical execution platform for MapReduce programs on private and public clouds.Semantic proximity Read ↗

HydraMPP: A lightweight library for distributed massive parallel processing in Python - threading at scaleSemantic proximity Read ↗

Benchmarking undedicated cloud computing providers for analysis of genomic datasetsSemantic proximity Read ↗

BigMPI4py: Python module for parallelization of Big Data objectsSemantic proximity Read ↗

Design considerations for workflow management systems use in production genomics research and the clinicSemantic proximity Read ↗

Benchmarking undedicated cloud computing providers for analysis of genomic datasets.Semantic proximity Read ↗

The Dockstore: enabling modular, community-focused sharing of Docker-based genomics tools and workflowsSemantic proximity Read ↗

HP2NET: Empowering Efficient Phylogenetic Network Analysis through High-Performance ComputingSemantic proximity Read ↗

Organizing and running bioinformatics hackathons within Africa: The H3ABioNet cloud computing experienceSemantic proximity Read ↗

DIVE: a data intensive visualization engine.Semantic proximity Read ↗

Real time scalable data acquisition of COVID-19 in six continents through PySpark - a big data toolSemantic proximity Read ↗

QUARTIC: QUick pArallel algoRithms for high-Throughput sequencIng data proCessingSemantic proximity Read ↗

⌁Select a neighboring publication to make it the new centre.