On the public citation graph

High-Performance Design of YARN MapReduce on Modern HPC Clusters with Lustre and RDMA

0 signed · 61 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/978-3-319-09873-9_54openalex-snapshot
MapReduce over Lustre: Can RDMA-Based Approach Benefit?
inferredcites →https://doi.org/10.1007/978-3-540-72586-2_111openalex-snapshot
Middleware in Modern High Performance Computing System Architectures
inferredcites →https://doi.org/10.1109/grid.2011.31openalex-snapshot
Using the Gfarm File System as a POSIX Compatible Storage Platform for Hadoop MapReduce Applications
inferredcites →https://doi.org/10.1109/hoti.2014.15openalex-snapshot
Accelerating Spark with RDMA for Big Data Processing: Early Experiences
inferredcites →https://doi.org/10.1109/icpp.2013.78openalex-snapshot
High-Performance Design of Hadoop RPC with RDMA over InfiniBand
inferredcites →https://doi.org/10.1109/ipdps.2012.74openalex-snapshot
High-Performance Design of HBase with RDMA over InfiniBand
inferredcites →https://doi.org/10.1109/ipdpsw.2013.238openalex-snapshot
High-Performance RDMA-based Design of Hadoop MapReduce over InfiniBand
inferredcites →https://doi.org/10.1109/msst.2010.5496972openalex-snapshot
The Hadoop Distributed File System
inferredcites →https://doi.org/10.1109/sc.2012.65openalex-snapshot
High performance RDMA-based design of HDFS over InfiniBand
inferredcites →https://doi.org/10.1145/2063384.2063461openalex-snapshot
Hadoop acceleration through network levitated merge
inferredcites →https://doi.org/10.1145/2063384.2063474openalex-snapshot
On the duality of data-intensive file system design
inferredcites →https://doi.org/10.1145/2523616.2523633openalex-snapshot
Apache Hadoop YARN
inferredcites →https://doi.org/10.1145/2597652.2597684openalex-snapshot
HOMR
inferredcites →https://doi.org/10.1145/2600212.2600715openalex-snapshot
SOR-HDFS
inferredcites →https://doi.org/10.21276/ijre.2018.5.5.4openalex-snapshot
MapReduce: Simplified Data Processing on Large Cluster
inferredcites →https://doi.org/10.5555/2388996.2389044openalex-snapshot
High performance RDMA-based design of HDFS over InfiniBand
inferredcites →https://doi.org/10.5555/2591272.2591287openalex-snapshot
MixApart: decoupled analytics for shared storage systems
inferredcites →https://doi.org/10.7551/mitpress/1556.001.0001openalex-snapshot
Beowulf Cluster Computing with Linux

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1007/978-3-031-04888-3_2openalex-snapshot
OpenFAM: A Library for Programming Disaggregated Memory
inferred← citeshttps://doi.org/10.1007/978-3-319-61845-6_46openalex-snapshot
An IDL-Based Parallel Model for Scientific Computations on Multi-core Computers
inferred← citeshttps://doi.org/10.1007/978-3-319-69953-0_6openalex-snapshot
Experiences of Converging Big Data Analytics Frameworks with High Performance Computing Systems
inferred← citeshttps://doi.org/10.1007/978-981-10-6442-5_52openalex-snapshot
Customized Filesystem with Dynamic Stripe Strategies on Lustre-Based Hadoop
inferred← citeshttps://doi.org/10.1007/978-981-97-4727-6_27openalex-snapshot
Performance Assessment of the Map Reduce Framework with HDFS for High Availability and Fault Tolerance
inferred← citeshttps://doi.org/10.1007/978-981-99-7161-9_4openalex-snapshot
A Survey of RoCEv2 Congestion Control
inferred← citeshttps://doi.org/10.1007/s10586-019-02960-yopenalex-snapshot
Approaches of enhancing interoperations among high performance computing and big data analytics via augmentation
inferred← citeshttps://doi.org/10.1007/s11227-016-1760-5openalex-snapshot
Characterizing and benchmarking stand-alone Hadoop MapReduce on modern HPC clusters
inferred← citeshttps://doi.org/10.1007/s11227-020-03162-9openalex-snapshot
Designing a MapReduce performance model in distributed heterogeneous platforms based on benchmarking approach
inferred← citeshttps://doi.org/10.1007/s11390-020-9799-4openalex-snapshot
Design and Implementation of the Tianhe-2 Data Storage and Management System
inferred← citeshttps://doi.org/10.1007/s11390-020-9801-1openalex-snapshot
Ad Hoc File Systems for High-Performance Computing
inferred← citeshttps://doi.org/10.1016/j.ins.2019.06.048openalex-snapshot
RDMA-driven MongoDB: An approach of RDMA enhanced NoSQL paradigm for large-Scale data processing
inferred← citeshttps://doi.org/10.1016/j.jpdc.2017.11.004openalex-snapshot
MR-Advisor: A comprehensive tuning, profiling, and prediction tool for MapReduce execution frameworks on HPC clusters
inferred← citeshttps://doi.org/10.1109/access.2017.2725318openalex-snapshot
Storage-Tag-Aware Scheduler for Hadoop Cluster
inferred← citeshttps://doi.org/10.1109/access.2019.2949836openalex-snapshot
Toward High-Performance Computing and Big Data Analytics Convergence: The Case of Spark-DIY
inferred← citeshttps://doi.org/10.1109/bdcat.2018.00010openalex-snapshot
Spark-DIY: A Framework for Interoperable Spark Operations with High Performance Block-Based Data Models
inferred← citeshttps://doi.org/10.1109/bigdata.2015.7363761openalex-snapshot
Performance characterization and acceleration of in-memory file systems for Hadoop and Spark applications on HPC clusters
inferred← citeshttps://doi.org/10.1109/bigdata.2016.7840608openalex-snapshot
Efficient data access strategies for Hadoop and Spark on HPC cluster with heterogeneous storage
inferred← citeshttps://doi.org/10.1109/bigdata.2016.7840835openalex-snapshot
On-demand data analytics in HPC environments at leadership computing facilities: Challenges and experiences
inferred← citeshttps://doi.org/10.1109/bigdata.2017.8257944openalex-snapshot
Big data and HPC collocation: Using HPC idle resources for Big Data analytics
inferred← citeshttps://doi.org/10.1109/bigdata.2017.8257947openalex-snapshot
NVMD: Non-volatile memory assisted design for accelerating MapReduce and DAG execution frameworks on HPC systems
inferred← citeshttps://doi.org/10.1109/ccgrid.2015.161openalex-snapshot
Triple-H: A Hybrid Approach to Accelerate HDFS on HPC Clusters with Heterogeneous Storage Architecture
inferred← citeshttps://doi.org/10.1109/comst.2021.3094993openalex-snapshot
Big Data Resource Management & Networks: Taxonomy, Survey, and Future Directions
inferred← citeshttps://doi.org/10.1109/dasc-picom-datacom-cyberscitec.2017.160openalex-snapshot
Availability Modeling and Assurance of Map-Reduce Computing
inferred← citeshttps://doi.org/10.1109/hoti.2017.24openalex-snapshot
Characterizing Deep Learning over Big Data (DLoBD) Stacks on RDMA-Capable Networks
inferred← citeshttps://doi.org/10.1109/hpcc/smartcity/dss.2019.00069openalex-snapshot
Pream: Enhancing HPC Storage System Performance with Pre-Allocated Metadata Management Mechanism
inferred← citeshttps://doi.org/10.1109/icpp.2015.79openalex-snapshot
Accelerating I/O Performance of Big Data Analytics on HPC Clusters through RDMA-Based Key-Value Store
inferred← citeshttps://doi.org/10.1109/ipdps.2017.31openalex-snapshot
Mimir: Memory-Efficient and Scalable MapReduce for Large Supercomputing Systems
inferred← citeshttps://doi.org/10.1109/pdsw-discs.2016.008openalex-snapshot
Can Non-volatile Memory Benefit MapReduce Applications on HPC Clusters?
inferred← citeshttps://doi.org/10.1109/sbac-pad.2016.33openalex-snapshot
MR-Advisor: A Comprehensive Tuning Tool for Advising HPC Users to Accelerate MapReduce Applications on Supercomputers
inferred← citeshttps://doi.org/10.1109/tmscs.2018.2845886openalex-snapshot
DLoBD: A Comprehensive Study of Deep Learning over Big Data Stacks on HPC Clusters
inferred← citeshttps://doi.org/10.1109/tpds.2016.2591947openalex-snapshot
A Comprehensive Study of MapReduce Over Lustre for Intermediate Data Placement and Shuffle Strategies on HPC Clusters
inferred← citeshttps://doi.org/10.1109/tpds.2018.2889718openalex-snapshot
RF-RPC: Remote Fetching RPC Paradigm for RDMA-Enabled Network
inferred← citeshttps://doi.org/10.1109/tpds.2021.3092266openalex-snapshot
PostMan: Rapidly Mitigating Bursty Traffic via On-Demand Offloading of Packet Processing
inferred← citeshttps://doi.org/10.1109/tsc.2019.2948009openalex-snapshot
BoR: Toward High-Performance Permissioned Blockchain in RDMA-Enabled Network
inferred← citeshttps://doi.org/10.1145/2694730.2694733openalex-snapshot
Accelerating Big Data Processing on Modern Clusters
inferred← citeshttps://doi.org/10.1145/2926534.2926538openalex-snapshot
On exploring efficient shuffle design for in-memory MapReduce
inferred← citeshttps://doi.org/10.1145/2949550.2949561openalex-snapshot
Experiences and Benefits of Running RDMA Hadoop and Spark on SDSC Comet
inferred← citeshttps://doi.org/10.1145/3064176.3064189openalex-snapshot
RFP
inferred← citeshttps://doi.org/10.1145/3458817.3476144openalex-snapshot
Pinpointing crash-consistency bugs in the HPC I/O stack
inferred← citeshttps://doi.org/10.22430/24223182.169openalex-snapshot
Big Data: desarrollo, avance y aplicación en las Organizaciones de la era de la Información
inferred← citeshttps://doi.org/10.48550/arxiv.1512.07805openalex-snapshot
RFP: A Remote Fetching Paradigm for RDMA-Accelerated Systems
inferred← citeshttps://doi.org/10.55730/1300-0632.3866openalex-snapshot
Lightweight distributed computing framework for orchestrating high performance computing and big data
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.