On the public citation graph
Efficient MPI‐AllReduce for large‐scale deep learning on GPU‐clusters
0 signed · 41 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1002/cpe.1206openalex-snapshot
Collective communication: theory, practice, and experience
inferredcites →https://doi.org/10.1007/978-3-319-72971-8_1openalex-snapshot
Evaluating On-Node GPU Interconnects for Deep Learning Workloads
inferredcites →https://doi.org/10.1007/s11263-015-0816-yopenalex-snapshot
ImageNet Large Scale Visual Recognition Challenge
inferredcites →https://doi.org/10.1016/j.jpdc.2008.09.002openalex-snapshot
Bandwidth optimal all-reduce algorithms for clusters of workstations
inferredcites →https://doi.org/10.1109/candarw.2018.00048openalex-snapshot
Hierarchical Distributed-Memory Multi-Leader MPI-Allreduce for Deep Learning Workloads
inferredcites →https://doi.org/10.1109/cluster.2015.21openalex-snapshot
Exploiting GPUDirect RDMA in Designing High Performance OpenSHMEM for NVIDIA GPU Clusters
inferredcites →https://doi.org/10.1109/cluster.2018.00014openalex-snapshot
SALaR: Scalable and Adaptive Designs for Large Message Reduction Collectives
inferredcites →https://doi.org/10.1109/comst.2015.2481183openalex-snapshot
Data Center Energy Consumption Modeling: A Survey
inferredcites →https://doi.org/10.1109/cvpr.2015.7298594openalex-snapshot
Going deeper with convolutions
inferredcites →https://doi.org/10.1109/cvpr.2016.90openalex-snapshot
Deep Residual Learning for Image Recognition
inferredcites →https://doi.org/10.1109/cvpr.2017.243openalex-snapshot
Densely Connected Convolutional Networks
inferredcites →https://doi.org/10.1109/ipdps.2007.370405openalex-snapshot
Bandwidth Efficient All-reduce Operation on Tree Topologies
inferredcites →https://doi.org/10.1109/sc.2014.34openalex-snapshot
Slim Fly: A Cost Effective Low-Diameter Network Topology
inferredcites →https://doi.org/10.1145/3065386openalex-snapshot
ImageNet classification with deep convolutional neural networks
inferredcites →https://doi.org/10.1145/3126908.3126912openalex-snapshot
Scaling deep learning on GPU and knights landing clusters
inferredcites →https://doi.org/10.1145/3126908.3126954openalex-snapshot
Scalable reduction collectives with data partitioning-based multi-leader design
inferredcites →https://doi.org/10.1177/1094342005051521openalex-snapshot
Optimization of Collective Communication Operations in MPICH
inferredcites →https://doi.org/10.21437/interspeech.2014-274openalex-snapshot
1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs
inferredcites →https://doi.org/10.21437/interspeech.2015-354openalex-snapshot
Scalable distributed DNN training using commodity GPU cloud computing
inferredcites →https://doi.org/10.48550/arxiv.1711.00489openalex-snapshot
Don't Decay the Learning Rate, Increase the Batch Size
inferredcites →https://doi.org/10.48550/arxiv.1811.06965openalex-snapshot
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1007/s11432-022-4201-7openalex-snapshot
FMCC-RT: a scalable and fine-grained all-reduce algorithm for large-scale SMP clusters
inferred← citeshttps://doi.org/10.1007/s11802-022-4839-zopenalex-snapshot
Parallel Extraction of Marine Targets Applying OIDA Architecture
inferred← citeshttps://doi.org/10.1016/j.comnet.2024.110453openalex-snapshot
PCNP: A RoCEv2 congestion control using precise CNP
inferred← citeshttps://doi.org/10.1016/j.future.2026.108498openalex-snapshot
Maximizing the computation-communication overlap for distributed deep learning with approximate AllReduce
inferred← citeshttps://doi.org/10.1016/j.jpdc.2023.104767openalex-snapshot
SUARA: A scalable universal allreduce communication algorithm for acceleration of parallel deep learning applications
inferred← citeshttps://doi.org/10.1109/acctcs66275.2025.00098openalex-snapshot
Research on Large Model Resource Optimization Strategy Through Distributed Management
inferred← citeshttps://doi.org/10.1109/bigdata52589.2021.9672073openalex-snapshot
Performance Optimization of Allreduce Operation for Multi-GPU Systems
inferred← citeshttps://doi.org/10.1109/icdcs57875.2023.00015openalex-snapshot
bbTopk: Bandwidth-Aware Sparse Allreduce with Blocked Sparsification for Efficient Distributed Training
inferred← citeshttps://doi.org/10.1109/isca66397.2026.00152openalex-snapshot
PipeComm: Maximizing Link Utilization Through Pipeline-Aware Collective Communication Synthesis
inferred← citeshttps://doi.org/10.1109/scw63240.2024.00129openalex-snapshot
Modeling and Simulation of Collective Algorithms on HPC Network Topologies using Structural Simulation Toolkit
inferred← citeshttps://doi.org/10.1145/3549939openalex-snapshot
Robust Searching-Based Gradient Collaborative Management in Intelligent Transportation System
inferred← citeshttps://doi.org/10.1145/3613424.3614278openalex-snapshot
Si-Kintsugi: Towards Recovering Golden-Like Performance of Defective Many-Core Spatial Architectures for AI
inferred← citeshttps://doi.org/10.1145/3620666.3651379openalex-snapshot
Centauri: Enabling Efficient Scheduling for Communication-Computation Overlap in Large Model Training via Communication Partitioning
inferred← citeshttps://doi.org/10.1145/3689031.3696088openalex-snapshot
FlowCheck: Decoupling Checkpointing and Training of Large-Scale Models
inferred← citeshttps://doi.org/10.1145/3748273.3749209openalex-snapshot
T3P: Topology-Tailored Tensor Parallelism
inferred← citeshttps://doi.org/10.23919/isc.2026.11520482openalex-snapshot
Design and Implementation of Multi-Rail-Aware Hierarchical MPI Reduce-Scatter and Allgather Operations
inferred← citeshttps://doi.org/10.3390/app15116251openalex-snapshot
Low-Scalability Distributed Systems for Artificial Intelligence: A Comparative Study of Distributed Deep Learning Frameworks for Image Classification
inferred← citeshttps://doi.org/10.7160/aol.2023.150105openalex-snapshot
Developing an Efficient System with Mask R-CNN for Agricultural Applications
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.