On the public citation graph
Distributed Training of Deep Neural Networks: Theoretical and Practical Limits of Parallel Scalability
0 signed · 96 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1007/978-3-319-58943-5_64openalex-snapshot
Theano-MPI: A Theano-Based Distributed Training Framework
inferredcites →https://doi.org/10.1007/978-3-7908-2604-3_16openalex-snapshot
Large-Scale Machine Learning with Stochastic Gradient Descent
inferredcites →https://doi.org/10.1007/s11263-015-0816-yopenalex-snapshot
ImageNet Large Scale Visual Recognition Challenge
inferredcites →https://doi.org/10.1016/j.neunet.2014.09.003openalex-snapshot
Deep learning in neural networks: An overview
inferredcites →https://doi.org/10.1109/cvpr.2015.7298594openalex-snapshot
Going deeper with convolutions
inferredcites →https://doi.org/10.1109/cvpr.2016.284openalex-snapshot
FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters
inferredcites →https://doi.org/10.1109/icassp.2014.6853593openalex-snapshot
On parallelizability of stochastic gradient descent for speech DNNS
inferredcites →https://doi.org/10.1109/ipdps.2013.80openalex-snapshot
Communication-Optimal Parallel Recursive Rectangular Matrix Multiplication
inferredcites →https://doi.org/10.1145/3065386openalex-snapshot
ImageNet classification with deep convolutional neural networks
inferredcites →https://doi.org/10.1145/3097983.3098035openalex-snapshot
Scalable and Sustainable Deep Learning via Randomized Hashing
inferredcites →https://doi.org/10.48550/arxiv.1404.5997openalex-snapshot
One weird trick for parallelizing convolutional neural networks
inferredcites →https://doi.org/10.48550/arxiv.1408.5093openalex-snapshot
Caffe: Convolutional Architecture for Fast Feature Embedding
inferredcites →https://doi.org/10.48550/arxiv.1409.1556openalex-snapshot
Very Deep Convolutional Networks for Large-Scale Image Recognition
inferredcites →https://doi.org/10.48550/arxiv.1502.02551openalex-snapshot
Deep Learning with Limited Numerical Precision
inferredcites →https://doi.org/10.48550/arxiv.1602.07360openalex-snapshot
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
inferredcites →https://doi.org/10.48550/arxiv.1603.04467openalex-snapshot
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
inferredcites →https://doi.org/10.48550/arxiv.1609.04836openalex-snapshot
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1002/spe.2894openalex-snapshot
Towards efficient federated learning‐based scheme in medical cyber‐physical systems for distributed data
inferred← citeshttps://doi.org/10.1007/978-3-030-14880-5_1openalex-snapshot
Sparsity in Deep Neural Networks - An Empirical Investigation with TensorQuant
inferred← citeshttps://doi.org/10.1007/978-3-030-16205-4_1openalex-snapshot
Parallel and Distributed Processing for Unsupervised Patient Phenotype Representation
inferred← citeshttps://doi.org/10.1007/978-3-030-22871-2_62openalex-snapshot
Improving Usability of Distributed Neural Network Training
inferred← citeshttps://doi.org/10.1007/978-3-030-70873-3_31openalex-snapshot
How to Extend Single-Processor Approach to Explicitly Many-Processor Approach
inferred← citeshttps://doi.org/10.1007/978-3-030-70873-3_33openalex-snapshot
Introducing Temporal Behavior to Computing Science
inferred← citeshttps://doi.org/10.1007/978-3-031-59212-6_89openalex-snapshot
Fire Risk Assessment Methods
inferred← citeshttps://doi.org/10.1007/978-3-319-92040-5_19openalex-snapshot
Distributed Deep Reinforcement Learning: Learn How to Play Atari Games in 21 minutes
inferred← citeshttps://doi.org/10.1007/978-981-15-0372-6_5openalex-snapshot
Training Data on Recursive Parallel Processors for Deep Learning
inferred← citeshttps://doi.org/10.1007/978-981-15-1899-7_9openalex-snapshot
A Novel Distributed Duration-Aware LSTM for Large Scale Sequential Data Analysis
inferred← citeshttps://doi.org/10.1007/s00521-021-06456-yopenalex-snapshot
Which scaling rule applies to large artificial neural networks
inferred← citeshttps://doi.org/10.1007/s00521-024-09870-0openalex-snapshot
Batch data recovery from gradients based on generative adversarial networks
inferred← citeshttps://doi.org/10.1007/s10441-022-09450-6openalex-snapshot
On the Role of Speed in Technological and Biological Information Transfer for Computations
inferred← citeshttps://doi.org/10.1007/s11227-019-02999-zopenalex-snapshot
Artificial bee colony-based fuzzy c means (ABC-FCM) segmentation algorithm and dimensionality reduction for leaf disease detection in bioinformatics
inferred← citeshttps://doi.org/10.1007/s11277-021-08699-3openalex-snapshot
Recommender System for Optimal Distributed Deep Learning in Cloud Datacenters
inferred← citeshttps://doi.org/10.1021/acs.chemrestox.2c00375openalex-snapshot
A Review on the Recent Applications of Deep Learning in Predictive Drug Toxicological Studies
inferred← citeshttps://doi.org/10.1080/08839514.2018.1508814openalex-snapshot
Distributed Learning of CNNs on Heterogeneous CPU/GPU Architectures
inferred← citeshttps://doi.org/10.1109/access.2021.3070012openalex-snapshot
Accelerating Distributed SGD With Group Hybrid Parallelism
inferred← citeshttps://doi.org/10.1109/access.2024.3386405openalex-snapshot
BBO-CFAT: Network Intrusion Detection Model Based on BBO Algorithm and Hierarchical Transformer
inferred← citeshttps://doi.org/10.1109/allerton.2018.8635903openalex-snapshot
Anytime Stochastic Gradient Descent: A Time to Hear from all the Workers
inferred← citeshttps://doi.org/10.1109/bigcomp.2018.00136openalex-snapshot
An Adaptive Batch-Orchestration Algorithm for the Heterogeneous GPU Cluster Environment in Distributed Deep Learning System
inferred← citeshttps://doi.org/10.1109/bigdata.2018.8621888openalex-snapshot
Distributed Learning of Deep Sparse Neural Networks for High-dimensional Classification
inferred← citeshttps://doi.org/10.1109/bigdata.2018.8621896openalex-snapshot
Performance Implications of Big Data in Scalable Deep Learning: On the Importance of Bandwidth and Caching
inferred← citeshttps://doi.org/10.1109/csci51800.2020.00120openalex-snapshot
Do we know the operating principles of our computers better than those of our brain?
inferred← citeshttps://doi.org/10.1109/csci58124.2022.00036openalex-snapshot
Component-Wise Natural Gradient Descent on Deep Neural Networks
inferred← citeshttps://doi.org/10.1109/globalsip.2018.8646456openalex-snapshot
DELAYED WEIGHT UPDATE FOR FASTER CONVERGENCE IN DATA-PARALLEL DEEP LEARNING
inferred← citeshttps://doi.org/10.1109/globecom52923.2024.10901004openalex-snapshot
Distributed Functional Compression for Independent Component Analysis in Wireless Networks
inferred← citeshttps://doi.org/10.1109/hoti52880.2021.00015openalex-snapshot
In-network reductions on multi-dimensional HyperX
inferred← citeshttps://doi.org/10.1109/hpca68181.2026.11408444openalex-snapshot
Compression-Aware Gradient Splitting for Collective Communications in Distributed Training
inferred← citeshttps://doi.org/10.1109/hpcc/smartcity/dss.2018.00036openalex-snapshot
On the Performance of Parallel Processing in Dynamic Resource Sharing Systems
inferred← citeshttps://doi.org/10.1109/icalip.2018.8455587openalex-snapshot
The Speed Improvement by Merging Batch Normalization into Previously Linear Layer in CNN
inferred← citeshttps://doi.org/10.1109/icde.2017.160openalex-snapshot
Modeling Scalability of Distributed Machine Learning
inferred← citeshttps://doi.org/10.1109/icip.2017.8296670openalex-snapshot
Training sample selection for deep learning of distributed data
inferred← citeshttps://doi.org/10.1109/icip.2019.8803513openalex-snapshot
Learning Geographically Distributed Data for Multiple Tasks Using Generative Adversarial Networks
inferred← citeshttps://doi.org/10.1109/icmla.2017.0-166openalex-snapshot
Anytime Exploitation of Stragglers in Synchronous Stochastic Gradient Descent
inferred← citeshttps://doi.org/10.1109/icoin59985.2024.10572141openalex-snapshot
BalanceNet Orchestrator: A KQV-based Dynamic Task Allocation for Distributed Deep Learning
inferred← citeshttps://doi.org/10.1109/icpads47876.2019.00068openalex-snapshot
A Framework for Distributed Deep Neural Network Training with Heterogeneous Computing Platforms
inferred← citeshttps://doi.org/10.1109/icrito48877.2020.9197981openalex-snapshot
Application-based Attention Mechanisms in Deep Learning
inferred← citeshttps://doi.org/10.1109/ies67184.2025.11161827openalex-snapshot
Groundwater Quality Prediction Using Deep Neural Networks with Principal Component Analysis Based Feature Reduction and K-Fold Cross Validation
inferred← citeshttps://doi.org/10.1109/ipdps53621.2022.00042openalex-snapshot
Multi-Phase Task-Based HPC Applications: Quickly Learning how to Run Fast
inferred← citeshttps://doi.org/10.1109/mlhpc.2018.8638639openalex-snapshot
Aluminum: An Asynchronous, GPU-Aware Communication Library Optimized for Large-Scale Training of Deep Neural Networks on HPC Systems
inferred← citeshttps://doi.org/10.1109/mlsp.2017.8168127openalex-snapshot
A layer-block-wise pipeline for memory and bandwidth reduction in distributed deep learning
inferred← citeshttps://doi.org/10.1109/smartworld.2018.00101openalex-snapshot
APRNN: A New Active Propagation Training Algorithm for Distributed RNN
inferred← citeshttps://doi.org/10.1109/smc.2018.00282openalex-snapshot
Extended Extreme Learning Machine: A Novel Framework for Neural Network
inferred← citeshttps://doi.org/10.1109/socc46988.2019.1570554761openalex-snapshot
Energy-Aware Workload Allocation for Distributed Deep Neural Networks in Edge-Cloud Continuum
inferred← citeshttps://doi.org/10.1109/tai.2023.3246032openalex-snapshot
Scaling the Inference of Digital Pathology Deep Learning Models Using CPU-Based High-Performance Computing
inferred← citeshttps://doi.org/10.1109/tits.2017.2750070openalex-snapshot
Generic Proposal Evaluator: A Lazy Learning Strategy Toward Blind Proposal Quality Assessment
inferred← citeshttps://doi.org/10.1109/tnnls.2020.3017434openalex-snapshot
Distributed Min–Max Learning Scheme for Neural Networks With Applications to High-Dimensional Classification
inferred← citeshttps://doi.org/10.1109/tnse.2023.3294406openalex-snapshot
faaShark: an End-to-End Network Traffic Analysis System atop Serverless Computing
inferred← citeshttps://doi.org/10.1145/3150224openalex-snapshot
HPC Cloud for Scientific and Business Applications
inferred← citeshttps://doi.org/10.1145/3295500.3356207openalex-snapshot
Channel and filter parallelism for large-scale CNN training
inferred← citeshttps://doi.org/10.1145/3452296.3472904openalex-snapshot
Efficient sparse collective communication and its application to accelerate distributed deep learning
inferred← citeshttps://doi.org/10.1145/3472456.3472467openalex-snapshot
Prophet: Speeding up Distributed DNN Training with Predictable Communication Scheduling
inferred← citeshttps://doi.org/10.1145/3545008.3545011openalex-snapshot
EmbRace: Accelerating Sparse Communication for Distributed Training of Deep Neural Networks
inferred← citeshttps://doi.org/10.1145/3558481.3591073openalex-snapshot
In-network Allreduce with Multiple Spanning Trees on PolarFly
inferred← citeshttps://doi.org/10.1177/20552076241256732openalex-snapshot
Enhancing health care through medical cognitive virtual agents
inferred← citeshttps://doi.org/10.1186/s40537-021-00556-1openalex-snapshot
Accelerating neural network training with distributed asynchronous and selective optimization (DASO)
inferred← citeshttps://doi.org/10.20944/preprints202103.0414.v1openalex-snapshot
On the Role of Information Transfer’s Speed in Technological and Biological Computations
inferred← citeshttps://doi.org/10.21203/rs.3.rs-88297/v1openalex-snapshot
On the Spatiotemporal Behavior in Biology-Mimicking Computing Systems
inferred← citeshttps://doi.org/10.21203/rs.3.rs-88297/v2openalex-snapshot
On the Spatiotemporal Behavior in Biology-Mimicking Computing Systems
inferred← citeshttps://doi.org/10.23919/jcn.2022.000028openalex-snapshot
Synchronizing tasks for distributed learning in connected and autonomous vehicles
inferred← citeshttps://doi.org/10.30574/wjaets.2023.8.1.0017openalex-snapshot
Optimizing data movement for AI workloads: A multilayer network engineering approach
inferred← citeshttps://doi.org/10.3233/jifs-171329openalex-snapshot
Single binding of data and model parallelisms to parallelize convolutional neural networks through multiple machines
inferred← citeshttps://doi.org/10.3390/a19010006openalex-snapshot
Algorithm for Describing Neuronal Electric Operation
inferred← citeshttps://doi.org/10.3390/app15115805openalex-snapshot
On Implementing Technomorph Biology for Inefficient Computing
inferred← citeshttps://doi.org/10.3390/electronics11040539openalex-snapshot
A Parallel Deep Reinforcement Learning Framework for Controlling Industrial Assembly Lines
inferred← citeshttps://doi.org/10.3390/informatics8040071openalex-snapshot
Revising the Classic Computing Paradigm and Its Technological Implementations
inferred← citeshttps://doi.org/10.3390/is4si-2017-04025openalex-snapshot
Cognitive Computing Architectures for Machine (Deep) Learning at Scale
inferred← citeshttps://doi.org/10.3390/mi16050587openalex-snapshot
CMOS Low-Power Optical Transceiver for Short Reach
inferred← citeshttps://doi.org/10.54364/aaiml.2021.1109openalex-snapshot
Why Learning and Machine Learning Are Different
inferred← citeshttps://doi.org/10.5821/dissertation-2117-351667openalex-snapshot
Convergence of deep learning and high performance computing: challenges and solutions
inferred← citeshttps://doi.org/10.5821/dissertation-2117-403149openalex-snapshot
Scaling deep learning workloads. Applications in computer vision and seismology
inferred← citeshttps://doi.org/10.70675/233d5251z3b9ez4709z8c5az5b8f70f675f3openalex-snapshot
Strategies for Distributing Task-Based Applications on Heterogeneous Platforms
inferred← citeshttps://doi.org/10.70675/9a7a509ez8d8cz4ba1z8712z1d826d59c975openalex-snapshot
Apprentissage automatique de caractéristiques audio : application à la génération de listes de lecture thématiques
inferred← citeshttps://doi.org/10.70675/a4e729dbzce3dz4be6zbb16z2bd8f87f3f78openalex-snapshot
Deep learning for seismic data processing and interpretation
inferred← citeshttps://doi.org/10.70675/c9683e60z640az42a7zaf83ze2c47909d110openalex-snapshot
Green artificial intelligence to automate medical diagnosis with low energy consumption
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.