On the public citation graph

On Efficient Training of Large-Scale Deep Learning Models

0 signed · 240 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/978-3-030-10925-7_24openalex-snapshot
Efficient Decentralized Deep Learning by Dynamic Model Averaging
inferredcites →https://doi.org/10.1007/978-3-031-19809-0_26openalex-snapshot
TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers
inferredcites →https://doi.org/10.1007/978-3-031-25056-9_43openalex-snapshot
SimpleTrack: Understanding and Rethinking 3D Multi-object Tracking
inferredcites →https://doi.org/10.1007/s11431-020-1647-3openalex-snapshot
Pre-trained models for natural language processing: A survey
inferredcites →https://doi.org/10.1007/s13042-024-02443-6openalex-snapshot
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
inferredcites →https://doi.org/10.1016/0010-0277(93)90058-4openalex-snapshot
Learning and development in neural networks: the importance of starting small
inferredcites →https://doi.org/10.1016/j.acha.2025.101795openalex-snapshot
Minibatch and local SGD: Algorithmic stability and linear speedup in generalization
inferredcites →https://doi.org/10.1016/j.aiopen.2021.08.002openalex-snapshot
Pre-trained models: Past, present and future
inferredcites →https://doi.org/10.1016/j.aiopen.2022.10.001openalex-snapshot
A survey of transformers
inferredcites →https://doi.org/10.1016/j.jksuci.2021.11.017openalex-snapshot
A survey on textual entailment based question answering
inferredcites →https://doi.org/10.1038/35016072openalex-snapshot
Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit
inferredcites →https://doi.org/10.1038/s41583-020-0277-3openalex-snapshot
Backpropagation and the brain
inferredcites →https://doi.org/10.1080/10556788.2021.1977806openalex-snapshot
Quasi-Newton methods for machine learning: forget the past, just sample
inferredcites →https://doi.org/10.1080/10618600.2023.2204130openalex-snapshot
Statistical Analysis of Fixed Mini-Batch Gradient Descent Estimator
inferredcites →https://doi.org/10.1109/cloud55607.2022.00068openalex-snapshot
A Data-Loader Tunable Knob to Shorten GPU Idleness for Distributed Deep Learning
inferredcites →https://doi.org/10.1109/cvpr.2016.515openalex-snapshot
Gradual DropIn of Layers to Train Very Deep Neural Networks
inferredcites →https://doi.org/10.1109/cvpr.2016.90openalex-snapshot
Deep Residual Learning for Image Recognition
inferredcites →https://doi.org/10.1109/cvpr.2019.00065openalex-snapshot
Bag of Tricks for Image Classification with Convolutional Neural Networks
inferredcites →https://doi.org/10.1109/cvpr.2019.00881openalex-snapshot
HAQ: Hardware-Aware Automated Quantization With Mixed Precision
inferredcites →https://doi.org/10.1109/cvpr42600.2020.00162openalex-snapshot
ReSprop: Reuse Sparsified Backpropagation
inferredcites →https://doi.org/10.1109/cvpr46437.2021.01358openalex-snapshot
SuperMix: Supervising the Mixing Data Augmentation
inferredcites →https://doi.org/10.1109/cvpr46437.2021.01462openalex-snapshot
StyleMix: Separating Content and Style for Enhanced Data Augmentation
inferredcites →https://doi.org/10.1109/cvpr52688.2022.00135openalex-snapshot
Masked-attention Mask Transformer for Universal Image Segmentation
inferredcites →https://doi.org/10.1109/cvpr52688.2022.01182openalex-snapshot
TransMix: Attend to Mix for Vision Transformers
inferredcites →https://doi.org/10.1109/cvpr52688.2022.01216openalex-snapshot
Automated Progressive Learning for Efficient Training of Vision Transformers
inferredcites →https://doi.org/10.1109/cvpr52688.2022.01553openalex-snapshot
Masked Autoencoders Are Scalable Vision Learners
inferredcites →https://doi.org/10.1109/cvpr52729.2023.01156openalex-snapshot
FFCV: Accelerating Training by Removing Data Bottlenecks
inferredcites →https://doi.org/10.1109/cvprw50498.2020.00359openalex-snapshot
Randaugment: Practical automated data augmentation with a reduced search space
inferredcites →https://doi.org/10.1109/iccv.2019.00612openalex-snapshot
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
inferredcites →https://doi.org/10.1109/iccv51070.2023.00507openalex-snapshot
Efficiently Robustify Pre-Trained Models
inferredcites →https://doi.org/10.1109/iccv51070.2023.00538openalex-snapshot
EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones
inferredcites →https://doi.org/10.1109/ipdps54959.2023.00031openalex-snapshot
An Efficient 2D Method for Training Super-Large Deep Learning Models
inferredcites →https://doi.org/10.1109/ipdpsw55747.2022.00223openalex-snapshot
A Scalable Pipeline for Gigapixel Whole Slide Imaging Analysis on Leadership Class HPC Systems
inferredcites →https://doi.org/10.1109/jssc.2022.3141050openalex-snapshot
BitBlade: Energy-Efficient Variable Bit-Precision Hardware Accelerator for Quantized Neural Networks
inferredcites →https://doi.org/10.1109/sc41405.2020.00024openalex-snapshot
ZeRO: Memory optimizations Toward Training Trillion Parameter Models
inferredcites →https://doi.org/10.1109/tcsi.2020.2964748openalex-snapshot
Fast 2D Convolution Algorithms for Convolutional Neural Networks
inferredcites →https://doi.org/10.1109/tnnls.2022.3230914openalex-snapshot
Signal Propagation: The Framework for Learning and Inference in a Forward Pass
inferredcites →https://doi.org/10.1109/tnnls.2025.3628666openalex-snapshot
Deep Model Fusion: A Survey
inferredcites →https://doi.org/10.1109/tpami.2024.3423382openalex-snapshot
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
inferredcites →https://doi.org/10.1109/tpds.2021.3065737openalex-snapshot
Efficient Data Loader for Fast Sampling-Based GNN Training on Large Graphs
inferredcites →https://doi.org/10.1109/wacv.2017.58openalex-snapshot
Cyclical Learning Rates for Training Neural Networks
inferredcites →https://doi.org/10.1109/wacv56688.2023.00561openalex-snapshot
Accelerating Self-Supervised Learning via Efficient Training Strategies
inferredcites →https://doi.org/10.1117/12.2520589openalex-snapshot
Super-convergence: very fast training of neural networks using large learning rates
inferredcites →https://doi.org/10.1137/1019005openalex-snapshot
Quasi-Newton Methods, Motivation and Theory
inferredcites →https://doi.org/10.1137/15m1007173openalex-snapshot
Butterfly Factorization
inferredcites →https://doi.org/10.1145/1553374.1553380openalex-snapshot
Curriculum learning
inferredcites →https://doi.org/10.1145/3065386openalex-snapshot
ImageNet classification with deep convolutional neural networks
inferredcites →https://doi.org/10.1145/3225058.3225069openalex-snapshot
ImageNet Training in Minutes
inferredcites →https://doi.org/10.1145/3341301.3359646openalex-snapshot
PipeDream
inferredcites →https://doi.org/10.1145/3394486.3406703openalex-snapshot
DeepSpeed
inferredcites →https://doi.org/10.1145/3458817.3476205openalex-snapshot
ZeRO-infinity
inferredcites →https://doi.org/10.1145/3458817.3476209openalex-snapshot
Efficient large-scale language model training on GPU clusters using megatron-LM
inferredcites →https://doi.org/10.1145/3530811openalex-snapshot
Efficient Transformers: A Survey
inferredcites →https://doi.org/10.1145/3560260openalex-snapshot
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension
inferredcites →https://doi.org/10.1145/3605573.3605613openalex-snapshot
Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
inferredcites →https://doi.org/10.11871/jfdc.issn.2096.742x.2019.01.011openalex-snapshot
PaddlePaddle: An Open-Source Deep Learning Platform from Industrial Practice
inferredcites →https://doi.org/10.1201/9781003214892openalex-snapshot
Artificial Intelligence
inferredcites →https://doi.org/10.1609/aaai.v34i07.7000openalex-snapshot
Random Erasing Data Augmentation
inferredcites →https://doi.org/10.1609/aaai.v36i3.20181openalex-snapshot
Cross-Domain Collaborative Normalization via Structural Knowledge
inferredcites →https://doi.org/10.1609/aaai.v38i14.29477openalex-snapshot
Towards Stability and Generalization Bounds in Decentralized Minibatch Stochastic Gradient Descent
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.447openalex-snapshot
Sequence-Level Mixed Sample Data Augmentation
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.72openalex-snapshot
Shallow-to-Deep Training for Neural Machine Translation
inferredcites →https://doi.org/10.18653/v1/2021.acl-long.427openalex-snapshot
Shortformer: Better Language Modeling using Shorter Inputs
inferredcites →https://doi.org/10.18653/v1/2021.emnlp-main.831openalex-snapshot
How to Train BERT with an Academic Budget
inferredcites →https://doi.org/10.18653/v1/2021.findings-acl.247openalex-snapshot
Progressive Multi-Granularity Training for Non-Autoregressive Translation
inferredcites →https://doi.org/10.18653/v1/2021.findings-acl.84openalex-snapshot
A Survey of Data Augmentation Approaches for NLP
inferredcites →https://doi.org/10.18653/v1/2021.naacl-main.406openalex-snapshot
On the Transformer Growth for Progressive BERT Training
inferredcites →https://doi.org/10.18653/v1/2022.bigscience-1.9openalex-snapshot
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
inferredcites →https://doi.org/10.18653/v1/d15-1306openalex-snapshot
That's So Annoying!!!: A Lexical and Frame-Semantic Embedding Based Data Augmentation Approach to Automatic Categorization of Annoying Behaviors using #petpeeve Tweets
inferredcites →https://doi.org/10.18653/v1/d19-1670openalex-snapshot
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
inferredcites →https://doi.org/10.21437/interspeech.2014-274openalex-snapshot
1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs
inferredcites →https://doi.org/10.24963/ijcai.2023/764openalex-snapshot
A Survey on Efficient Training of Transformers
inferredcites →https://doi.org/10.31219/osf.io/uz8cvopenalex-snapshot
A Review of Neuroscience-Inspired Machine Learning
inferredcites →https://doi.org/10.3390/a11100159openalex-snapshot
A Faster Algorithm for Reducing the Computational Complexity of Convolutional Neural Networks
inferredcites →https://doi.org/10.3390/electronics11060945openalex-snapshot
A Survey on Efficient Convolutional Neural Networks and Hardware Acceleration
inferredcites →https://doi.org/10.3390/electronics11142183openalex-snapshot
Adversarial Attack and Defense Strategies of Speaker Recognition Systems: A Survey
inferredcites →https://doi.org/10.3390/info13070337openalex-snapshot
Sequential Normalization: Embracing Smaller Sample Sizes for Normalization
inferredcites →https://doi.org/10.4230/lipics.cp.2025.31openalex-snapshot
HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case
inferredcites →https://doi.org/10.4230/lipics.itcs.2018.22openalex-snapshot
Convergence Results for Neural Networks via Electrodynamics
inferredcites →https://doi.org/10.4230/lipics.itp.2023.19openalex-snapshot
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
inferredcites →https://doi.org/10.48550/arxiv.1212.5701openalex-snapshot
ADADELTA: An Adaptive Learning Rate Method
inferredcites →https://doi.org/10.48550/arxiv.1312.6120openalex-snapshot
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
inferredcites →https://doi.org/10.48550/arxiv.1412.6980openalex-snapshot
Adam: A Method for Stochastic Optimization
inferredcites →https://doi.org/10.48550/arxiv.1509.01626openalex-snapshot
Character-level Convolutional Networks for Text Classification
inferredcites →https://doi.org/10.48550/arxiv.1511.06067openalex-snapshot
Convolutional neural networks with low-rank regularization
inferredcites →https://doi.org/10.48550/arxiv.1606.08415openalex-snapshot
Gaussian Error Linear Units (GELUs)
inferredcites →https://doi.org/10.48550/arxiv.1608.03983openalex-snapshot
SGDR: Stochastic Gradient Descent with Warm Restarts
inferredcites →https://doi.org/10.48550/arxiv.1704.08863openalex-snapshot
On weight initialization in deep neural networks
inferredcites →https://doi.org/10.48550/arxiv.1705.08741openalex-snapshot
Train longer, generalize better: closing the generalization gap in large batch training of neural networks
inferredcites →https://doi.org/10.48550/arxiv.1706.00043openalex-snapshot
Biased Importance Sampling for Deep Neural Network Training
inferredcites →https://doi.org/10.48550/arxiv.1706.07270openalex-snapshot
Nonlinear Acceleration of Stochastic Algorithms
inferredcites →https://doi.org/10.48550/arxiv.1708.03888openalex-snapshot
Large Batch Training of Convolutional Networks
inferredcites →https://doi.org/10.48550/arxiv.1708.04552openalex-snapshot
Improved Regularization of Convolutional Neural Networks with Cutout
inferredcites →https://doi.org/10.48550/arxiv.1710.09412openalex-snapshot
mixup: Beyond Empirical Risk Minimization
inferredcites →https://doi.org/10.48550/arxiv.1710.09967openalex-snapshot
Improving Deep Learning by Inverse Square Root Linear Units (ISRLUs)
inferredcites →https://doi.org/10.48550/arxiv.1710.10196openalex-snapshot
Progressive Growing of GANs for Improved Quality, Stability, and Variation
inferredcites →https://doi.org/10.48550/arxiv.1711.00489openalex-snapshot
Don't Decay the Learning Rate, Increase the Batch Size
inferredcites →https://doi.org/10.48550/arxiv.1711.05101openalex-snapshot
Decoupled Weight Decay Regularization
inferredcites →https://doi.org/10.48550/arxiv.1802.05799openalex-snapshot
Horovod: fast and easy distributed deep learning in TensorFlow
inferredcites →https://doi.org/10.48550/arxiv.1803.03635openalex-snapshot
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
inferredcites →https://doi.org/10.48550/arxiv.1803.05407openalex-snapshot
Averaging Weights Leads to Wider Optima and Better Generalization
inferredcites →https://doi.org/10.48550/arxiv.1805.09501openalex-snapshot
AutoAugment: Learning Augmentation Policies from Data
inferredcites →https://doi.org/10.48550/arxiv.1808.03357openalex-snapshot
Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning
inferredcites →https://doi.org/10.48550/arxiv.1808.07217openalex-snapshot
Don't Use Large Mini-Batches, Use Local SGD
inferredcites →https://doi.org/10.48550/arxiv.1812.06162openalex-snapshot
An Empirical Model of Large-Batch Training
inferredcites →https://doi.org/10.48550/arxiv.1901.11196openalex-snapshot
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
inferredcites →https://doi.org/10.48550/arxiv.1904.09223openalex-snapshot
ERNIE: Enhanced Representation through Knowledge Integration
inferredcites →https://doi.org/10.48550/arxiv.1905.03381openalex-snapshot
AutoAssist: A Framework to Accelerate Training of Deep Neural Networks
inferredcites →https://doi.org/10.48550/arxiv.1909.08053openalex-snapshot
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
inferredcites →https://doi.org/10.48550/arxiv.1910.00762openalex-snapshot
Accelerating Deep Learning by Focusing on the Biggest Losers
inferredcites →https://doi.org/10.48550/arxiv.1910.07467openalex-snapshot
Root Mean Square Layer Normalization
inferredcites →https://doi.org/10.48550/arxiv.1912.02781openalex-snapshot
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
inferredcites →https://doi.org/10.48550/arxiv.2001.08361openalex-snapshot
Scaling Laws for Neural Language Models
inferredcites →https://doi.org/10.48550/arxiv.2006.01791openalex-snapshot
SaliencyMix: A Saliency Guided Data Augmentation Strategy for Better Regularization
inferredcites →https://doi.org/10.48550/arxiv.2006.04768openalex-snapshot
Conv-Linformer: Boosting Linformer's Performance with Convolution in Small-Scale Settings
inferredcites →https://doi.org/10.48550/arxiv.2006.10738openalex-snapshot
Differentiable Augmentation for Data-Efficient GAN Training
inferredcites →https://doi.org/10.48550/arxiv.2010.01412openalex-snapshot
Sharpness-Aware Minimization for Efficiently Improving Generalization
inferredcites →https://doi.org/10.48550/arxiv.2101.06329openalex-snapshot
In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learning
inferredcites →https://doi.org/10.48550/arxiv.2102.03065openalex-snapshot
Co-Mixup: Saliency Guided Joint Mixup with Supermodular Diversity
inferredcites →https://doi.org/10.48550/arxiv.2103.00397openalex-snapshot
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective
inferredcites →https://doi.org/10.48550/arxiv.2103.01988openalex-snapshot
Self-supervised Pretraining of Visual Features in the Wild
inferredcites →https://doi.org/10.48550/arxiv.2105.14450openalex-snapshot
Maximizing Parallelism in Distributed Training for Huge Neural Networks
inferredcites →https://doi.org/10.48550/arxiv.2106.10270openalex-snapshot
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
inferredcites →https://doi.org/10.48550/arxiv.2107.03356openalex-snapshot
M-FAC: Efficient Matrix-Free Approximations of Second-Order Information
inferredcites →https://doi.org/10.48550/arxiv.2107.04197openalex-snapshot
REX: Revisiting Budgeted Training with an Improved Schedule
inferredcites →https://doi.org/10.48550/arxiv.2108.07258openalex-snapshot
On the Opportunities and Risks of Foundation Models
inferredcites →https://doi.org/10.48550/arxiv.2108.09084openalex-snapshot
Fastformer: Additive Attention Can Be All You Need
inferredcites →https://doi.org/10.48550/arxiv.2110.12661openalex-snapshot
ZerO Initialization: Initializing Neural Networks with only Zeros and Ones
inferredcites →https://doi.org/10.48550/arxiv.2111.00856openalex-snapshot
Large-Scale Deep Learning Optimizations: A Comprehensive Survey
inferredcites →https://doi.org/10.48550/arxiv.2112.05682openalex-snapshot
Self-attention Does Not Need $O(n^2)$ Memory
inferredcites →https://doi.org/10.48550/arxiv.2201.11990openalex-snapshot
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
inferredcites →https://doi.org/10.48550/arxiv.2202.06009openalex-snapshot
Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam
inferredcites →https://doi.org/10.48550/arxiv.2203.05705openalex-snapshot
DNN Training Acceleration via Exploring GPGPU Friendly Sparsity
inferredcites →https://doi.org/10.48550/arxiv.2205.09995openalex-snapshot
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
inferredcites →https://doi.org/10.48550/arxiv.2205.15242openalex-snapshot
Re-parameterizing Your Optimizers rather than Architectures
inferredcites →https://doi.org/10.48550/arxiv.2206.01288openalex-snapshot
Decentralized Training of Foundation Models in Heterogeneous Environments
inferredcites →https://doi.org/10.48550/arxiv.2206.07682openalex-snapshot
Emergent Abilities of Large Language Models
inferredcites →https://doi.org/10.48550/arxiv.2209.00099openalex-snapshot
Efficient Methods for Natural Language Processing: A Survey
inferredcites →https://doi.org/10.48550/arxiv.2210.04889openalex-snapshot
Turbo Training with Token Dropout
inferredcites →https://doi.org/10.48550/arxiv.2210.09461openalex-snapshot
Token Merging: Your ViT But Faster
inferredcites →https://doi.org/10.48550/arxiv.2210.12864openalex-snapshot
K-SAM: Sharpness-Aware Minimization at the Speed of SGD
inferredcites →https://doi.org/10.48550/arxiv.2210.15424openalex-snapshot
What Language Model to Train if You Have One Million GPU Hours?
inferredcites →https://doi.org/10.48550/arxiv.2211.00889openalex-snapshot
Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches
inferredcites →https://doi.org/10.48550/arxiv.2211.04908openalex-snapshot
Profiling and Improving the PyTorch Dataloader for high-latency Storage: A Technical Report
inferredcites →https://doi.org/10.48550/arxiv.2212.13345openalex-snapshot
The Forward-Forward Algorithm: Some Preliminary Investigations
inferredcites →https://doi.org/10.48550/arxiv.2212.14034openalex-snapshot
Cramming: Training a Language Model on a Single GPU in One Day
inferredcites →https://doi.org/10.48550/arxiv.2301.02966openalex-snapshot
SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chain
inferredcites →https://doi.org/10.48550/arxiv.2308.01320openalex-snapshot
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
inferredcites →https://doi.org/10.48550/arxiv.2308.07870openalex-snapshot
Brain-inspired Computational Intelligence via Predictive Coding
inferredcites →https://doi.org/10.48550/arxiv.2312.08010openalex-snapshot
EZ-CLIP: Efficient Zeroshot Video Action Recognition
inferredcites →https://doi.org/10.48550/arxiv.2401.12187openalex-snapshot
WARM: On the Benefits of Weight Averaged Reward Models
inferredcites →https://doi.org/10.52202/068431-1189openalex-snapshot
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
inferredcites →https://doi.org/10.52202/068431-2176openalex-snapshot
Training Compute-Optimal Large Language Models
inferredcites →https://doi.org/10.52202/075280-0542openalex-snapshot
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision
inferredcites →https://doi.org/10.52202/075280-1008openalex-snapshot
Prioritizing Samples in Reinforcement Learning with Reducible Loss
inferredcites →https://doi.org/10.52202/075280-1482openalex-snapshot
Data Selection for Language Models via Importance Resampling
inferredcites →https://doi.org/10.52202/075280-2140openalex-snapshot
Symbolic Discovery of Optimization Algorithms
inferredcites →https://doi.org/10.52202/075280-2308openalex-snapshot
Fine-Tuning Language Models with Just Forward Passes
inferredcites →https://doi.org/10.5281/zenodo.5879544openalex-snapshot
GPT-NeoX: Large Scale Autoregressive Language Modeling in PyTorch
inferredcites →https://doi.org/10.7551/mitpress/1120.001.0001openalex-snapshot
Advances in Neural Information Processing Systems 14
inferredcites →https://doi.org/10.7551/mitpress/7503.003.0024openalex-snapshot
Greedy Layer-Wise Training of Deep Networks

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1007/978-3-032-02728-3_20openalex-snapshot
Comparative Analysis of Spiking Neurons Mathematical Models Training Using Surrogate Gradients Techniques
inferred← citeshttps://doi.org/10.1007/978-3-032-32732-1_6openalex-snapshot
Parallel LLM Reasoning for Bias-Resilient, Robust Conceptual Abstraction
inferred← citeshttps://doi.org/10.1007/978-981-96-8912-5_12openalex-snapshot
ZNorm: Z-Score Gradient Normalization Accelerating Skip-Connected Network Training Without Architectural Modification
inferred← citeshttps://doi.org/10.1007/s10115-025-02496-1openalex-snapshot
Technology feature fusion prediction method based on multidimensional information extraction and deep neural networks
inferred← citeshttps://doi.org/10.1007/s10489-025-06878-4openalex-snapshot
EMERALD-O: efficient multi-agent reinforcement learning framework for optimised deep learning hyperparameter tuning and selection
inferred← citeshttps://doi.org/10.1007/s10489-026-07316-9openalex-snapshot
PESatNet: Mitigating embedding saturation in knowledge graph recommendation via parameter-embedding synergistic enhancement
inferred← citeshttps://doi.org/10.1007/s11207-026-02740-zopenalex-snapshot
SDOFMv2: A Multi-Instrument Foundation Model for the Solar Dynamics Observatory with Transferable Downstream Applications
inferred← citeshttps://doi.org/10.1007/s11227-026-08607-1openalex-snapshot
FDDPG: a federated deep deterministic policy gradient-based method for attack detection in IoV
inferred← citeshttps://doi.org/10.1007/s11554-026-02000-0openalex-snapshot
CSFENet: a lightweight edge network for UAV-based forest fire detection with generative data
inferred← citeshttps://doi.org/10.1007/s11760-025-04796-zopenalex-snapshot
An efficient dual space curriculum learning approach for speech emotion recognition
inferred← citeshttps://doi.org/10.1007/s11831-026-10724-2openalex-snapshot
Differential Evolution for Deep Learning: A Comprehensive Survey
inferred← citeshttps://doi.org/10.1007/s12083-025-02105-6openalex-snapshot
Fused attention rectified linear unit–empowered graph reinforcement learning for task scheduling in the cloud
inferred← citeshttps://doi.org/10.1007/s12555-026-00009-6openalex-snapshot
Remote Driving Capability Identification Method Based on Graph Transformation and Hybrid Convolutional Neural Networks
inferred← citeshttps://doi.org/10.1007/s44163-026-02369-8openalex-snapshot
Energy constraints in large scale artificial intelligence and insights from human cognition for efficient large language models
inferred← citeshttps://doi.org/10.1016/bs.hna.2026.05.002openalex-snapshot
Learned iterative networks
inferred← citeshttps://doi.org/10.1016/j.aei.2026.105044openalex-snapshot
MFPR-ED: A Multi-Feature Probabilistic Reasoning Method for Environment Decision based on Dynamic Bayesian Networks
inferred← citeshttps://doi.org/10.1016/j.apenergy.2026.128419openalex-snapshot
An LLM-driven adaptive scheduling framework for fuel cell cogeneration-based integrated energy systems under source-load uncertainty
inferred← citeshttps://doi.org/10.1016/j.apsb.2025.07.030openalex-snapshot
Artificial intelligence-driven multi-omics approaches in Alzheimer's disease: Progress, challenges, and future directions
inferred← citeshttps://doi.org/10.1016/j.buildenv.2026.115079openalex-snapshot
Physics-guided multimodal deep learning for thermal performance prediction of green building envelopes
inferred← citeshttps://doi.org/10.1016/j.envsoft.2026.106915openalex-snapshot
Seamless hourly PM2.5 mapping across China with a graph spatiotemporal deep neural network
inferred← citeshttps://doi.org/10.1016/j.inffus.2025.103332openalex-snapshot
Large language models for automated scholarly paper review: A survey
inferred← citeshttps://doi.org/10.1016/j.media.2026.104195openalex-snapshot
Progressive growing of patch size: Curriculum learning for accelerated and improved medical image segmentation
inferred← citeshttps://doi.org/10.1016/j.memsci.2025.124266openalex-snapshot
Machine learning modeling assisted intelligent process analysis for high - performance virus filtration
inferred← citeshttps://doi.org/10.1016/j.neucom.2026.134451openalex-snapshot
Tripartite similarity enhanced canonical correlation fusion for multi-label cross-modal retrieval
inferred← citeshttps://doi.org/10.1016/j.neunet.2026.108733openalex-snapshot
Enhancing progressive ensemble learning via normalized extra-Gradient initialization
inferred← citeshttps://doi.org/10.1016/j.patcog.2026.113591openalex-snapshot
EEGTune: A data-efficient fine-tuning framework for EEG foundation models
inferred← citeshttps://doi.org/10.1016/j.procs.2025.09.345openalex-snapshot
Dimensionality Reduction Method for Fuzzy Interval Data Using Deep Learning
inferred← citeshttps://doi.org/10.1016/j.rser.2026.117120openalex-snapshot
Large models for battery prognostics and health management: A review and future roadmap
inferred← citeshttps://doi.org/10.1016/j.softx.2025.102162openalex-snapshot
bs-scheduler: A Batch Size Scheduler library compatible with PyTorch DataLoaders
inferred← citeshttps://doi.org/10.1021/acs.jpca.6c00365openalex-snapshot
Explainable Machine Learning for Efficient Cocrystal Prediction: Leveraging Morgan Fingerprints to Decode Local Structure-Cocrystal Formation Relationships
inferred← citeshttps://doi.org/10.1038/s41598-025-10289-3openalex-snapshot
Hare escape optimization algorithm with applications in engineering and deep learning
inferred← citeshttps://doi.org/10.1109/agers67633.2025.11446362openalex-snapshot
Optimizing Intrusion Detection Performance in the Internet of Vehicle: De-duplication and SMOTEENN on an Imbalanced Dataset
inferred← citeshttps://doi.org/10.1109/agers67633.2025.11446457openalex-snapshot
Bezier-Shaped Saliency-Guided CutMix for Deep Learning-Based Forest Mapping with NICFI PlanetScope Imagery
inferred← citeshttps://doi.org/10.1109/aibthings66987.2025.11296217openalex-snapshot
A Novel Approach to Fine-tune BERT using Non-Text Features for Enhanced Ransomware Detection
inferred← citeshttps://doi.org/10.1109/ciml69155.2026.11692775openalex-snapshot
ASSS: A Differentiable Adversarial Framework for Task-Aware Data Reduction
inferred← citeshttps://doi.org/10.1109/cscwd64889.2025.11033565openalex-snapshot
Efficient Training of Large Language Models on Legacy GPUs with HetSeq and PyTorch
inferred← citeshttps://doi.org/10.1109/emc68537.2026.11441792openalex-snapshot
PocketKD: Adaptive Confidence Distillation and Lightweight Student Network for Embedded Applications
inferred← citeshttps://doi.org/10.1109/icassp49660.2025.10890533openalex-snapshot
UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition
inferred← citeshttps://doi.org/10.1109/icauc68182.2026.11441266openalex-snapshot
Explainable Deep Learning Architecture for High-Risk Predictions
inferred← citeshttps://doi.org/10.1109/iccc64910.2025.11077170openalex-snapshot
Generative Models Reimagined: Review into Resource-Efficient Training
inferred← citeshttps://doi.org/10.1109/iccd65941.2025.00062openalex-snapshot
A Dynamic Virtual Memory Management System for LLMs on AI Chips
inferred← citeshttps://doi.org/10.1109/icdca69396.2026.11620290openalex-snapshot
Depression and Anxiety Screening for Pregnant Women and General Users Using AI Speech
inferred← citeshttps://doi.org/10.1109/icrera62673.2024.10815236openalex-snapshot
Tensor Network-Based Lightweight Energy Forecasting for Virtual Power Plant
inferred← citeshttps://doi.org/10.1109/ijcnn64981.2025.11229358openalex-snapshot
H2C-Scheduler: An Efficient and Scalable Job Scheduling Method for Hybrid Heterogeneous AI Computing Clusters
inferred← citeshttps://doi.org/10.1109/ispct68220.2025.11406770openalex-snapshot
Grain Truck Recognition and Random Sampling Using an Attention-Enhanced YOLOv5s Network
inferred← citeshttps://doi.org/10.1109/iwqos70441.2026.11661132openalex-snapshot
CANListener: A Lightweight and Adaptive Intrusion Detection System for In-vehicle CAN Bus
inferred← citeshttps://doi.org/10.1109/jbhi.2024.3496864openalex-snapshot
Generalized Cross-Domain Framework for Gesture Recognition via Wrist-Worn Sensing
inferred← citeshttps://doi.org/10.1109/jiot.2025.3599518openalex-snapshot
Cross-Domain Gesture Recognition via Wrist-Worn Sensing for Resource-Efficient IoT Applications
inferred← citeshttps://doi.org/10.1109/jiot.2026.3652734openalex-snapshot
Detecting Ethereum Smart Contract Vulnerabilities via Bytecode Image Analysis
inferred← citeshttps://doi.org/10.1109/jiot.2026.3695605openalex-snapshot
MORF: Latent Regime-Flow Online Forecasting for Nonstationary Multinode IoT Air-Quality Networks With Delayed Supervision
inferred← citeshttps://doi.org/10.1109/menacomm69507.2026.11532615openalex-snapshot
A Survey on Foundation Models for Industrial Intelligence: Architectures, Training Paradigms, and Applications
inferred← citeshttps://doi.org/10.1109/synasc69064.2025.00078openalex-snapshot
Increasing the Training Speed with Batch Size Schedulers
inferred← citeshttps://doi.org/10.1109/tccn.2026.3704580openalex-snapshot
Energy-Efficient Computing Using Adaptive Model Selection for Mobile Agents in Federated Learning
inferred← citeshttps://doi.org/10.1109/tcsii.2026.3705196openalex-snapshot
TDComp: Energy Efficient Time Domain Bitmap Compression
inferred← citeshttps://doi.org/10.1109/tpami.2026.3663608openalex-snapshot
Boosting Learning Efficiency in Few-Shot Tasks With Layer-Adaptive PID Control
inferred← citeshttps://doi.org/10.1145/3708035.3736061openalex-snapshot
AI Project Facilitation Guidance for Research Computing and Data (RCD) Professionals
inferred← citeshttps://doi.org/10.1145/3743093.3771005openalex-snapshot
Spatial Momentum Networks: Physics-Guided Efficient Attention Fusion Method
inferred← citeshttps://doi.org/10.1145/3832810.3832832openalex-snapshot
MServerSim: A Modular Design based Simulation Technique for Modern AI Servers
inferred← citeshttps://doi.org/10.12677/aam.2025.143088openalex-snapshot
Intelligent Biomedical Image Classification Algorithm Based on Wavelet Transform
inferred← citeshttps://doi.org/10.14710/jmasif.16.1.72957openalex-snapshot
A Comparative Analysis of Convolutional Neural Network (CNN): MobileNetV2 and Xception for Butterfly Species Classification
inferred← citeshttps://doi.org/10.2139/ssrn.6580122openalex-snapshot
Rank Utilization in Low-Rank Adaptation: Spectral Diagnostics and Scaling Laws for finetuning Quality
inferred← citeshttps://doi.org/10.2139/ssrn.6902318openalex-snapshot
Fractional-order dynamics driven stochastic gradient descent method with momentum
inferred← citeshttps://doi.org/10.22399/ijcesen.5394openalex-snapshot
GOVERN-CTRL: A Governance Control Plane Architecture for Production-Scale Data and Machine Learning Pipelines
inferred← citeshttps://doi.org/10.32604/cmes.2025.067809openalex-snapshot
A Survey of Large-Scale Deep Learning Models in Medicine and Healthcare
inferred← citeshttps://doi.org/10.3389/fbrio.2026.1921669openalex-snapshot
Artificial intelligence in microbial biotechnology for food security: current state and challenges
inferred← citeshttps://doi.org/10.3389/fnbot.2025.1691300openalex-snapshot
UHGAN: a dual-phase GAN with Hough-transform constraints for accurate farmland road extraction
inferred← citeshttps://doi.org/10.3390/a19080631openalex-snapshot
UAV Navigation Mark Inspection Path Planning Based on Improved GWO
inferred← citeshttps://doi.org/10.3390/app16083725openalex-snapshot
Entropy-Guided Hierarchical Scheduling for Elastic Distributed Deep Learning
inferred← citeshttps://doi.org/10.3390/computers15040201openalex-snapshot
A Unified Multi-Dimensional Cost Analysis of Speculative Parallel Conflict Detection and Diagnosis
inferred← citeshttps://doi.org/10.3390/electronics15051034openalex-snapshot
Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study
inferred← citeshttps://doi.org/10.3390/f17010131openalex-snapshot
Spatiotemporal Patterns of Aboveground Carbon Storage in Hainan Mangroves Based on Machine Learning and Multi-Source Remote Sensing Data
inferred← citeshttps://doi.org/10.3390/make7010013openalex-snapshot
Exploring the Intersection of Machine Learning and Big Data: A Survey
inferred← citeshttps://doi.org/10.3390/s25123783openalex-snapshot
CAs-Net: A Channel-Aware Speech Network for Uyghur Speech Recognition
inferred← citeshttps://doi.org/10.3390/sym18040670openalex-snapshot
Asymmetric Cross-Modal Prototypical Networks for Few-Shot Image Classification
inferred← citeshttps://doi.org/10.4018/979-8-3373-7549-6.ch003openalex-snapshot
Sustaining Intelligent Societies Through Renewable Energy Sources for AI Development
inferred← citeshttps://doi.org/10.5753/eradrs.2026.20518openalex-snapshot
Performance Evaluation of Distributed Deep Learning Training on Low-Bandwidth Networks
inferred← citeshttps://doi.org/10.59717/ipj.energy-use.2025.100006openalex-snapshot
Co-evolution of urban power network and electric mobility
inferred← citeshttps://doi.org/10.61186/jgst.14.1.63openalex-snapshot
Target Detection in Panchromatic Remotely Sensed Images Using Deep Learning Algorithms: A Review
inferred← citeshttps://doi.org/10.61453/jods.v20260214openalex-snapshot
Continual Learning Frameworks for Long-Term Knowledge Retention in Evolving Data Streams
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.