On the public citation graph

Self-Distillation Amplifies Regularization in Hilbert Space

https://doi.org/10.48550/arxiv.2002.05715

0 signed · 117 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.

Claim with ORCID

Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.

See reference health

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.4760942openalex-extracted

Sdelc: An Ensemble Label Noise Correction Method Based on Self-Distillation

inferred← citeshttps://doi.org/10.1007/978-3-030-58568-6_16openalex-snapshot

Rethinking Few-Shot Image Classification: A Good Embedding is All You Need?

inferred← citeshttps://doi.org/10.1007/978-3-030-86520-7_12openalex-snapshot

Midpoint Regularization: From High Uncertainty Training Labels to Conservative Classification Decisions

inferred← citeshttps://doi.org/10.1007/978-3-031-32095-8_1openalex-snapshot

Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/s11263-021-01453-zopenalex-snapshot

Knowledge Distillation: A Survey

inferred← citeshttps://doi.org/10.1007/s11263-023-01792-zopenalex-snapshot

Multi-target Knowledge Distillation via Student Self-reflection

inferred← citeshttps://doi.org/10.1007/s40747-024-01394-3openalex-snapshot

Knowledge distillation based on projector integration and classifier sharing

inferred← citeshttps://doi.org/10.1007/s40747-024-01624-8openalex-snapshot

Residual trio feature network for efficient super-resolution

inferred← citeshttps://doi.org/10.1016/j.bspc.2022.104496openalex-snapshot

Automatic sleep scoring using patient-specific ensemble models and knowledge distillation for ear-EEG data

inferred← citeshttps://doi.org/10.1016/j.compag.2025.111009openalex-snapshot

A semi-supervised method for detecting female cucumber flowers in greenhouses based on unmanned aerial vehicle images

inferred← citeshttps://doi.org/10.1016/j.compbiomed.2024.108489openalex-snapshot

Sample self-selection using dual teacher networks for pathological image classification with noisy labels

inferred← citeshttps://doi.org/10.1016/j.imavis.2020.104006openalex-snapshot

GIFSL - grafting based improved few-shot learning

inferred← citeshttps://doi.org/10.1016/j.imavis.2025.105430openalex-snapshot

Semantic-aware for point cloud domain adaptation with self-distillation learning

inferred← citeshttps://doi.org/10.1016/j.jwpe.2025.108013openalex-snapshot

Optimization of graph wavenet model for dissolved oxygen prediction using self-distillation and whale optimization algorithm

inferred← citeshttps://doi.org/10.1016/j.knosys.2024.111504openalex-snapshot

Balanced self-distillation for long-tailed recognition

inferred← citeshttps://doi.org/10.1016/j.media.2024.103102openalex-snapshot

Hybrid unsupervised representation learning and pseudo-label supervised self-distillation for rare disease imaging phenotype classification with dispersion-aware imbalance correction

inferred← citeshttps://doi.org/10.1016/j.neucom.2021.06.090openalex-snapshot

Efficient-PrototypicalNet with self knowledge distillation for few-shot learning

inferred← citeshttps://doi.org/10.1016/j.neucom.2025.129477openalex-snapshot

Adaptive lightweight network construction method for Self-Knowledge Distillation

inferred← citeshttps://doi.org/10.1016/j.patcog.2025.112599openalex-snapshot

Self-distilled learning of adaptive interval 3D lookup tables on real-time image enhancement

inferred← citeshttps://doi.org/10.1016/j.patrec.2021.03.007openalex-snapshot

Leveraging recent advances in deep learning for audio-Visual emotion recognition

inferred← citeshttps://doi.org/10.1080/17538947.2024.2405525openalex-snapshot

YOLOSAR-Lite: a lightweight framework for real-time ship detection in SAR imagery

inferred← citeshttps://doi.org/10.1088/1361-6560/ac3935openalex-snapshot

Efficient knowledge distillation for liver CT segmentation using growing assistant network

inferred← citeshttps://doi.org/10.1109/arace60380.2023.00022openalex-snapshot

Online-S2T: A Lightweight Distributed Online Reinforcement Learning Training Framework For Resource-Constrained Devices

inferred← citeshttps://doi.org/10.1109/cvpr52688.2022.01163openalex-snapshot

Knowledge Distillation with the Reused Teacher Classifier

inferred← citeshttps://doi.org/10.1109/cvpr52688.2022.01214openalex-snapshot

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.00778openalex-snapshot

Decentralized Learning with Multi-Headed Distillation

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.01932openalex-snapshot

Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.01935openalex-snapshot

Simulated Annealing in Early Layers Leads to Better Generalization

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.02350openalex-snapshot

ScaleFL: Resource-Adaptive Federated Learning with Heterogeneous Clients

inferred← citeshttps://doi.org/10.1109/cvprw50498.2020.00124openalex-snapshot

Dropout as an Implicit Gating Mechanism For Continual Learning

inferred← citeshttps://doi.org/10.1109/cvprw53098.2021.00283openalex-snapshot

Anchor-based Plain Net for Mobile Image Super-Resolution

inferred← citeshttps://doi.org/10.1109/cvprw53098.2021.00364openalex-snapshot

Estimating (and fixing) the Effect of Face Obfuscation in Video Recognition

inferred← citeshttps://doi.org/10.1109/cvprw53098.2021.00390openalex-snapshot

Essentials for Class Incremental Learning

inferred← citeshttps://doi.org/10.1109/cvprw56347.2022.00101openalex-snapshot

Fast and Memory-Efficient Network Towards Efficient Image Super-Resolution

inferred← citeshttps://doi.org/10.1109/icaibd55127.2022.9820338openalex-snapshot

Research on Compression of Teacher Guidance Network Use Global Differential Computing Neural Architecture Search

inferred← citeshttps://doi.org/10.1109/icassp48485.2024.10446335openalex-snapshot

Stable Distillation: Regularizing Continued Pre-Training for Low-Resource Automatic Speech Recognition

inferred← citeshttps://doi.org/10.1109/iccv48922.2021.00501openalex-snapshot

Student Customized Knowledge Distillation: Bridging the Gap Between Student and Teacher

inferred← citeshttps://doi.org/10.1109/iccv51070.2023.01562openalex-snapshot

Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement

inferred← citeshttps://doi.org/10.1109/iccv51070.2023.02143openalex-snapshot

Tiny Updater: Towards Efficient Neural Network-Driven Software Updating

inferred← citeshttps://doi.org/10.1109/iccvw54120.2021.00396openalex-snapshot

Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognition

inferred← citeshttps://doi.org/10.1109/icdcs57875.2023.00113openalex-snapshot

Scalable Federated Learning with System Heterogeneity

inferred← citeshttps://doi.org/10.1109/icdh60066.2023.00028openalex-snapshot

sDREAMER: Self-distilled Mixture-of-Modality-Experts Transformer for Automatic Sleep Staging

inferred← citeshttps://doi.org/10.1109/icme52920.2022.9859708openalex-snapshot

Distilldarts: Network Distillation for Smoothing Gradient Distributions in Differentiable Architecture Search

inferred← citeshttps://doi.org/10.1109/icra57147.2024.10610702openalex-snapshot

VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inference

inferred← citeshttps://doi.org/10.1109/ijcnn52387.2021.9533321openalex-snapshot

Density-Fixing: Simple yet Effective Regularization Method based on the Class Priors

inferred← citeshttps://doi.org/10.1109/ncim59001.2023.10212747openalex-snapshot

Physiotherapy Exercise Classification by Exploring Knowledge Distillation with Attention Modules

inferred← citeshttps://doi.org/10.1109/tgrs.2023.3293535openalex-snapshot

A Semi-Soft Label-Guided Network With Self-Distillation for SAR Inshore Ship Detection

inferred← citeshttps://doi.org/10.1109/tkde.2023.3303885openalex-snapshot

Iterative Graph Self-Distillation

inferred← citeshttps://doi.org/10.1109/tpami.2024.3370716openalex-snapshot

Randomness Regularization With Simple Consistency Training for Neural Networks

inferred← citeshttps://doi.org/10.1109/tps-isa58951.2023.00012openalex-snapshot

RAI4IoE: Responsible AI for Enabling the Internet of Energy

inferred← citeshttps://doi.org/10.1109/wacv51458.2022.00394openalex-snapshot

Fair Visual Recognition in Limited Data Regime using Self-Supervision and Self-Distillation

inferred← citeshttps://doi.org/10.1109/wacv56688.2023.00285openalex-snapshot

Self-Distilled Self-supervised Representation Learning

inferred← citeshttps://doi.org/10.1145/3394231.3397892openalex-snapshot

Semi-Supervised Granular Classification Framework for Resource Constrained Short-texts

inferred← citeshttps://doi.org/10.1145/3404835.3462927openalex-snapshot

Improving Video Retrieval by Adaptive Margin

inferred← citeshttps://doi.org/10.1145/3543507.3583543openalex-snapshot

SeqCare: Sequential Training with External Medical Knowledge Graph for Diagnosis Prediction in Healthcare Data

inferred← citeshttps://doi.org/10.1145/3624918.3625320openalex-snapshot

RFR: Representation-Focused Replay for Overcoming the Catastrophic Forgetting in Lifelong Language Learning

inferred← citeshttps://doi.org/10.1145/3627631.3627647openalex-snapshot

Knowledge Distillation with Ensemble Calibration

inferred← citeshttps://doi.org/10.1145/3664647.3681610openalex-snapshot

Reliable Model Watermarking: Defending against Theft without Compromising on Evasion

inferred← citeshttps://doi.org/10.1145/3701728openalex-snapshot

Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

inferred← citeshttps://doi.org/10.1609/aaai.v36i10.21349openalex-snapshot

A Semi-supervised Learning Approach with Two Teachers to Improve Breakdown Identification in Dialogues

inferred← citeshttps://doi.org/10.1609/aaai.v37i2.25266openalex-snapshot

Self-Decoupling and Ensemble Distillation for Efficient Segmentation

inferred← citeshttps://doi.org/10.1609/aaai.v38i10.29004openalex-snapshot

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression

inferred← citeshttps://doi.org/10.1609/aaai.v38i14.29519openalex-snapshot

Distilling Reliable Knowledge for Instance-Dependent Partial Label Learning

inferred← citeshttps://doi.org/10.1609/aaai.v38i17.29821openalex-snapshot

Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data

inferred← citeshttps://doi.org/10.1609/aaai.v38i5.28219openalex-snapshot

Understanding the Role of the Projector in Knowledge Distillation

inferred← citeshttps://doi.org/10.18653/v1/2020.emnlp-main.446openalex-snapshot

Imitation Attacks and Defenses for Black-box Machine Translation Systems

inferred← citeshttps://doi.org/10.18653/v1/2020.findings-emnlp.74openalex-snapshot

Improving QA Generalization by Concurrent Modeling of Multiple Biases

inferred← citeshttps://doi.org/10.18653/v1/2021.naacl-main.56openalex-snapshot

Noisy Self-Knowledge Distillation for Text Summarization

inferred← citeshttps://doi.org/10.18653/v1/2022.acl-long.508openalex-snapshot

Sharpness-Aware Minimization Improves Language Model Generalization

inferred← citeshttps://doi.org/10.18653/v1/2022.findings-emnlp.417openalex-snapshot

Sharpness-Aware Minimization with Dynamic Reweighting

inferred← citeshttps://doi.org/10.18653/v1/2022.findings-naacl.70openalex-snapshot

Self-Training with Differentiable Teacher

inferred← citeshttps://doi.org/10.18653/v1/2023.acl-long.755openalex-snapshot

Disentangled Phonetic Representation for Chinese Spelling Correction

inferred← citeshttps://doi.org/10.18653/v1/2023.emnlp-main.271openalex-snapshot

Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? Label Smoothing: Fact or Fallacy?

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-acl.393openalex-snapshot

Distilling Calibrated Knowledge for Stance Detection

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-acl.706openalex-snapshot

Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training

inferred← citeshttps://doi.org/10.2139/ssrn.4884260openalex-snapshot

Adaptive Network Construction Method for Self-Knowledge Distillation

inferred← citeshttps://doi.org/10.24963/ijcai.2021/362openalex-snapshot

Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation

inferred← citeshttps://doi.org/10.26434/chemrxiv-2022-sq34x-v2openalex-snapshot

Designing solvent systems in chemical processes using self-evolving solubility databases and graph neural networks

inferred← citeshttps://doi.org/10.3390/app12199453openalex-snapshot

Multiple-Stage Knowledge Distillation

inferred← citeshttps://doi.org/10.3390/app13063683openalex-snapshot

A Novel Small Target Detection Strategy: Location Feature Extraction in the Case of Self-Knowledge Distillation

inferred← citeshttps://doi.org/10.3390/app14041375openalex-snapshot

Self-Distillation and Pinyin Character Prediction for Chinese Spelling Correction Based on Multimodality

inferred← citeshttps://doi.org/10.3390/app14167022openalex-snapshot

Class-Center-Based Self-Knowledge Distillation: A Simple Method to Reduce Intra-Class Variance

inferred← citeshttps://doi.org/10.3390/biomimetics7040195openalex-snapshot

Cervical Cell Image Classification-Based Knowledge Distillation

inferred← citeshttps://doi.org/10.3390/pr13051556openalex-snapshot

A Lightweight Multi-Scale Object Detection Framework for Shrimp Meat Quality Control in Food Processing

inferred← citeshttps://doi.org/10.3390/rs14184606openalex-snapshot

Self-Learning for Few-Shot Remote Sensing Image Captioning

inferred← citeshttps://doi.org/10.3390/s21051566openalex-snapshot

RS-SSKD: Self-Supervision Equipped with Knowledge Distillation for Few-Shot Remote Sensing Scene Classification

inferred← citeshttps://doi.org/10.3390/s22197344openalex-snapshot

A Method of Deep Learning Model Optimization for Image Classification on Edge Device

inferred← citeshttps://doi.org/10.47749/t/unicamp.2022.1246260openalex-snapshot

Improving loss functions and feature utilization for self-supervised single image depth estimation from monocular videos

inferred← citeshttps://doi.org/10.48550/arxiv.2005.10419openalex-snapshot

Why distillation helps: a statistical perspective

inferred← citeshttps://doi.org/10.48550/arxiv.2006.00555openalex-snapshot

Transferring Inductive Biases through Knowledge Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2006.05826openalex-snapshot

Transient Non-Stationarity and Generalisation in Deep Reinforcement Learning

inferred← citeshttps://doi.org/10.48550/arxiv.2006.16589openalex-snapshot

On the Demystification of Knowledge Distillation: A Residual Network Perspective

inferred← citeshttps://doi.org/10.48550/arxiv.2009.07032openalex-snapshot

Noisy Self-Knowledge Distillation for Text Summarization

inferred← citeshttps://doi.org/10.48550/arxiv.2010.03622openalex-snapshot

Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data

inferred← citeshttps://doi.org/10.48550/arxiv.2010.10090openalex-snapshot

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher

inferred← citeshttps://doi.org/10.48550/arxiv.2010.14498openalex-snapshot

Implicit Under-Parameterization Inhibits Data-Efficient Deep Reinforcement Learning

inferred← citeshttps://doi.org/10.48550/arxiv.2011.10944openalex-snapshot

Run Away From your Teacher: Understanding BYOL by a Novel Self-Supervised Approach

inferred← citeshttps://doi.org/10.48550/arxiv.2012.07976openalex-snapshot

NeurIPS 2020 Competition: Predicting Generalization in Deep Learning

inferred← citeshttps://doi.org/10.48550/arxiv.2012.09816openalex-snapshot

Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

inferred← citeshttps://doi.org/10.48550/arxiv.2102.06849openalex-snapshot

Distilling Double Descent

inferred← citeshttps://doi.org/10.48550/arxiv.2102.13088openalex-snapshot

Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2102.13089openalex-snapshot

On The Effect of Auxiliary Tasks on Representation Dynamics

inferred← citeshttps://doi.org/10.48550/arxiv.2104.09732openalex-snapshot

Knowledge Distillation as Semiparametric Inference

inferred← citeshttps://doi.org/10.48550/arxiv.2106.02654openalex-snapshot

Churn Reduction via Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2106.05945openalex-snapshot

Does Knowledge Distillation Really Work?

inferred← citeshttps://doi.org/10.48550/arxiv.2106.06770openalex-snapshot

What can linearized neural networks actually say about generalization?

inferred← citeshttps://doi.org/10.48550/arxiv.2106.10494openalex-snapshot

Teacher's pet: understanding and mitigating biases in distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2106.13913openalex-snapshot

Midpoint Regularization: from High Uncertainty Training to Conservative Classification

inferred← citeshttps://doi.org/10.48550/arxiv.2106.14448openalex-snapshot

R-Drop: Regularized Dropout for Neural Networks

inferred← citeshttps://doi.org/10.48550/arxiv.2107.06993openalex-snapshot

Confidence Conditioned Knowledge Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2108.01696openalex-snapshot

Linking Common Vulnerabilities and Exposures to the MITRE ATT&CK Framework: A Self-Distillation Approach

inferred← citeshttps://doi.org/10.48550/arxiv.2108.12522openalex-snapshot

Learning Energy-Based Approximate Inference Networks for Structured Applications in NLP

inferred← citeshttps://doi.org/10.48550/arxiv.2109.15014openalex-snapshot

Deep Neural Compression Via Concurrent Pruning and Self-Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2110.08220openalex-snapshot

Combining Diverse Feature Priors

inferred← citeshttps://doi.org/10.48550/arxiv.2110.15210openalex-snapshot

Towards Model Agnostic Federated Learning Using Knowledge Distillation

inferred← citeshttps://doi.org/10.48550/arxiv.2111.12170openalex-snapshot

Domain-Agnostic Clustering with Self-Distillation

inferred← citeshttps://doi.org/10.52202/068431-0535openalex-snapshot

Spectral Bias in Practice: The Role of Function Frequency in Generalization

Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.