On the public citation graph

Patient Knowledge Distillation for BERT Model Compression

0 signed · 641 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.

Claim with ORCID

Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.

See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/978-3-319-46493-0_39openalex-snapshot

Deep Networks with Stochastic Depth

inferredcites →https://doi.org/10.1109/cvpr.2017.194openalex-snapshot

Spatially Adaptive Computation Time for Residual Networks

inferredcites →https://doi.org/10.1109/icassp.2017.7953072openalex-snapshot

Knowledge distillation for small-footprint highway networks

inferredcites →https://doi.org/10.1109/iccv.2015.327openalex-snapshot

An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections

inferredcites →https://doi.org/10.1109/iccv.2017.155openalex-snapshot

Channel Pruning for Accelerating Very Deep Neural Networks

inferredcites →https://doi.org/10.1162/tacl_a_00051openalex-snapshot

Enriching Word Vectors with Subword Information

inferredcites →https://doi.org/10.18653/v1/d13-1170openalex-snapshot

Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank

inferredcites →https://doi.org/10.18653/v1/d16-1264openalex-snapshot

SQuAD: 100,000+ Questions for Machine Comprehension of Text

inferredcites →https://doi.org/10.18653/v1/d17-1082openalex-snapshot

RACE: Large-scale ReAding Comprehension Dataset From Examinations

inferredcites →https://doi.org/10.18653/v1/n18-1101openalex-snapshot

A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference

inferredcites →https://doi.org/10.18653/v1/n18-1202openalex-snapshot

Deep Contextualized Word Representations

inferredcites →https://doi.org/10.18653/v1/n19-1423openalex-snapshot

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

inferredcites →https://doi.org/10.18653/v1/p18-1031openalex-snapshot

Universal Language Model Fine-tuning for Text Classification

inferredcites →https://doi.org/10.3115/v1/d14-1162openalex-snapshot

Glove: Global Vectors for Word Representation

inferredcites →https://doi.org/10.4230/lipics.cp.2025.31openalex-snapshot

HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case

inferredcites →https://doi.org/10.48550/arxiv.1306.0543openalex-snapshot

Predicting Parameters in Deep Learning

inferredcites →https://doi.org/10.48550/arxiv.1310.4546openalex-snapshot

Distributed Representations of Words and Phrases and their Compositionality

inferredcites →https://doi.org/10.48550/arxiv.1412.6115openalex-snapshot

Compressing Deep Convolutional Networks using Vector Quantization

inferredcites →https://doi.org/10.48550/arxiv.1503.02531openalex-snapshot

Distilling the Knowledge in a Neural Network

inferredcites →https://doi.org/10.48550/arxiv.1506.06726openalex-snapshot

Skip-Thought Vectors

inferredcites →https://doi.org/10.48550/arxiv.1511.01432openalex-snapshot

Semi-supervised Sequence Learning

inferredcites →https://doi.org/10.48550/arxiv.1511.05641openalex-snapshot

Net2Net: Accelerating Learning via Knowledge Transfer

inferredcites →https://doi.org/10.48550/arxiv.1610.09650openalex-snapshot

Deep Model Compression: Distilling Knowledge from Noisy Teachers

inferredcites →https://doi.org/10.48550/arxiv.1610.09716openalex-snapshot

Doubly Convolutional Neural Networks

inferredcites →https://doi.org/10.48550/arxiv.1702.06257openalex-snapshot

The Power of Sparsity in Convolutional Neural Networks

inferredcites →https://doi.org/10.48550/arxiv.1802.05668openalex-snapshot

Model compression via distillation and quantization

inferredcites →https://doi.org/10.48550/arxiv.1803.02893openalex-snapshot

An efficient framework for learning sentence representations

inferredcites →https://doi.org/10.48550/arxiv.1812.03593openalex-snapshot

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

inferredcites →https://doi.org/10.48550/arxiv.1902.10461openalex-snapshot

Multilingual Neural Machine Translation with Knowledge Distillation

inferredcites →https://doi.org/10.48550/arxiv.1904.09482openalex-snapshot

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding

inferredcites →https://doi.org/10.65215/2q58a426openalex-snapshot

Attention Is All You Need

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.3985429openalex-extracted

Greedy Layer Pruning: Decreasing Inference Time of Transformer Models

inferred← citeshttps://doi.org/10.2139/ssrn.4924881openalex-extracted

Can Advanced LLMs Coach Smaller LLMs? Knowledge Distillation for Goal-Oriented Dialogs

inferred← citeshttps://doi.org/10.1002/wics.70049openalex-snapshot

Theoretical Perspectives on Knowledge Distillation: A Review

inferred← citeshttps://doi.org/10.1007/978-3-030-58595-2_40openalex-snapshot

Feature Normalized Knowledge Distillation for Image Classification

inferred← citeshttps://doi.org/10.1007/978-3-030-59585-2_7openalex-snapshot

ALBERT-Based Chinese Named Entity Recognition

inferred← citeshttps://doi.org/10.1007/978-3-030-72240-1_21openalex-snapshot

Simplified TinyBERT: Knowledge Distillation for Document Retrieval

inferred← citeshttps://doi.org/10.1007/978-3-030-86365-4_46openalex-snapshot

Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation

inferred← citeshttps://doi.org/10.1007/978-3-030-86523-8_36openalex-snapshot

Follow Your Path: A Progressive Method for Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-030-88480-2_18openalex-snapshot

Accelerating Pretrained Language Model Inference Using Weighted Ensemble Self-distillation

inferred← citeshttps://doi.org/10.1007/978-3-030-92638-0_19openalex-snapshot

MS-BERT: A Multi-layer Self-distillation Approach for BERT Compression Based on Earth Mover’s Distance

inferred← citeshttps://doi.org/10.1007/978-3-030-94822-1_10openalex-snapshot

WiFi-Based Multi-task Sensing

inferred← citeshttps://doi.org/10.1007/978-3-030-96033-9_5openalex-snapshot

LightBERT: A Distilled Chinese BERT Model

inferred← citeshttps://doi.org/10.1007/978-3-031-08473-7_18openalex-snapshot

A Methodology for Enabling NLP Capabilities on Edge and Low-Resource Devices

inferred← citeshttps://doi.org/10.1007/978-3-031-10986-7_11openalex-snapshot

Deep-to-Bottom Weights Decay: A Systemic Knowledge Review Learning Technique for Transformer Layers in Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-031-15931-2_13openalex-snapshot

Adaptive Knowledge Distillation for Efficient Relation Classification

inferred← citeshttps://doi.org/10.1007/978-3-031-18315-7_12openalex-snapshot

Improving Event Temporal Relation Classification via Auxiliary Label-Aware Contrastive Learning

inferred← citeshttps://doi.org/10.1007/978-3-031-19830-4_5openalex-snapshot

Factorizing Knowledge in Neural Networks

inferred← citeshttps://doi.org/10.1007/978-3-031-20053-3_19openalex-snapshot

Improving Robustness by Enhancing Weak Subnets

inferred← citeshttps://doi.org/10.1007/978-3-031-26422-1_7openalex-snapshot

Distributional Correlation–Aware Knowledge Distillation for Stock Trading Volume Prediction

inferred← citeshttps://doi.org/10.1007/978-3-031-32095-8_5openalex-snapshot

Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications

inferred← citeshttps://doi.org/10.1007/978-3-031-35995-8_39openalex-snapshot

A Contrastive Self-distillation BERT with Kernel Alignment-Based Inference

inferred← citeshttps://doi.org/10.1007/978-3-031-41682-8_15openalex-snapshot

Multimodal Rumour Detection: Catching News that Never Transpired!

inferred← citeshttps://doi.org/10.1007/978-3-031-44195-0_22openalex-snapshot

Aggregate Distillation for Top-K Recommender System

inferred← citeshttps://doi.org/10.1007/978-3-031-44198-1_1openalex-snapshot

2RDA: Representation and Relation Distillation with Data Augmentation

inferred← citeshttps://doi.org/10.1007/978-3-031-44696-2_56openalex-snapshot

OnMKD: An Online Mutual Knowledge Distillation Framework for Passage Retrieval

inferred← citeshttps://doi.org/10.1007/978-3-031-46674-8_35openalex-snapshot

Multi-teacher Local Semantic Distillation from Graph Neural Networks

inferred← citeshttps://doi.org/10.1007/978-3-031-46674-8_40openalex-snapshot

Effi-Emp: An AI Based Approach Towards Positive Empathic Expressions

inferred← citeshttps://doi.org/10.1007/978-3-031-46677-9_29openalex-snapshot

FSKD: Detecting Fake News with Few-Shot Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-031-53308-2_23openalex-snapshot

Lightweight Image Captioning Model Based on Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-031-63749-0_13openalex-snapshot

Data-Efficient Knowledge Distillation with Teacher Assistant-Based Dynamic Objective Alignment

inferred← citeshttps://doi.org/10.1007/978-3-031-72350-6_11openalex-snapshot

EKD: Effective Knowledge Distillation for Few-Shot Sentiment Analysis

inferred← citeshttps://doi.org/10.1007/978-3-031-72973-7_7openalex-snapshot

BKDSNN: Enhancing the Performance of Learning-Based Spiking Neural Networks Training with Blurred Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-031-85747-8_6openalex-snapshot

Sparse Fine-Tuning for Inference Acceleration of Large Language Models

inferred← citeshttps://doi.org/10.1007/978-3-031-85747-8_8openalex-snapshot

Class-Based Feature Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-032-06418-9_2openalex-snapshot

Unlocking One-for-All Generative AI at Edge

inferred← citeshttps://doi.org/10.1007/978-3-032-10209-6_8openalex-snapshot

Semantic Communication with Transformer and Knowledge Distillation for Language Translation

inferred← citeshttps://doi.org/10.1007/978-3-032-10738-1_20openalex-snapshot

Neural Network Compression and Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-3-032-12840-9_21openalex-snapshot

Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study

inferred← citeshttps://doi.org/10.1007/978-3-032-37574-2_19openalex-snapshot

LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoning

inferred← citeshttps://doi.org/10.1007/978-981-15-5573-2_4openalex-snapshot

Sentence Representation

inferred← citeshttps://doi.org/10.1007/978-981-92-2584-2_26openalex-snapshot

Optimization Approaches for Language Models in the Task of Translating Sino-Vietnamese Texts into Modern Vietnamese

inferred← citeshttps://doi.org/10.1007/978-981-95-4158-4_10openalex-snapshot

Learnable Relational Knowledge Distillation For Language Model Compression

inferred← citeshttps://doi.org/10.1007/978-981-95-5740-0_22openalex-snapshot

SDP: Spiking Diffusion Policy for Robotic Manipulation with Learnable Channel-Wise Membrane Thresholds

inferred← citeshttps://doi.org/10.1007/978-981-97-3980-6_38openalex-snapshot

Biomedical Named Entity Recognition Model Based on Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-981-97-5569-1_11openalex-snapshot

QoMRC: Query-oriented Machine Reading Comprehension Framework for Aspect Sentiment Triplet Extraction

inferred← citeshttps://doi.org/10.1007/978-981-97-5669-8_30openalex-snapshot

A Task-Efficient Gradient Guide Knowledge Distillation for Pre-train Language Model Compression

inferred← citeshttps://doi.org/10.1007/978-981-97-5669-8_33openalex-snapshot

Knowledge Distillation with Information Compressed Representations

inferred← citeshttps://doi.org/10.1007/978-981-97-7707-5_29openalex-snapshot

The Journey of Language Models in Understanding Natural Language

inferred← citeshttps://doi.org/10.1007/978-981-97-9431-7_19openalex-snapshot

Model-Agnostic Knowledge Distillation Between Heterogeneous Models

inferred← citeshttps://doi.org/10.1007/978-981-99-1600-9_13openalex-snapshot

OpenBMB: Big Model Systems for Large-Scale Representation Learning

inferred← citeshttps://doi.org/10.1007/978-981-99-1600-9_5openalex-snapshot

Pre-trained Models for Representation Learning

inferred← citeshttps://doi.org/10.1007/978-981-99-4752-2_48openalex-snapshot

RA-KD: Random Attention Map Projection for Knowledge Distillation

inferred← citeshttps://doi.org/10.1007/978-981-99-4752-2_66openalex-snapshot

KDCE: Effective Lifelong Learning for Code Pre-train Language Model

inferred← citeshttps://doi.org/10.1007/978-981-99-6207-5_21openalex-snapshot

Adder Encoder for Pre-trained Language Model

inferred← citeshttps://doi.org/10.1007/s00371-025-03973-yopenalex-snapshot

PDFT: parameter-diminish fine-tuning for transformer-based models

inferred← citeshttps://doi.org/10.1007/s00521-022-07366-3openalex-snapshot

Attention mechanism in neural networks: where it comes and where it goes

inferred← citeshttps://doi.org/10.1007/s00521-023-08308-3openalex-snapshot

Learning metric space with distillation for large-scale multi-label text classification

inferred← citeshttps://doi.org/10.1007/s00778-025-00919-7openalex-snapshot

HMI: hierarchical knowledge management for efficient multi-tenant inference in pretrained language models

inferred← citeshttps://doi.org/10.1007/s10032-025-00542-wopenalex-snapshot

SlimDoc: lightweight distillation of document transformer models

inferred← citeshttps://doi.org/10.1007/s10115-026-02818-xopenalex-snapshot

Enhancing deep learning models for time series classification via knowledge distillation

inferred← citeshttps://doi.org/10.1007/s10462-025-11162-5openalex-snapshot

BERT applications in natural language processing: a review

inferred← citeshttps://doi.org/10.1007/s10462-025-11423-3openalex-snapshot

Knowledge distillation and dataset distillation of large language models: emerging trends, challenges, and future directions

inferred← citeshttps://doi.org/10.1007/s10489-025-06427-zopenalex-snapshot

TsDa-ASAM: Balancing efficiency and accuracy in coke image particle size segmentation via two-stage distillation-aware adaptive segment anything model

inferred← citeshttps://doi.org/10.1007/s10664-025-10631-3openalex-snapshot

Towards semantic versioning of open pre-trained language model releases on hugging face

inferred← citeshttps://doi.org/10.1007/s10994-023-06453-3openalex-snapshot

DPQ: dynamic pseudo-mean mixed-precision quantization for pruned neural network

inferred← citeshttps://doi.org/10.1007/s10994-026-07076-0openalex-snapshot

SAMD: Span-Aware Matryoshka Distillation for Cross-Tokenizer Embedding Models

inferred← citeshttps://doi.org/10.1007/s11227-023-05191-6openalex-snapshot

Moka-ADA: adversarial domain adaptation with model-oriented knowledge adaptation for cross-domain sentiment analysis

inferred← citeshttps://doi.org/10.1007/s11263-021-01453-zopenalex-snapshot

Knowledge Distillation: A Survey

inferred← citeshttps://doi.org/10.1007/s11263-023-01753-6openalex-snapshot

DDPNAS: Efficient Neural Architecture Search via Dynamic Distribution Pruning

inferred← citeshttps://doi.org/10.1007/s11263-026-02865-5openalex-snapshot

Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency

inferred← citeshttps://doi.org/10.1007/s11390-021-1119-0openalex-snapshot

Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation

inferred← citeshttps://doi.org/10.1007/s11431-020-1647-3openalex-snapshot

Pre-trained models for natural language processing: A survey

inferred← citeshttps://doi.org/10.1007/s11517-023-02881-4openalex-snapshot

Knowledge distillation for efficient standard scanplane detection of fetal ultrasound

inferred← citeshttps://doi.org/10.1007/s13042-024-02443-6openalex-snapshot

A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT

inferred← citeshttps://doi.org/10.1007/s40747-025-01886-wopenalex-snapshot

An adaptive dual distillation framework for efficient remaining useful life prediction

inferred← citeshttps://doi.org/10.1007/s40747-025-02006-4openalex-snapshot

BDEKD: mitigating backdoor attacks in NLP models via ensemble knowledge distillation

inferred← citeshttps://doi.org/10.1007/s41109-023-00534-xopenalex-snapshot

Network embedding aided vaccine skepticism detection

inferred← citeshttps://doi.org/10.1007/s44443-026-01271-8openalex-snapshot

Explainable multi-loss distillation framework for efficient and interpretable shrimp disease text classification

inferred← citeshttps://doi.org/10.1016/j.aiopen.2021.05.003openalex-snapshot

Know what you don't need: Single-Shot Meta-Pruning for attention heads

inferred← citeshttps://doi.org/10.1016/j.aiopen.2021.08.002openalex-snapshot

Pre-trained models: Past, present and future

inferred← citeshttps://doi.org/10.1016/j.aiopen.2023.08.005openalex-snapshot

AdaDS: Adaptive data selection for accelerating pre-trained language model knowledge distillation

inferred← citeshttps://doi.org/10.1016/j.artmed.2024.102900openalex-snapshot

Transformers and large language models in healthcare: A review

inferred← citeshttps://doi.org/10.1016/j.asoc.2024.111579openalex-snapshot

PURF: Improving teacher representations by imposing smoothness constraints for knowledge distillation

inferred← citeshttps://doi.org/10.1016/j.asoc.2025.113637openalex-snapshot

Transformer spectral optimization: From gradient frequency analysis to adaptive spectral integration

inferred← citeshttps://doi.org/10.1016/j.bspc.2025.108340openalex-snapshot

Radiology report generation from a singular perspective using transformers with Knowledge Distillation

inferred← citeshttps://doi.org/10.1016/j.csl.2022.101429openalex-snapshot

On the effect of dropping layers of pre-trained transformer models

inferred← citeshttps://doi.org/10.1016/j.csl.2024.101646openalex-snapshot

A flexible BERT model enabling width- and depth-dynamic inference

inferred← citeshttps://doi.org/10.1016/j.displa.2024.102819openalex-snapshot

Enhancing Chinese–Braille translation: A two-part approach with token prediction and segmentation labeling

inferred← citeshttps://doi.org/10.1016/j.engappai.2023.106137openalex-snapshot

Improving question answering performance using knowledge distillation and active learning

inferred← citeshttps://doi.org/10.1016/j.eswa.2022.119040openalex-snapshot

PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation

inferred← citeshttps://doi.org/10.1016/j.eswa.2023.120980openalex-snapshot

Feature structure distillation with Centered Kernel Alignment in BERT transferring

inferred← citeshttps://doi.org/10.1016/j.eswa.2023.122045openalex-snapshot

A lightweight IoT intrusion detection model based on improved BERT-of-Theseus

inferred← citeshttps://doi.org/10.1016/j.eswa.2024.126040openalex-snapshot

Parameter-efficient online knowledge distillation for pretrained language models

inferred← citeshttps://doi.org/10.1016/j.inffus.2024.102840openalex-snapshot

Federated and edge learning for large language models

inferred← citeshttps://doi.org/10.1016/j.inffus.2026.104819openalex-snapshot

Knowledge Transmission and Fusion in Large Models: Research Advances and Challenges

inferred← citeshttps://doi.org/10.1016/j.ins.2023.01.093openalex-snapshot

Rethinking attention mechanism in time series classification

inferred← citeshttps://doi.org/10.1016/j.ins.2024.121759openalex-snapshot

Heterogeneous federated distillation with mutual information maximization for medical relation extraction

inferred← citeshttps://doi.org/10.1016/j.ipm.2021.102592openalex-snapshot

Adaptive and hybrid context-aware fine-grained word sense disambiguation in topic modeling based document representation

inferred← citeshttps://doi.org/10.1016/j.knosys.2025.113073openalex-snapshot

Personalized federated learning with multiple classifier aggregation

inferred← citeshttps://doi.org/10.1016/j.knosys.2025.113300openalex-snapshot

Distilling vision-language pre-training models with modality-specific meta-learning

inferred← citeshttps://doi.org/10.1016/j.neucom.2021.03.130openalex-snapshot

Learning word representation by jointly using neighbor and syntactic contexts

inferred← citeshttps://doi.org/10.1016/j.neucom.2021.05.084openalex-snapshot

Joint structured pruning and dense knowledge distillation for efficient transformer model compression

inferred← citeshttps://doi.org/10.1016/j.neucom.2021.07.050openalex-snapshot

Improving task-agnostic BERT distillation with layer mapping search

inferred← citeshttps://doi.org/10.1016/j.neucom.2022.08.061openalex-snapshot

Cross-domain knowledge distillation for text classification

inferred← citeshttps://doi.org/10.1016/j.neucom.2024.128791openalex-snapshot

A review of AI edge devices and lightweight CNN and LLM deployment

inferred← citeshttps://doi.org/10.1016/j.neucom.2024.129162openalex-snapshot

Model compression through distillation with cross-layer integrated guidance at word level

inferred← citeshttps://doi.org/10.1016/j.neucom.2024.129190openalex-snapshot

Understanding LLMs: A comprehensive overview from training to inference

inferred← citeshttps://doi.org/10.1016/j.neunet.2024.106272openalex-snapshot

Layerwised multimodal knowledge distillation for vision-language pretrained model

inferred← citeshttps://doi.org/10.1016/j.neunet.2025.107794openalex-snapshot

Embeddings hidden layers learning for neural network compression

inferred← citeshttps://doi.org/10.1016/j.neunet.2025.108114openalex-snapshot

A domain-specific cross-lingual semantic alignment learning model for low-resource languages

inferred← citeshttps://doi.org/10.1016/j.procs.2021.05.065openalex-snapshot

Re-Transformer: A Self-Attention Based Model for Machine Translation

inferred← citeshttps://doi.org/10.1016/j.specom.2026.103474openalex-snapshot

MAG-EMN-KD: Multimodal Attention Gating with Emotion Memory Network and Knowledge Distillation for conversational emotion recognition

inferred← citeshttps://doi.org/10.1016/j.tust.2025.106882openalex-snapshot

Structural failure risk assessment of shield tunnel using large language model

inferred← citeshttps://doi.org/10.1017/s1351324923000542openalex-snapshot

Lightweight transformers for clinical natural language processing

inferred← citeshttps://doi.org/10.1038/s41467-022-29763-xopenalex-snapshot

Communication-efficient federated learning via knowledge distillation

inferred← citeshttps://doi.org/10.1038/s41598-025-16001-9openalex-snapshot

Optimised knowledge distillation for efficient social media emotion recognition using DistilBERT and ALBERT

inferred← citeshttps://doi.org/10.1044/2024_jslhr-24-00515openalex-snapshot

Early Identification of Language Disorders Using Natural Language Processing and Machine Learning: Challenges and Emerging Approaches

inferred← citeshttps://doi.org/10.1049/htl2.12097openalex-snapshot

A related convolutional neural network for cancer diagnosis using microRNA data classification

inferred← citeshttps://doi.org/10.1080/02331888.2025.2451944openalex-snapshot

Knowledge distillation with adapted weight

inferred← citeshttps://doi.org/10.1080/07421222.2023.2301178openalex-snapshot

Improving Threat Mitigation Through a Cybersecurity Risk Management Framework: A Computational Design Science Approach

inferred← citeshttps://doi.org/10.1080/21642583.2025.2474450openalex-snapshot

Supervised methods of machine learning for email classification: a literature survey

inferred← citeshttps://doi.org/10.1088/2632-2153/ac99baopenalex-snapshot

Chemical transformer compression for accelerating both training and inference of molecular modeling

inferred← citeshttps://doi.org/10.1101/2021.09.15.460567openalex-snapshot

Accurate Name Entity Recognition for Biomedical Literatures: A Combined High-quality Manual Annotation and Deep-learning Natural Language Processing Study

inferred← citeshttps://doi.org/10.1101/2022.02.07.479388openalex-snapshot

Clinically driven knowledge distillation for sparsifying high-dimensional multi-omics survival models

inferred← citeshttps://doi.org/10.1109/access.2022.3223049openalex-snapshot

Depression Classification From Tweets Using Small Deep Transfer Learning Language Models

inferred← citeshttps://doi.org/10.1109/access.2024.3405997openalex-snapshot

A Named Entity Recognition Method Based on Knowledge Distillation and Efficient GlobalPointer for Chinese Medical Texts

inferred← citeshttps://doi.org/10.1109/access.2024.3440410openalex-snapshot

Multi-Band NIR-Based Low-Light Image Enhancement via Dual-Teacher Cross Attention

inferred← citeshttps://doi.org/10.1109/access.2025.3608944openalex-snapshot

HiFused-Depth: High-Frequency Fused Depth Estimation With Knowledge Guidance

inferred← citeshttps://doi.org/10.1109/access.2025.3611390openalex-snapshot

A Developer’s Guide to Compressing Pre-Trained Transformer Neural Networks Across Different Domains

inferred← citeshttps://doi.org/10.1109/aicas57966.2023.10168575openalex-snapshot

Novel Knowledge Distillation to Improve Training Accuracy of Spin-based SNN

inferred← citeshttps://doi.org/10.1109/aixse64906.2025.00013openalex-snapshot

A Progressive Learning-to-Learn Knowledge Distillation Method for Out-of-Domain Generalization

inferred← citeshttps://doi.org/10.1109/apsec65559.2024.00049openalex-snapshot

CoSTV: Accelerating Code Search with Two-Stage Paradigm and Vector Retrieval

inferred← citeshttps://doi.org/10.1109/ase56229.2023.00059openalex-snapshot

EALink: An Efficient and Accurate Pre-Trained Framework for Issue-Commit Link Recovery

inferred← citeshttps://doi.org/10.1109/asru51503.2021.9687959openalex-snapshot

Hierarchical Knowledge Distillation for Dialogue Sequence Labeling

inferred← citeshttps://doi.org/10.1109/besc59560.2023.10386647openalex-snapshot

Decoupling Teaching Ability in Meta Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/bigdata50022.2020.9378470openalex-snapshot

Benchmarking performance of RaySGD and Horovod for big data applications

inferred← citeshttps://doi.org/10.1109/cac53003.2021.9728246openalex-snapshot

Fixed-point Quantization for Vision Transformer

inferred← citeshttps://doi.org/10.1109/cacml68972.2026.11507030openalex-snapshot

HRAG: A Fine-Grained Text Classification Framework Oriented Towards Explainability

inferred← citeshttps://doi.org/10.1109/ccai69603.2026.11641879openalex-snapshot

An Empirical Study of Knowledge Distillation Frameworks for Financial NLP in Africa

inferred← citeshttps://doi.org/10.1109/ccsb66722.2025.11154259openalex-snapshot

ADDL: Adaptive Dynamic Distillation for Large Language Models

inferred← citeshttps://doi.org/10.1109/cipae60493.2023.00125openalex-snapshot

EU-BERT: Efficient Unified Named Entity Recognition via Multi-exit BERT

inferred← citeshttps://doi.org/10.1109/compsac61105.2024.00066openalex-snapshot

Effective Compression of Language Models by Combining Pruning and Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/cscwd64889.2025.11033369openalex-snapshot

A Lightweight Dual Stage Distillation Method for Knowledge Graph Completion

inferred← citeshttps://doi.org/10.1109/csicc58665.2023.10105376openalex-snapshot

Using Structured Pruning to Find Winning Lottery Tickets

inferred← citeshttps://doi.org/10.1109/cvpr46437.2021.01603openalex-snapshot

Wasserstein Contrastive Representation Distillation

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.01388openalex-snapshot

RIFormer: Keep Your Vision Backbone Effective But Removing Token Mixer

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.01545openalex-snapshot

Stitchable Neural Networks

inferred← citeshttps://doi.org/10.1109/cvpr52733.2024.01430openalex-snapshot

On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving

inferred← citeshttps://doi.org/10.1109/cvpr52733.2024.01486openalex-snapshot

PELA: Learning Parameter-Efficient Models with Low-Rank Approximation

inferred← citeshttps://doi.org/10.1109/cvpr52734.2025.00937openalex-snapshot

Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement

inferred← citeshttps://doi.org/10.1109/cvprw53098.2021.00338openalex-snapshot

Extracurricular Learning: Knowledge Transfer Beyond Empirical Distribution

inferred← citeshttps://doi.org/10.1109/cvprw63382.2024.00145openalex-snapshot

ViTKD: Feature-based Knowledge Distillation for Vision Transformers

inferred← citeshttps://doi.org/10.1109/cvprw63382.2024.00594openalex-snapshot

End-to-End Neural Network Compression via l1/l2 Regularized Latency Surrogates

inferred← citeshttps://doi.org/10.1109/cvprw63382.2024.00789openalex-snapshot

CASR: Efficient Cascade Network Structure with Channel Aligned method for 4K Real-Time Single Image Super-Resolution

inferred← citeshttps://doi.org/10.1109/cvprw67362.2025.00132openalex-snapshot

Distillation-Supervised Convolutional Low-Rank Adaptation for Efficient Image Super-Resolution

inferred← citeshttps://doi.org/10.1109/eecsi67060.2025.11290133openalex-snapshot

CombiBERT: Choosing the Best Layers Combination in Sentence-BERT Model Variant to Reduce Losses in Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/fuzz-ieee55066.2022.9882595openalex-snapshot

A Study on the Best Way to Compress Natural Language Processing Models

inferred← citeshttps://doi.org/10.1109/iaict52856.2021.9532543openalex-snapshot

Efficient knowledge distillation of teacher model to multiple student models

inferred← citeshttps://doi.org/10.1109/icassp39728.2021.9414572openalex-snapshot

Elbert: Fast Albert with Confidence-Window Based Early Exit

inferred← citeshttps://doi.org/10.1109/icassp43922.2022.9746113openalex-snapshot

Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation

inferred← citeshttps://doi.org/10.1109/icassp48485.2024.10445737openalex-snapshot

One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models

inferred← citeshttps://doi.org/10.1109/icassp48485.2024.10447812openalex-snapshot

Sensi-Bert: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient Language Model

inferred← citeshttps://doi.org/10.1109/icassp48485.2024.10448022openalex-snapshot

Multiple Representation Transfer from Large Language Models to End-to-End ASR Systems

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10094792openalex-snapshot

Boosting Bert Subnets with Neural Grafting

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10094912openalex-snapshot

A Simple Yet Effective Approach to Structured Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10095536openalex-snapshot

Distill-Quantize-Tune - Leveraging Large Teachers for Low-Footprint Efficient Multilingual NLU on Edge

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10095721openalex-snapshot

Prompt-Distiller: Few-Shot Knowledge Distillation for Prompt-Based Language Learners with Dual Contrastive Learning

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10095864openalex-snapshot

F-PABEE: Flexible-Patience-Based Early Exiting For Single-Label and Multi-Label Text Classification Tasks

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10096045openalex-snapshot

Boosting Prompt-Based Few-Shot Learners Through Out-of-Domain Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/icassp49357.2023.10096531openalex-snapshot

Masked Token Similarity Transfer for Compressing Transformer-Based ASR Models

inferred← citeshttps://doi.org/10.1109/icassp55912.2026.11461222openalex-snapshot

Sparsity Induction for Accurate Post-Training Pruning of Large Language Models

inferred← citeshttps://doi.org/10.1109/icassp55912.2026.11462199openalex-snapshot

SPADE: Structured Pruning and Adaptive Distillation for Efficient LLM-TTS

inferred← citeshttps://doi.org/10.1109/icbir54589.2022.9786508openalex-snapshot

Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning

inferred← citeshttps://doi.org/10.1109/icbk50248.2020.00066openalex-snapshot

SDSK2BERT: Explore the Specific Depth with Specific Knowledge to Compress BERT

inferred← citeshttps://doi.org/10.1109/iccc59590.2023.10507622openalex-snapshot

Sci-CoT: Leveraging Large Language Models for Enhanced Knowledge Distillation in Small Models for Scientific QA

inferred← citeshttps://doi.org/10.1109/icccr56747.2023.10194171openalex-snapshot

A Robust Log Classification Approach Based on Natural Language Processing

inferred← citeshttps://doi.org/10.1109/iccsn66511.2025.11172481openalex-snapshot

Research on Tool Wear State Prediction Model Based on Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/iccv48922.2021.00816openalex-snapshot

Exploring Inter-Channel Correlation for Diversity-preserved Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/iccwamtip64812.2024.10873679openalex-snapshot

A Model Compression Method for Loran Prediction on FPGA

inferred← citeshttps://doi.org/10.1109/icde60146.2024.00121openalex-snapshot

Target-agnostic Source-free Domain Adaptation for Regression Tasks

inferred← citeshttps://doi.org/10.1109/icdm50108.2020.00030openalex-snapshot

BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search

inferred← citeshttps://doi.org/10.1109/icdm50108.2020.00042openalex-snapshot

Hybrid Context-Aware Word Sense Disambiguation in Topic Modeling Based Document Representation

inferred← citeshttps://doi.org/10.1109/icdm51629.2021.00166openalex-snapshot

Compressibility of Distributed Document Representations

inferred← citeshttps://doi.org/10.1109/icdmw58026.2022.00062openalex-snapshot

Compression Methods for Transformers in Multidomain Sentiment Analysis

inferred← citeshttps://doi.org/10.1109/iceace67491.2025.11439887openalex-snapshot

Efficient Compression of BERT via Knowledge Distillation and Interpolative Decomposition

inferred← citeshttps://doi.org/10.1109/icesit53460.2021.9696948openalex-snapshot

An adaptive knowledge distillation algorithm for text classification

inferred← citeshttps://doi.org/10.1109/icic64337.2024.10957202openalex-snapshot

Compacting Language Model for Natural Language Understanding on English Datasets

inferred← citeshttps://doi.org/10.1109/iciss71466.2026.11715411openalex-snapshot

Distilling Encoder-Decoder and Decoder-Only Models into BERT for NLP Tasks

inferred← citeshttps://doi.org/10.1109/icitisee58992.2023.10405359openalex-snapshot

Abstractive Indonesian News Summarization Using BERT2GPT

inferred← citeshttps://doi.org/10.1109/icm63406.2024.10815822openalex-snapshot

Hardware Accelerator for Bidirectional Encoder Representations from Transformers (BERT)

inferred← citeshttps://doi.org/10.1109/icme59968.2025.11210235openalex-snapshot

Elastic Architecture Search for Efficient Language Models

inferred← citeshttps://doi.org/10.1109/icpr48806.2021.9412192openalex-snapshot

Automatic Student Network Search for Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/icpr48806.2021.9413006openalex-snapshot

Compact CNN Structure Learning by Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/icpr56361.2022.9956259openalex-snapshot

cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation

inferred← citeshttps://doi.org/10.1109/icra57147.2024.10611616openalex-snapshot

FBPT: A Fully Binary Point Transformer

inferred← citeshttps://doi.org/10.1109/icscst70031.2026.11709804openalex-snapshot

Lightweight Transformer Architecture for Real-Time Sentiment Analysis in Edge IoT Systems

inferred← citeshttps://doi.org/10.1109/ictai50040.2020.00075openalex-snapshot

Text Editing for Augmented Distilled BERT

inferred← citeshttps://doi.org/10.1109/ieir62538.2024.10960253openalex-snapshot

Multi-Knowledge Distillation for Constructing Math Word Problem Encoder

inferred← citeshttps://doi.org/10.1109/ijcnn52387.2021.9533328openalex-snapshot

Audio DistilBERT: A Distilled Audio BERT for Speech Representation Learning

inferred← citeshttps://doi.org/10.1109/ijcnn52387.2021.9534402openalex-snapshot

RefBERT: Compressing BERT by Referencing to Pre-computed Representations

showing the first 200 of 610 · page through all 610

Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.