On the public citation graph

A Practical Survey on Faster and Lighter Transformers

0 signed · 222 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/978-3-030-58452-8_13openalex-snapshot
End-to-End Object Detection with Transformers
inferredcites →https://doi.org/10.1007/978-3-642-39593-2_1openalex-snapshot
Deep Learning of Representations: Looking Forward
inferredcites →https://doi.org/10.1016/b978-1-4832-1446-7.50020-0openalex-snapshot
Schemata and Sequential Thought Processes in PDP Models
inferredcites →https://doi.org/10.1016/j.csl.2022.101429openalex-snapshot
On the effect of dropping layers of pre-trained transformer models
inferredcites →https://doi.org/10.1109/asru46091.2019.9003750openalex-snapshot
A Comparative Study on Transformer vs RNN in Speech Applications
inferredcites →https://doi.org/10.1109/cvpr.2016.90openalex-snapshot
Deep Residual Learning for Image Recognition
inferredcites →https://doi.org/10.1109/cvpr.2018.00286openalex-snapshot
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
inferredcites →https://doi.org/10.1109/cvpr.2018.00907openalex-snapshot
Learning Transferable Architectures for Scalable Image Recognition
inferredcites →https://doi.org/10.1109/emc2-nips53020.2019.00016openalex-snapshot
Q8BERT: Quantized 8Bit BERT
inferredcites →https://doi.org/10.1109/icpp.2008.45openalex-snapshot
Challenges and Advances in Parallel Sparse Matrix-Matrix Multiplication
inferredcites →https://doi.org/10.1109/msr52588.2021.00025openalex-snapshot
On Improving Deep Learning Trace Analysis with System Call Arguments
inferredcites →https://doi.org/10.1109/mts.2020.2991496openalex-snapshot
Estimating Carbon Emissions of Artificial Intelligence [Opinion]
inferredcites →https://doi.org/10.1109/slt48900.2021.9383613openalex-snapshot
Transformer-Based Online Speech Recognition with Decoder-end Adaptive Computation Steps
inferredcites →https://doi.org/10.1109/tnnls.2020.3019893openalex-snapshot
Attention in Natural Language Processing
inferredcites →https://doi.org/10.1145/3505244openalex-snapshot
Transformers in Vision: A Survey
inferredcites →https://doi.org/10.1145/3530811openalex-snapshot
Efficient Transformers: A Survey
inferredcites →https://doi.org/10.1162/neco.1991.3.1.79openalex-snapshot
Adaptive Mixtures of Local Experts
inferredcites →https://doi.org/10.1162/neco.1997.9.8.1735openalex-snapshot
Long Short-Term Memory
inferredcites →https://doi.org/10.1162/tacl_a_00290openalex-snapshot
Neural Network Acceptability Judgments
inferredcites →https://doi.org/10.1162/tacl_a_00353openalex-snapshot
Efficient Content-Based Sparse Attention with Routing Transformers
inferredcites →https://doi.org/10.1177/107769905303000401openalex-snapshot
“Cloze Procedure”: A New Tool for Measuring Readability
inferredcites →https://doi.org/10.1609/aaai.v33i01.33014780openalex-snapshot
Regularized Evolution for Image Classifier Architecture Search
inferredcites →https://doi.org/10.1609/aaai.v34i09.7123openalex-snapshot
Energy and Policy Considerations for Modern Deep Learning Research
inferredcites →https://doi.org/10.1609/aaai.v35i16.17664openalex-snapshot
Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.259openalex-snapshot
When BERT Plays the Lottery, All Tickets Are Winning
inferredcites →https://doi.org/10.18653/v1/2020.findings-emnlp.232openalex-snapshot
Blockwise Self-Attention for Long Document Understanding
inferredcites →https://doi.org/10.18653/v1/2020.findings-emnlp.372openalex-snapshot
TinyBERT: Distilling BERT for Natural Language Understanding
inferredcites →https://doi.org/10.18653/v1/2021.emnlp-main.465openalex-snapshot
Do Transformer Modifications Transfer Across Implementations and Applications?
inferredcites →https://doi.org/10.18653/v1/d13-1160openalex-snapshot
Semantic Parsing on Freebase from Question-Answer Pairs
inferredcites →https://doi.org/10.18653/v1/d16-1053openalex-snapshot
Long Short-Term Memory-Networks for Machine Reading
inferredcites →https://doi.org/10.18653/v1/d16-1264openalex-snapshot
SQuAD: 100,000+ Questions for Machine Comprehension of Text
inferredcites →https://doi.org/10.18653/v1/d19-1002openalex-snapshot
Attention is not not Explanation
inferredcites →https://doi.org/10.18653/v1/d19-1374openalex-snapshot
Small and Practical BERT Models for Sequence Labeling
inferredcites →https://doi.org/10.18653/v1/n18-2074openalex-snapshot
Self-Attention with Relative Position Representations
inferredcites →https://doi.org/10.18653/v1/n19-1357openalex-snapshot
Attention is not Explanation
inferredcites →https://doi.org/10.18653/v1/n19-1423openalex-snapshot
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
inferredcites →https://doi.org/10.18653/v1/p18-1027openalex-snapshot
Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context
inferredcites →https://doi.org/10.18653/v1/p19-1032openalex-snapshot
Adaptive Attention Span in Transformers
inferredcites →https://doi.org/10.18653/v1/p19-1285openalex-snapshot
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
inferredcites →https://doi.org/10.18653/v1/p19-1355openalex-snapshot
Energy and Policy Considerations for Deep Learning in NLP
inferredcites →https://doi.org/10.18653/v1/w18-6301openalex-snapshot
Scaling Neural Machine Translation
inferredcites →https://doi.org/10.3115/v1/d14-1179openalex-snapshot
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
inferredcites →https://doi.org/10.3115/v1/w14-3302openalex-snapshot
Findings of the 2014 Workshop on Statistical Machine Translation
inferredcites →https://doi.org/10.4230/lipics.cp.2025.31openalex-snapshot
HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case
inferredcites →https://doi.org/10.4230/tgdk.3.3.5openalex-snapshot
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
inferredcites →https://doi.org/10.48550/arxiv.1305.2982openalex-snapshot
Estimating or Propagating Gradients Through Stochastic Neurons
inferredcites →https://doi.org/10.48550/arxiv.1312.6184openalex-snapshot
Do Deep Nets Really Need to be Deep?
inferredcites →https://doi.org/10.48550/arxiv.1409.3215openalex-snapshot
Sequence to Sequence Learning with Neural Networks
inferredcites →https://doi.org/10.48550/arxiv.1502.03167openalex-snapshot
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
inferredcites →https://doi.org/10.48550/arxiv.1503.02531openalex-snapshot
Distilling the Knowledge in a Neural Network
inferredcites →https://doi.org/10.48550/arxiv.1603.08983openalex-snapshot
Adaptive Computation Time for Recurrent Neural Networks
inferredcites →https://doi.org/10.48550/arxiv.1604.06174openalex-snapshot
Training Deep Nets with Sublinear Memory Cost
inferredcites →https://doi.org/10.48550/arxiv.1611.01578openalex-snapshot
Neural Architecture Search with Reinforcement Learning
inferredcites →https://doi.org/10.48550/arxiv.1706.03762openalex-snapshot
Attention Is All You Need
inferredcites →https://doi.org/10.48550/arxiv.1707.04585openalex-snapshot
The Reversible Residual Network: Backpropagation Without Storing Activations
inferredcites →https://doi.org/10.48550/arxiv.1710.03740openalex-snapshot
Mixed Precision Training
inferredcites →https://doi.org/10.48550/arxiv.1806.09055openalex-snapshot
DARTS: Differentiable Architecture Search
inferredcites →https://doi.org/10.48550/arxiv.1808.05377openalex-snapshot
Neural Architecture Search: A Survey
inferredcites →https://doi.org/10.48550/arxiv.1901.11117openalex-snapshot
The Evolved Transformer
inferredcites →https://doi.org/10.48550/arxiv.1902.10186openalex-snapshot
Attention is not Explanation
inferredcites →https://doi.org/10.48550/arxiv.1904.10509openalex-snapshot
Generating Long Sequences with Sparse Transformers
inferredcites →https://doi.org/10.48550/arxiv.1909.10893openalex-snapshot
Recurrent Independent Mechanisms
inferredcites →https://doi.org/10.48550/arxiv.2001.04451openalex-snapshot
Reformer: The Efficient Transformer
inferredcites →https://doi.org/10.48550/arxiv.2002.06170openalex-snapshot
Transformer on a Diet
inferredcites →https://doi.org/10.48550/arxiv.2002.11296openalex-snapshot
Sparse Sinkhorn Attention
inferredcites →https://doi.org/10.48550/arxiv.2003.10555openalex-snapshot
Beyond FLOPs: Energy-Aware Knowledge Distillation for Sustainable LLMs on Code-Related Task
inferredcites →https://doi.org/10.48550/arxiv.2004.05150openalex-snapshot
Longformer: The Long-Document Transformer
inferredcites →https://doi.org/10.48550/arxiv.2004.07320openalex-snapshot
Training with Quantization Noise for Extreme Model Compression
inferredcites →https://doi.org/10.48550/arxiv.2004.11886openalex-snapshot
Lite Transformer with Long-Short Range Attention
inferredcites →https://doi.org/10.48550/arxiv.2005.00743openalex-snapshot
Synthesizer: Rethinking Self-Attention in Transformer Models
inferredcites →https://doi.org/10.48550/arxiv.2006.04768openalex-snapshot
Conv-Linformer: Boosting Linformer's Performance with Convolution in Small-Scale Settings
inferredcites →https://doi.org/10.48550/arxiv.2006.16236openalex-snapshot
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
inferredcites →https://doi.org/10.48550/arxiv.2008.06808openalex-snapshot
Finding Fast Transformers: One-Shot Neural Architecture Search by Component Composition
inferredcites →https://doi.org/10.48550/arxiv.2010.02916openalex-snapshot
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate
inferredcites →https://doi.org/10.48550/arxiv.2011.13834openalex-snapshot
Transformer-based Online Speech Recognition with Decoder-end Adaptive Computation Steps
inferredcites →https://doi.org/10.48550/arxiv.2101.03961openalex-snapshot
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
inferredcites →https://doi.org/10.48550/arxiv.2103.00336openalex-snapshot
Transformers with Competitive Ensembles of Independent Mechanisms
inferredcites →https://doi.org/10.48550/arxiv.2105.01601openalex-snapshot
MLP-Mixer: An all-MLP Architecture for Vision

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.4751751openalex-extracted
Utranspa: Transformer-Based Network for Sparsely Viewed Photoacoustic Tomography
inferred← citeshttps://doi.org/10.2139/ssrn.4770927openalex-extracted
Comment Sentiment Analysis Using Bidirectional Encoder Representations from Transformers
inferred← citeshttps://doi.org/10.2139/ssrn.4856933openalex-extracted
From Attention to Assurance: Enhancing Transformer Encoder Reliability Through Advanced Testing and Online Error Prediction
inferred← citeshttps://doi.org/10.1002/aelm.202300850openalex-snapshot
Random Projection‐Based Locality‐Sensitive Hashing in a Memristor Crossbar Array with Stochasticity for Sparse Self‐Attention‐Based Transformer
inferred← citeshttps://doi.org/10.1002/wcms.70025openalex-snapshot
Machine Learning Transition State Geometries and Applications in Reaction Property Prediction
inferred← citeshttps://doi.org/10.1007/978-3-031-23190-2_3openalex-snapshot
Improving Pre-trained Language Models
inferred← citeshttps://doi.org/10.1007/978-3-031-78172-8_1openalex-snapshot
TaylorShift: Shifting the Complexity of Self-attention from Squared to Linear (and Back) Using Taylor-Softmax
inferred← citeshttps://doi.org/10.1007/978-3-031-83432-5_9openalex-snapshot
Real-Time Detection of the Colta’s Lagoon Surface Contamination Using a Unmanned Aerial Vehicle (UAV)-Based Machine Learning
inferred← citeshttps://doi.org/10.1007/978-981-95-2345-0_40openalex-snapshot
Development and Testing of a Multi Strategy Fusion Music Recommendation System
inferred← citeshttps://doi.org/10.1007/978-981-97-9327-3_7openalex-snapshot
A Comparative Study of Korean Text Summarization Performance According to Architecture Features of Pre-trained Language Models
inferred← citeshttps://doi.org/10.1007/s00521-025-11226-1openalex-snapshot
NiNformer: a network in network transformer with token mixing generated gating function
inferred← citeshttps://doi.org/10.1007/s10800-026-02505-3openalex-snapshot
Multi-feature fusion and timesnet-transformer-LSTM for multi-step lithium-ion battery state-of-health prediction
inferred← citeshttps://doi.org/10.1007/s11227-022-05009-xopenalex-snapshot
Fast training of a transformer for global multi-horizon time series forecasting on tensor processing units
inferred← citeshttps://doi.org/10.1007/s11227-025-07430-4openalex-snapshot
SVDFormer: lightweight transformer based on singular value decomposition
inferred← citeshttps://doi.org/10.1007/s40747-025-02149-4openalex-snapshot
A knowledge tracing based intelligent framework for formative assessment of students skills
inferred← citeshttps://doi.org/10.1007/s44163-025-00334-5openalex-snapshot
A review of large language models and the recommendation task
inferred← citeshttps://doi.org/10.1016/b978-0-443-32950-0.00010-7openalex-snapshot
Decoding the evolution: artificial intelligence-powered survey of trends in bone regeneration
inferred← citeshttps://doi.org/10.1016/b978-0-443-34266-0.00007-3openalex-snapshot
Intelligent orchestration mechanisms for image workload placement
inferred← citeshttps://doi.org/10.1016/j.aei.2025.103987openalex-snapshot
Cross-domain fault diagnosis of RV reducer rolling bearings based on relative shaft synchronous resampling and adaptive gradient freezing transfer learning
inferred← citeshttps://doi.org/10.1016/j.array.2026.101216openalex-snapshot
Semantic alignment and multimodal fusion in image-text learning: A coupling-aware survey of methods, challenges, and future directions
inferred← citeshttps://doi.org/10.1016/j.atmosenv.2024.120796openalex-snapshot
Estimating 1-km PM2.5 concentrations based on a novel spatiotemporal parallel network STMSPNet in the Beijing-Tianjin-Hebei region
inferred← citeshttps://doi.org/10.1016/j.compbiomed.2025.109721openalex-snapshot
Multimodal deep learning fusion of ultrafast-DCE MRI and clinical information for breast lesion classification
inferred← citeshttps://doi.org/10.1016/j.cosrev.2025.100883openalex-snapshot
A survey of transformer networks for time series forecasting
inferred← citeshttps://doi.org/10.1016/j.enconman.2026.122118openalex-snapshot
Decoupling engine operation from transient loads: a Mamba-based predictive reinforcement learning framework for quasi-steady energy management in gasoline compression ignition hybrid powertrains
inferred← citeshttps://doi.org/10.1016/j.engappai.2024.108231openalex-snapshot
Neural natural language processing for long texts: A survey on classification and summarization
inferred← citeshttps://doi.org/10.1016/j.engappai.2026.113947openalex-snapshot
Transformers meet hyperspectral imaging: A comprehensive study of models, challenges and open problems
inferred← citeshttps://doi.org/10.1016/j.epsr.2026.114134openalex-snapshot
Time series power load forecasting based on PCC-MIC hybrid feature selection and differential attention improved PatchTST
inferred← citeshttps://doi.org/10.1016/j.eswa.2023.122666openalex-snapshot
A comprehensive survey on applications of transformers for deep learning tasks
inferred← citeshttps://doi.org/10.1016/j.eswa.2025.127347openalex-snapshot
Adaptive sparse lightweight multi-scale hybrid network for remote sensing image semantic segmentation
inferred← citeshttps://doi.org/10.1016/j.eswa.2025.129425openalex-snapshot
TFSM: A network for time-frequency synergistic modeling integrating Mamba temporal pathway and spectral features for electricity theft detection
inferred← citeshttps://doi.org/10.1016/j.eswa.2026.133034openalex-snapshot
A classification framework of large language model in the post-transformer era
inferred← citeshttps://doi.org/10.1016/j.heliyon.2024.e40095openalex-snapshot
An explainable deep learning approach for stock market trend prediction
inferred← citeshttps://doi.org/10.1016/j.ifacol.2025.11.247openalex-snapshot
MDM: A Mamba-Conditioned Diffusion Model for Spacecraft Lithium-Ion Battery RUL Prediction
inferred← citeshttps://doi.org/10.1016/j.inffus.2024.102697openalex-snapshot
Transformers in biosignal analysis: A review
inferred← citeshttps://doi.org/10.1016/j.inffus.2026.104507openalex-snapshot
Toward trustworthy digital healthcare: A system-level convergence of IoMT, large language models, and explainable AI
inferred← citeshttps://doi.org/10.1016/j.jelechem.2026.120660openalex-snapshot
State-of-health prediction of lithium-ion batteries: A 1DCNN-iFNetformer framework with DRT feature engineering and learnable Fourier filtering
inferred← citeshttps://doi.org/10.1016/j.jmsy.2025.06.019openalex-snapshot
Skeleton-based action recognition for manufacturing assembly task through graph convolution network
inferred← citeshttps://doi.org/10.1016/j.jwpe.2026.110174openalex-snapshot
A hybrid deep learning model with topology-aware attention for multi-station water quality prediction at basin scale
inferred← citeshttps://doi.org/10.1016/j.mattod.2026.103211openalex-snapshot
Advanced intelligent E-Skin: Multimodal sensing to AI-Driven clinical monitoring
inferred← citeshttps://doi.org/10.1016/j.microc.2025.114483openalex-snapshot
Mamba state space model and transformer model calibrated Raman spectroscopy for real-time multi-objective monitoring in ethanol precipitation process of Guanxinning tablets
inferred← citeshttps://doi.org/10.1016/j.neucom.2025.129987openalex-snapshot
PCSViT: Efficient and hardware friendly Pyramid Vision Transformer with channel and spatial self-attentions
inferred← citeshttps://doi.org/10.1016/j.neucom.2026.133140openalex-snapshot
Compact transformer variants for synthetic time series forecasting
inferred← citeshttps://doi.org/10.1016/j.neunet.2024.106235openalex-snapshot
Multi-tailed vision transformer for efficient inference
inferred← citeshttps://doi.org/10.1016/j.neunet.2025.107846openalex-snapshot
Output contraction analysis of discrete-time nonlinear systems with an application to RNNs
inferred← citeshttps://doi.org/10.1016/j.neunet.2026.109278openalex-snapshot
MCFusion-DDI: Multimodal cross-attention fusion of local-global features and latent drug associations for explainable DDI prediction
inferred← citeshttps://doi.org/10.1016/j.patcog.2025.112502openalex-snapshot
The MERIT dataset: Modelling and efficiently rendering interpretable transcripts
inferred← citeshttps://doi.org/10.1016/j.rineng.2026.112625openalex-snapshot
Transformer-based recognition of fine-grained assembly actions from skeleton data
inferred← citeshttps://doi.org/10.1016/j.rineng.2026.113012openalex-snapshot
Tool wear prediction from ultrashort acoustic emission signals: A computationally efficient machine learning approach in Ti6Al4V machining
inferred← citeshttps://doi.org/10.1016/j.rsase.2026.102151openalex-snapshot
Machine learning approaches for crop yield prediction: A systematic literature review
inferred← citeshttps://doi.org/10.1016/j.sysarc.2023.102990openalex-snapshot
A survey of techniques for optimizing transformer inference
inferred← citeshttps://doi.org/10.1016/j.treng.2021.100087openalex-snapshot
A data-driven model for safety risk identification from flight data analysis
inferred← citeshttps://doi.org/10.1029/2025jh001181openalex-snapshot
Rapid and High‐Accuracy Three‐Dimensional Airborne Transient Electromagnetic Forward Modeling Based on Machine Learning
inferred← citeshttps://doi.org/10.1038/s41598-024-76781-4openalex-snapshot
AIRHF-Net: an adaptive interaction representation hierarchical fusion network for occluded person re-identification
inferred← citeshttps://doi.org/10.1038/s41598-025-32207-3openalex-snapshot
Multi-scale EEG feature decoding with Swin Transformers for subject independent motor imagery BCIs
inferred← citeshttps://doi.org/10.1061/jccee5.cpeng-6388openalex-snapshot
Transformer Hypernetworks for Complex Structural Representation
inferred← citeshttps://doi.org/10.1080/01629778.2025.2587631openalex-snapshot
Chronicling transitions in Baltic media: a longitudinal topic analysis of The Baltic Times ’ coverage from the post-Soviet era to European integration (1998–2024)
inferred← citeshttps://doi.org/10.1088/1361-6501/ae1156openalex-snapshot
Visual navigation via spatio-temporal adaptive attention and meta-variational policy algorithm
inferred← citeshttps://doi.org/10.1088/2632-2153/ae1277openalex-snapshot
An attention-based spatio-temporal neural operator for evolving physics
inferred← citeshttps://doi.org/10.1093/jigpal/jzaf040openalex-snapshot
A didactic overview of Transformer applications: model variations and user guidelines
inferred← citeshttps://doi.org/10.1093/jrsssb/qkae117openalex-snapshot
Prediction sets for high-dimensional mixture of experts models
inferred← citeshttps://doi.org/10.1101/2021.01.16.426955openalex-snapshot
Representation learning for neural population activity with Neural Data Transformers
inferred← citeshttps://doi.org/10.1101/2025.02.10.25322019openalex-snapshot
Automatic Classification of EEG Signals, Based on Image Interpretation of Spatio-Temporal Information
inferred← citeshttps://doi.org/10.1109/access.2022.3212767openalex-snapshot
Neural Architecture Search for Transformers: A Survey
inferred← citeshttps://doi.org/10.1109/access.2023.3335196openalex-snapshot
Deep Representation Learning: Fundamentals, Technologies, Applications, and Open Challenges
inferred← citeshttps://doi.org/10.1109/access.2024.3349952openalex-snapshot
A Survey of Text Classification With Transformers: How Wide? How Large? How Long? How Accurate? How Expensive? How Safe?
inferred← citeshttps://doi.org/10.1109/access.2025.3591505openalex-snapshot
Non-Invasive Glucose Monitoring Using Optical Sensors and Machine Learning: A Predictive Model for Nutritional and Health Assessment
inferred← citeshttps://doi.org/10.1109/access.2025.3611390openalex-snapshot
A Developer’s Guide to Compressing Pre-Trained Transformer Neural Networks Across Different Domains
inferred← citeshttps://doi.org/10.1109/access.2026.3653692openalex-snapshot
Lightweight and Interpretable Transformer-Based Models for Predicting Driving Comfort in Autonomous Vehicles
inferred← citeshttps://doi.org/10.1109/acdsa65407.2025.11166142openalex-snapshot
Heuristic Algorithm for event prediction in Embedded Systems
inferred← citeshttps://doi.org/10.1109/apsec65559.2024.00035openalex-snapshot
Learning Heterogeneous Abstract Code Graph Representations for Program Comprehension
inferred← citeshttps://doi.org/10.1109/bigdata62323.2024.10825888openalex-snapshot
Data Efficient Transformers for Wearable Sensor Analysis in Centralized and Federated Environments
inferred← citeshttps://doi.org/10.1109/bts-i2c63534.2024.10942193openalex-snapshot
Hyperparameter Optimization for Transformer-Based Translation Models on Low-Power Devices
inferred← citeshttps://doi.org/10.1109/cme67420.2025.11239350openalex-snapshot
Real-Time Mortality Prediction for Patients with Trauma-Associated Sepsis Using Interpretable Temporal Algorithms
inferred← citeshttps://doi.org/10.1109/cvprw63382.2024.00031openalex-snapshot
An End-to-End Approach for Handwriting Recognition: From Handwritten Text Lines to Complete Pages
inferred← citeshttps://doi.org/10.1109/eccst68196.2025.11441010openalex-snapshot
The Transformer as a Parametric Filter for Sequence MIMO Equalization
inferred← citeshttps://doi.org/10.1109/embc53108.2024.10782490openalex-snapshot
SLUMBR: SLeep statUs estiMation from aBdominal Respiratory effort
inferred← citeshttps://doi.org/10.1109/esic68176.2026.11496105openalex-snapshot
A Review on Event-Augmented, Audio-Visual Distillation for MicroLip-Reading with Tiny Transformers
inferred← citeshttps://doi.org/10.1109/icassp43922.2022.9747691openalex-snapshot
Conformer-Based Speech Recognition with Linear Nyström Attention and Rotary Position Embedding
inferred← citeshttps://doi.org/10.1109/iccc68654.2025.11437877openalex-snapshot
A Modeling Method for CNC of Machine Tool Kinematics
inferred← citeshttps://doi.org/10.1109/iccmt69755.2026.11608054openalex-snapshot
WDF-Net: A Dual-Path Frequency Domain Water Level Prediction Method Integrating Differentiable Wavelet Transform and Its Application
inferred← citeshttps://doi.org/10.1109/iccraids67816.2026.11519669openalex-snapshot
Stock Market Price Prediction Using a Hybrid LSTM-Transformer Model
inferred← citeshttps://doi.org/10.1109/iccv51070.2023.01604openalex-snapshot
E 2 VPT: An Effective and Efficient Approach for Visual Prompt Tuning
inferred← citeshttps://doi.org/10.1109/icdmw69685.2025.00032openalex-snapshot
A Comparative Study of Pruning Methods in Transformer-Based Time Series Forecasting
inferred← citeshttps://doi.org/10.1109/icitee66631.2025.11338305openalex-snapshot
Fourier Latent Transformer for Anomaly Signal with High-Frequency Reconstruction
inferred← citeshttps://doi.org/10.1109/issre59848.2023.00037openalex-snapshot
Using Transformer Models and Textual Analysis for Log Parsing
inferred← citeshttps://doi.org/10.1109/iswcs69382.2026.11714127openalex-snapshot
Cross-Modal Semantic Fusion and Compression for Multimodal Semantic Communication
inferred← citeshttps://doi.org/10.1109/jbhi.2026.3665532openalex-snapshot
SwitchNet: Adaptive Distribution Switching in UNet for Brain Lesion Segmentation
inferred← citeshttps://doi.org/10.1109/jbhi.2026.3669166openalex-snapshot
BioFPT: Biosignal Feature Pyramid Transformer for Self-Supervised Representation Learning From ECG Signals
inferred← citeshttps://doi.org/10.1109/jiot.2026.3656932openalex-snapshot
A Comprehensive Survey of TinyML-Based Biometric Recognition for IoT Edge Devices
inferred← citeshttps://doi.org/10.1109/jiot.2026.3685406openalex-snapshot
TmsNet: An Efficient Transformer Network Based on Multiscale Shift-Invariance Mechanism for Side-Channel Analysis
inferred← citeshttps://doi.org/10.1109/jsen.2026.3689924openalex-snapshot
SFNet: Sparse Fusion Network for Object Detection of Cross-Modal Images
inferred← citeshttps://doi.org/10.1109/lra.2025.3595025openalex-snapshot
Real-Time Multi-Contact Estimation for Cable-Driven Serial Manipulator
inferred← citeshttps://doi.org/10.1109/mcom.001.2300583openalex-snapshot
Forecasting Trends in Cloud-Edge Computing: Unleashing the Power of Attention Mechanisms
inferred← citeshttps://doi.org/10.1109/ojcoms.2025.3586560openalex-snapshot
Deep-Learning-Based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities
inferred← citeshttps://doi.org/10.1109/ojcs.2025.3538579openalex-snapshot
A Hybrid Temporal Convolutional Network and Transformer Model for Accurate and Scalable Sales Forecasting
inferred← citeshttps://doi.org/10.1109/tcasai.2026.3657358openalex-snapshot
Sparsity-Aware Streaming SNN Accelerator With Output-Channel Dataflow for Automatic Modulation Classification
inferred← citeshttps://doi.org/10.1109/tgrs.2024.3496895openalex-snapshot
MambaDS: Near-Surface Meteorological Field Downscaling With Topography Constrained Selective State-Space Modeling
inferred← citeshttps://doi.org/10.1109/tmlcn.2025.3584009openalex-snapshot
Attention-Driven AI Model Generalization for Workload Forecasting in the Compute Continuum
inferred← citeshttps://doi.org/10.1109/tpami.2023.3243465openalex-snapshot
Video Transformers: A Survey
inferred← citeshttps://doi.org/10.1109/wacv57701.2024.00127openalex-snapshot
OmniVec: Learning robust representations with cross modal sharing
inferred← citeshttps://doi.org/10.1109/wisee57913.2025.11229871openalex-snapshot
Forecasting Self-Similar User Traffic Demand Using Transformers in LEO Satellite Networks
inferred← citeshttps://doi.org/10.1145/3696411openalex-snapshot
A Systematic Review on Graph Neural Network-based Methods for Stock Market Forecasting
inferred← citeshttps://doi.org/10.1145/3706418openalex-snapshot
Resource-efficient Algorithms and Systems of Foundation Models: A Survey
inferred← citeshttps://doi.org/10.1145/3731715.3733432openalex-snapshot
SFi-Former: Sparse Flow Induced Attention for Graph Transformer
inferred← citeshttps://doi.org/10.1145/3744641openalex-snapshot
Deep Learning in Stance Detection: A Survey
inferred← citeshttps://doi.org/10.1145/3785665openalex-snapshot
Adversarial Machine Learning in IoT Security: A Comprehensive Survey
inferred← citeshttps://doi.org/10.1145/3840387openalex-snapshot
Why Transformers? A Comprehensive Overview of Transformers in Artificial Intelligence for IT Operations
inferred← citeshttps://doi.org/10.1162/tacl_a_00547openalex-snapshot
Efficient Long-Text Understanding with Short-Text Models
inferred← citeshttps://doi.org/10.1177/14727978251361403openalex-snapshot
A hybrid approach for long- and short-term time series analysis and prediction combining the Mamba and transformer models
inferred← citeshttps://doi.org/10.1177/15705838251343009openalex-snapshot
Ontology Mapping for Retrieval Augmented Modelling to Reduce Factual Hallucinations in Pretrained Language Model-Based Auto-Generated Questions
inferred← citeshttps://doi.org/10.1186/s13059-025-03638-yopenalex-snapshot
CellMemory: hierarchical interpretation of out-of-distribution cells using bottlenecked transformer
inferred← citeshttps://doi.org/10.1360/ssv-2025-0239openalex-snapshot
Application of artificial intelligence technology in antibody drug design
inferred← citeshttps://doi.org/10.15622/ia.25.5.1openalex-snapshot
A Gumbel-Softmax-Based Approach for Selecting Important Tokens in Self-Attention Mechanism
inferred← citeshttps://doi.org/10.18653/v1/2021.emnlp-main.65openalex-snapshot
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories
inferred← citeshttps://doi.org/10.18653/v1/2022.acl-long.279openalex-snapshot
Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP
inferred← citeshttps://doi.org/10.18653/v1/2022.emnlp-main.823openalex-snapshot
SCROLLS: Standardized CompaRison Over Long Language Sequences
inferred← citeshttps://doi.org/10.18653/v1/2023.emnlp-main.772openalex-snapshot
Focus Your Attention (with Adaptive IIR Filters)
inferred← citeshttps://doi.org/10.2118/231420-paopenalex-snapshot
YoMa-DL: A You Only Look Once-Mamba-Based Intelligent Approach to Drill Cuttings Lithology Identification in Mud Logging
inferred← citeshttps://doi.org/10.2118/233778-paopenalex-snapshot
TCN-Autoformer: A Hybrid Deep Learning Framework for High-Precision Curve Reconstruction
inferred← citeshttps://doi.org/10.21203/rs.3.rs-10690104/v1openalex-snapshot
Research on Rolling Bearing Degradation Modeling and Remaining Useful Life Prediction Based on TCN and an Improved Transformer Algorithm
inferred← citeshttps://doi.org/10.21941/kcss/2023/1openalex-snapshot
Representation Learning for Texts and Graphs
inferred← citeshttps://doi.org/10.30748/soi.2025.180.03openalex-snapshot
АНАЛІЗ МОЖЛИВОСТЕЙ ВДОСКОНАЛЕННЯ АРХІТЕКТУРИ МАШИННОГО НАВЧАННЯ РОЗПІЗНАВАННЯ ЦІЛЕЙ У АВТОНОМНИХ СИСТЕМАХ ОЗБРОЄННЯ
inferred← citeshttps://doi.org/10.30837/2522-9818.2025.2.151openalex-snapshot
Organization of software and neural network algorithms for machine analysis of textual data presented in natural language
inferred← citeshttps://doi.org/10.31219/osf.io/f75wzopenalex-snapshot
Intelligent Digital Agents in the Era of Large Language Models
inferred← citeshttps://doi.org/10.3233/ia-240035openalex-snapshot
Conditional computation in neural networks: Principles and research trends
inferred← citeshttps://doi.org/10.32604/jcs.2024.053954openalex-snapshot
Data-Efficient Image Transformers for Robust Malware Family Classification
inferred← citeshttps://doi.org/10.3390/app13179530openalex-snapshot
F-ALBERT: A Distilled Model from a Two-Time Distillation System for Reduced Computational Complexity in ALBERT Model
inferred← citeshttps://doi.org/10.3390/app14041325openalex-snapshot
Enhancing Emotion Recognition through Federated Learning: A Multimodal Approach with Convolutional Neural Networks
inferred← citeshttps://doi.org/10.3390/app14104316openalex-snapshot
A Historical Survey of Advances in Transformer Architectures
inferred← citeshttps://doi.org/10.3390/app16199827openalex-snapshot
MIFARec: Mixed-Interest-Based Fourier Analysis Network for Time-Specific Recommendation
inferred← citeshttps://doi.org/10.3390/axioms13030187openalex-snapshot
Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics
inferred← citeshttps://doi.org/10.3390/electronics13204134openalex-snapshot
Feasibility of Transformer Model for User Authentication Using Electromyogram Signals
inferred← citeshttps://doi.org/10.3390/electronics14183687openalex-snapshot
Integrating Temporal Interest Dynamics and Virality Factors for High-Precision Ranking in Big Data Recommendation
inferred← citeshttps://doi.org/10.3390/fractalfract9090603openalex-snapshot
Bidirectional Mamba-Enhanced 3D Human Pose Estimation for Accurate Clinical Gait Analysis
inferred← citeshttps://doi.org/10.3390/land15010092openalex-snapshot
Fine-Grained Classification of Lakeshore Wetland–Cropland Mosaics via Multimodal RS Data Fusion and Weakly Supervised Learning: A Case Study of Bosten Lake, China
inferred← citeshttps://doi.org/10.3390/su16083367openalex-snapshot
Identification of Perceived Challenges in the Green Energy Transition by Turkish Society through Sentiment Analysis
inferred← citeshttps://doi.org/10.36227/techrxiv.24467740openalex-snapshot
Forecasting Trends in Cloud/Edge Computing: Unleashing the Power of Attention Mechanisms
inferred← citeshttps://doi.org/10.37394/23205.2026.25.15openalex-snapshot
Understanding Vision Transformers through Intuition and Simple Visual Examples
inferred← citeshttps://doi.org/10.48550/arxiv.2106.05822openalex-snapshot
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures
inferred← citeshttps://doi.org/10.48550/arxiv.2110.03450openalex-snapshot
Efficient and Private Federated Learning with Partially Trainable Networks
inferred← citeshttps://doi.org/10.51628/001c.27358openalex-snapshot
Representation learning for neural population activity with Neural Data Transformers
inferred← citeshttps://doi.org/10.52058/2786-6025-2024-7(35)-698-709openalex-snapshot
ВПРОВАДЖЕННЯ ПРОГРАМНИХ ТА НЕЙРОМЕРЕЖЕВИХ АЛГОРИТМІВ МАШИННОГО АНАЛІЗУ ТЕКСТОВИХ ДАНИХ ФІНАНСОВОЇ АНАЛІТИКИ
inferred← citeshttps://doi.org/10.52058/2786-6300-2024-8(26)-187-198openalex-snapshot
ОСОБЛИВОСТІ ЗАСТОСУВАННЯ СИСТЕМ МАШИННОГО АНАЛІЗУ ПРИ ПІДГОТОВЦІ МАРКЕТИНГОВОГО КОНТЕНТУ
inferred← citeshttps://doi.org/10.62370/hbds.v25i3.276177openalex-snapshot
Enhancing Multi-Object Tracking with Compact Model Adjustment
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.