On the public citation graph

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

0 signed · 175 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/(sici)1096-9128(199704)9:4<255::aid-cpe250>3.0.co;2-2openalex-snapshot
SUMMA: scalable universal matrix multiplication algorithm
inferredcites →https://doi.org/10.1016/j.cviu.2023.103838openalex-snapshot
Constituent Attention for Vision Transformers
inferredcites →https://doi.org/10.1109/cvpr52688.2022.01055openalex-snapshot
MetaFormer is Actually What You Need for Vision
inferredcites →https://doi.org/10.1109/hpca53966.2022.00082openalex-snapshot
TransPIM: A Memory-based Acceleration via Software-Hardware Co-Design for Transformer
inferredcites →https://doi.org/10.1109/icpr.2016.7900006openalex-snapshot
BranchyNet: Fast inference via early exiting from deep neural networks
inferredcites →https://doi.org/10.1109/iiswc55918.2022.00018openalex-snapshot
Accelerating Transformer Networks through Recomposing Softmax Layers
inferredcites →https://doi.org/10.1109/ijcnn54540.2023.10191067openalex-snapshot
A Scalable GPT-2 Inference Hardware Architecture on FPGA
inferredcites →https://doi.org/10.1109/ipdps54959.2023.00042openalex-snapshot
ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputs
inferredcites →https://doi.org/10.1109/ipdpsw63119.2024.00208openalex-snapshot
System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
inferredcites →https://doi.org/10.1109/isca45697.2020.00045openalex-snapshot
MLPerf Inference Benchmark
inferredcites →https://doi.org/10.1109/isca59077.2024.00019openalex-snapshot
Splitwise: Efficient Generative LLM Inference Using Phase Splitting
inferredcites →https://doi.org/10.1109/sc41404.2022.00051openalex-snapshot
DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale
inferredcites →https://doi.org/10.1109/sc41405.2020.00073openalex-snapshot
BATCH: Machine Learning Inference Serving on Serverless Platforms with Adaptive Batching
inferredcites →https://doi.org/10.1109/scw63240.2024.00178openalex-snapshot
LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
inferredcites →https://doi.org/10.1109/tc.1985.6312218openalex-snapshot
Speculative computation, parallelism, and functional programming
inferredcites →https://doi.org/10.1109/tpami.2023.3277122openalex-snapshot
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond
inferredcites →https://doi.org/10.1145/3315508.3329973openalex-snapshot
Triton: an intermediate language and compiler for tiled neural network computations
inferredcites →https://doi.org/10.1145/3320060openalex-snapshot
Demystifying Parallel and Distributed Deep Learning
inferredcites →https://doi.org/10.1145/3341301.3359630openalex-snapshot
TASO
inferredcites →https://doi.org/10.1145/3363554openalex-snapshot
Scalable Deep Learning on Distributed Infrastructures
inferredcites →https://doi.org/10.1145/3437801.3441578openalex-snapshot
TurboTransformers
inferredcites →https://doi.org/10.1145/3487045openalex-snapshot
Compression of Deep Learning Models for Text: A Survey
inferredcites →https://doi.org/10.1145/3497776.3517770openalex-snapshot
MLIR-based code generation for GPU tensor cores
inferredcites →https://doi.org/10.1145/3503221.3508418openalex-snapshot
FasterMoE
inferredcites →https://doi.org/10.1145/3530811openalex-snapshot
Efficient Transformers: A Survey
inferredcites →https://doi.org/10.1145/3552326.3587438openalex-snapshot
Tabi: An Efficient Multi-Level Inference System for Large Language Models
inferredcites →https://doi.org/10.1145/3575693.3575698openalex-snapshot
STI: Turbocharge NLP Inference at the Edge via Elastic Pipelining
inferredcites →https://doi.org/10.1145/3575693.3576933openalex-snapshot
TensorIR: An Abstraction for Automatic Tensorized Program Optimization
inferredcites →https://doi.org/10.1145/3579371.3589350openalex-snapshot
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings
inferredcites →https://doi.org/10.1145/3579990.3583093openalex-snapshot
PyTorch 2.0: The Journey to Bringing Compiler Technologies to the Core of PyTorch (Keynote)
inferredcites →https://doi.org/10.1145/3580305.3599572openalex-snapshot
Towards Next-Generation Intelligent Assistants Leveraging LLM Techniques
inferredcites →https://doi.org/10.1145/3581784.3607102openalex-snapshot
Calculon: a methodology and tool for high-level co-design of systems and large language models
inferredcites →https://doi.org/10.1145/3582016.3582047openalex-snapshot
SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning
inferredcites →https://doi.org/10.1145/3588964openalex-snapshot
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement
inferredcites →https://doi.org/10.1145/3600006.3613139openalex-snapshot
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
inferredcites →https://doi.org/10.1145/3600006.3613163openalex-snapshot
Paella: Low-latency Model Serving with Software-defined GPU Scheduling
inferredcites →https://doi.org/10.1145/3600006.3613165openalex-snapshot
Efficient Memory Management for Large Language Model Serving with PagedAttention
inferredcites →https://doi.org/10.1145/3617689openalex-snapshot
Improving Computation and Memory Efficiency for Real-world Transformer Inference on GPUs
inferredcites →https://doi.org/10.1145/3620665.3640383openalex-snapshot
ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference
inferredcites →https://doi.org/10.1145/3620665.3640411openalex-snapshot
SpotServe: Serving Generative Large Language Models on Preemptible Instances
inferredcites →https://doi.org/10.1145/3620666.3651335openalex-snapshot
SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification
inferredcites →https://doi.org/10.1145/3626246.3654683openalex-snapshot
Demystifying Data Management for Large Language Models
inferredcites →https://doi.org/10.1145/3669940.3707215openalex-snapshot
Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow
inferredcites →https://doi.org/10.1145/3669940.3707220openalex-snapshot
GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism
inferredcites →https://doi.org/10.1145/3669940.3707256openalex-snapshot
vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention
inferredcites →https://doi.org/10.1145/3676641.3716249openalex-snapshot
Relax: Composable Abstractions for End-to-End Dynamic Machine Learning
inferredcites →https://doi.org/10.1145/3689031.3696072openalex-snapshot
Fast State Restoration in LLM Serving with HCache
inferredcites →https://doi.org/10.1145/3694715.3695948openalex-snapshot
LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism
inferredcites →https://doi.org/10.1145/3694715.3695964openalex-snapshot
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
inferredcites →https://doi.org/10.1145/3714983.3714987openalex-snapshot
AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
inferredcites →https://doi.org/10.1162/tacl_a_00353openalex-snapshot
Efficient Content-Based Sparse Attention with Routing Transformers
inferredcites →https://doi.org/10.1162/tacl_a_00577openalex-snapshot
Efficient Methods for Natural Language Processing: A Survey
inferredcites →https://doi.org/10.1162/tacl_a_00735openalex-snapshot
OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure
inferredcites →https://doi.org/10.1201/9781003162810-13openalex-snapshot
A Survey of Quantization Methods for Efficient Neural Network Inference
inferredcites →https://doi.org/10.14218/jcth.2022.00006sopenalex-snapshot
Diagnostic and Prognostic Value of Protein Post-Translational Modifications in Hepatocellular Carcinoma
inferredcites →https://doi.org/10.14722/ndss.2025.230057openalex-snapshot
BumbleBee: Secure Two-party Inference Framework for Large Transformers
inferredcites →https://doi.org/10.14778/3626292.3626303openalex-snapshot
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
inferredcites →https://doi.org/10.1609/aaai.v33i01.33013723openalex-snapshot
Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input
inferredcites →https://doi.org/10.1609/aaai.v35i12.17325openalex-snapshot
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
inferredcites →https://doi.org/10.1609/aaai.v35i15.17572openalex-snapshot
An Efficient Transformer Decoder with Compressed Sub-layers
inferredcites →https://doi.org/10.18653/v1/2020.acl-main.204openalex-snapshot
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
inferredcites →https://doi.org/10.18653/v1/2020.acl-main.537openalex-snapshot
FastBERT: a Self-distilling BERT with Adaptive Inference Time
inferredcites →https://doi.org/10.18653/v1/2020.findings-emnlp.372openalex-snapshot
TinyBERT: Distilling BERT for Natural Language Understanding
inferredcites →https://doi.org/10.18653/v1/2021.emnlp-main.406openalex-snapshot
Consistent Accelerated Inference via Confident Adaptive Transformers
inferredcites →https://doi.org/10.18653/v1/2021.findings-acl.11openalex-snapshot
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade
inferredcites →https://doi.org/10.18653/v1/2021.findings-emnlp.304openalex-snapshot
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference
inferredcites →https://doi.org/10.18653/v1/2021.findings-emnlp.43openalex-snapshot
CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
inferredcites →https://doi.org/10.18653/v1/2021.naacl-main.162openalex-snapshot
A Global Past-Future Early Exit Method for Accelerating Inference of Pre-trained Language Models
inferredcites →https://doi.org/10.18653/v1/2021.naacl-main.463openalex-snapshot
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference
inferredcites →https://doi.org/10.18653/v1/2021.sustainlp-1.5openalex-snapshot
Memory-efficient Transformers via Top-k Attention
inferredcites →https://doi.org/10.18653/v1/2023.acl-demo.54openalex-snapshot
Petals: Collaborative Inference and Fine-tuning of Large Models
inferredcites →https://doi.org/10.18653/v1/2023.acl-long.689openalex-snapshot
Accelerating Transformer Inference for Translation via Parallel Decoding
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.232openalex-snapshot
Adapting Language Models to Compress Contexts
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.298openalex-snapshot
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.391openalex-snapshot
Compressing Context to Enhance Inference Efficiency of Large Language Models
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.825openalex-snapshot
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
inferredcites →https://doi.org/10.18653/v1/2023.findings-emnlp.183openalex-snapshot
Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer
inferredcites →https://doi.org/10.18653/v1/2023.findings-emnlp.936openalex-snapshot
RWKV: Reinventing RNNs for the Transformer Era
inferredcites →https://doi.org/10.18653/v1/2023.iwslt-1.47openalex-snapshot
DePA: Improving Non-autoregressive Translation with Dependency-Aware Decoder
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.172openalex-snapshot
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.607openalex-snapshot
Draft& Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.678openalex-snapshot
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.91openalex-snapshot
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
inferredcites →https://doi.org/10.18653/v1/2024.eacl-demo.23openalex-snapshot
LLMeBench: A Flexible Framework for Accelerating LLMs Benchmarking
inferredcites →https://doi.org/10.18653/v1/2024.eacl-long.4openalex-snapshot
Generating Benchmarks for Factuality Evaluation of Language Models
inferredcites →https://doi.org/10.18653/v1/2024.emnlp-main.742openalex-snapshot
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding
inferredcites →https://doi.org/10.18653/v1/2025.naacl-long.601openalex-snapshot
Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
inferredcites →https://doi.org/10.18653/v1/d18-1149openalex-snapshot
Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement
inferredcites →https://doi.org/10.18653/v1/d19-1223openalex-snapshot
Adaptively Sparse Transformers
inferredcites →https://doi.org/10.18653/v1/d19-1441openalex-snapshot
Patient Knowledge Distillation for BERT Model Compression
inferredcites →https://doi.org/10.18653/v1/d19-1633openalex-snapshot
Mask-Predict: Parallel Decoding of Conditional Masked Language Models
inferredcites →https://doi.org/10.18653/v1/n19-1133openalex-snapshot
Star-Transformer
inferredcites →https://doi.org/10.18653/v1/p17-2091openalex-snapshot
Speeding Up Neural Machine Translation Decoding by Shrinking Run-time Vocabulary
inferredcites →https://doi.org/10.18653/v1/p18-1027openalex-snapshot
Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context
inferredcites →https://doi.org/10.21437/interspeech.2014-80openalex-snapshot
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
inferredcites →https://doi.org/10.24963/ijcai.2019/735openalex-snapshot
Sharing Attention Weights for Fast Transformer
inferredcites →https://doi.org/10.2737/fpl-gtr-290openalex-snapshot
Proceedings
inferredcites →https://doi.org/10.48550/arxiv.1802.09941openalex-snapshot
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
inferredcites →https://doi.org/10.48550/arxiv.1903.11314openalex-snapshot
Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools
inferredcites →https://doi.org/10.48550/arxiv.2002.10957openalex-snapshot
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
inferredcites →https://doi.org/10.48550/arxiv.2105.01601openalex-snapshot
MLP-Mixer: An all-MLP Architecture for Vision
inferredcites →https://doi.org/10.48550/arxiv.2106.04426openalex-snapshot
Hash Layers For Large Sparse Models
inferredcites →https://doi.org/10.48550/arxiv.2201.11903openalex-snapshot
BNAI, NO-TOKEN, and MIND-UNITY: Pillars of a Systemic Revolution in Artificial Intelligence
inferredcites →https://doi.org/10.48550/arxiv.2205.05198openalex-snapshot
Reducing Activation Recomputation in Large Transformer Models
inferredcites →https://doi.org/10.48550/arxiv.2206.03382openalex-snapshot
Tutel: Adaptive Mixture-of-Experts at Scale
inferredcites →https://doi.org/10.48550/arxiv.2211.05102openalex-snapshot
Efficiently Scaling Transformer Inference
inferredcites →https://doi.org/10.48550/arxiv.2211.15841openalex-snapshot
MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
inferredcites →https://doi.org/10.48550/arxiv.2310.19102openalex-snapshot
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
inferredcites →https://doi.org/10.52202/068431-0515openalex-snapshot
Mixture-Of-Experts with Expert Choice Routing
inferredcites →https://doi.org/10.52202/068431-1970openalex-snapshot
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1002/spe.70069openalex-snapshot
Perspectives On Machine Learning Inference Serving in Real‐World Settings
inferred← citeshttps://doi.org/10.1007/978-3-032-23304-2_27openalex-snapshot
Adaptive Network-Aware Scheduling Extension for Mixture-of-Experts Model Deployments in Kubernetes with RoCE and GPUDirect RDMA
inferred← citeshttps://doi.org/10.1007/978-3-032-26211-0_18openalex-snapshot
AnyScale Inference for Enterprise Chatbots: Carbon- and Cost-Aware Geo-Shifting Across Heterogeneous Accelerators
inferred← citeshttps://doi.org/10.1007/978-981-95-2725-0_16openalex-snapshot
Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models
inferred← citeshttps://doi.org/10.1007/s11704-024-40678-2openalex-snapshot
Tool learning with large language models: a survey
inferred← citeshttps://doi.org/10.1016/b978-0-443-45022-8.00017-6openalex-snapshot
Implementation guidelines
inferred← citeshttps://doi.org/10.1016/j.cor.2026.107568openalex-snapshot
Joint package design and compute resource allocation for large language model-as-a-service with endogenous consumer demand
inferred← citeshttps://doi.org/10.1016/j.cosrev.2025.100755openalex-snapshot
Empowering large language models to edge intelligence: A survey of edge efficient LLMs and techniques
inferred← citeshttps://doi.org/10.1016/j.cpes.2026.04.003openalex-snapshot
Optimization of renewable-integrated energy systems via artificial intelligence: Review and perspective
inferred← citeshttps://doi.org/10.1016/j.eswa.2025.127305openalex-snapshot
BiTA: Bi-directional tuning for lossless acceleration in large language models
inferred← citeshttps://doi.org/10.1016/j.iot.2026.102020openalex-snapshot
Small language models for on-device IoT intelligence: A survey on architectures, optimization, and deployment
inferred← citeshttps://doi.org/10.1016/j.knosys.2026.115311openalex-snapshot
Grouped query attention supported with graph-based query clustering
inferred← citeshttps://doi.org/10.1016/j.neucom.2024.128791openalex-snapshot
A review of AI edge devices and lightweight CNN and LLM deployment
inferred← citeshttps://doi.org/10.1016/j.parco.2026.103216openalex-snapshot
SmartBatchLLM: An efficient adaptive hybrid batching strategy for large language model serving
inferred← citeshttps://doi.org/10.1016/j.procs.2026.04.214openalex-snapshot
Intelligent Question Answering System Architecture Driven by Large Models and Structured Knowledge Base
inferred← citeshttps://doi.org/10.1016/j.sysarc.2025.103359openalex-snapshot
GTA: Generating high-performance tensorized program with dual-task scheduling
inferred← citeshttps://doi.org/10.1080/0144929x.2026.2734081openalex-snapshot
Influence of personality traits on employee’ adoption of generative AI: a qualitative comparative analysis
inferred← citeshttps://doi.org/10.1088/1757-899x/1342/1/012064openalex-snapshot
Developing RAGs for robot code generation
inferred← citeshttps://doi.org/10.1109/access.2024.3501358openalex-snapshot
Efficient LLMs Training and Inference: An Introduction
inferred← citeshttps://doi.org/10.1109/access.2026.3664226openalex-snapshot
Minimizing Response Latency in LLM-Based Agent Systems: A Comprehensive Survey
inferred← citeshttps://doi.org/10.1109/bigdata62323.2024.10826121openalex-snapshot
Performance Characterization of Expert Router for Scalable LLM Inference
inferred← citeshttps://doi.org/10.1109/ccnc65079.2026.11366259openalex-snapshot
Toward Cost-Efficient LLM Serving: A System-Level Memory Optimization Approach
inferred← citeshttps://doi.org/10.1109/cloud72782.2026.00037openalex-snapshot
BYSTANDER: State-Aware End-to-End Latency Prediction for Heterogeneous LLM Inference Scheduling
inferred← citeshttps://doi.org/10.1109/cloud72782.2026.00049openalex-snapshot
Design Methodology and Performance Trade-offs Management for Distributed and Compound AI Systems
inferred← citeshttps://doi.org/10.1109/compsac69091.2026.00029openalex-snapshot
Energy-Efficient LLM Inference with SLA-Constrained Adaptive GPU Power Capping
inferred← citeshttps://doi.org/10.1109/iaecst64597.2024.11117374openalex-snapshot
Research on Detection Methods for Adversarial Capability of Artificial Intelligence Software
inferred← citeshttps://doi.org/10.1109/icera72709.2026.11666706openalex-snapshot
Kairos: SLO-Aware Scheduling and a Benchmark for Multi-Tenant LLM Inference Serving under Bursty, Heterogeneous Load
inferred← citeshttps://doi.org/10.1109/icicc71012.2026.11637729openalex-snapshot
Difficulty-Aware Hybrid Routing for Cost-Efficient Long-Context LLM Inference
inferred← citeshttps://doi.org/10.1109/iciis69028.2026.11450920openalex-snapshot
Evaluate the Effectiveness of Leveraging Loan Advisory Service with AI-Powered Chatbot Technology in the Sri Lankan Context
inferred← citeshttps://doi.org/10.1109/icima68728.2026.11564766openalex-snapshot
Enabling Real-Time AI at the Edge: A Comparative Analysis of Latency and Accuracy in Sub-3B Parameter Models
inferred← citeshttps://doi.org/10.1109/icme59968.2025.11210229openalex-snapshot
Dialogue Director: Bridging the Gap in Dialogue Visualization for Multimodal Storytelling
inferred← citeshttps://doi.org/10.1109/icoict71118.2026.11664754openalex-snapshot
UTARI: An On-Prem GPU-Accelerated LLM Platform for Higher-Education Services
inferred← citeshttps://doi.org/10.1109/icws67624.2025.00046openalex-snapshot
CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration
inferred← citeshttps://doi.org/10.1109/infocom59046.2026.11571388openalex-snapshot
CoSine: Enhancing LLM Serving via Collaborative and Decoupled Speculative Inference
inferred← citeshttps://doi.org/10.1109/infocom59046.2026.11571484openalex-snapshot
MoVi: Real-Time Large Multimodal Model-Driven Interactive Video Analytics on Mobile Devices
inferred← citeshttps://doi.org/10.1109/isiber68248.2026.11469930openalex-snapshot
Optimizing LLM Inference with Language-Aware Multi-Bin Batching for Code Summarization
inferred← citeshttps://doi.org/10.1109/issre66568.2025.00044openalex-snapshot
An Empirical Study of Production Incidents in Generative AI Cloud Services
inferred← citeshttps://doi.org/10.1109/jiot.2026.3657494openalex-snapshot
Coconut: Multilevel Collaborative Deployment for Real-Time Deep Learning Tasks in Heterogeneous Edge GPU Cluster
inferred← citeshttps://doi.org/10.1109/jiot.2026.3710272openalex-snapshot
EC-LLM: Low-Cost, Low-Latency, High-Quality Large Language Model Inference Based on Edge--Cloud Collaboration
inferred← citeshttps://doi.org/10.1109/micro61859.2024.00108openalex-snapshot
Cambricon-LLM: A Chiplet-Based Hybrid Architecture for On-Device Inference of 70B LLM
inferred← citeshttps://doi.org/10.1109/raeeucci61380.2024.10547860openalex-snapshot
Augmented Reality Navigation: A Vision for Safer Roads and Seamless Driving Experience
inferred← citeshttps://doi.org/10.1109/rita.2026.3701046openalex-snapshot
Optimizing Open Large Language Models for Equity and Accessibility in Higher Education Through Pruning and Retrieval-Augmented Generation
inferred← citeshttps://doi.org/10.1109/roedunet68395.2025.11208510openalex-snapshot
HectorIDE: A Document Centric Platform for AI Powered Software Development
inferred← citeshttps://doi.org/10.1109/tmc.2025.3622698openalex-snapshot
Cola: Cross-Processor Operator Parallelism for Asynchronous Deep Learning Inference
inferred← citeshttps://doi.org/10.1109/tmc.2026.3656318openalex-snapshot
EAT: QoS-Aware Edge-Collaborative AIGC Task Scheduling via Attention-Guided Diffusion Reinforcement Learning
inferred← citeshttps://doi.org/10.1109/tmc.2026.3697502openalex-snapshot
CALSI: Context-Aware Layer Skipping Inference for On-Device LLM Serving
inferred← citeshttps://doi.org/10.1109/tvcg.2025.3574194openalex-snapshot
ASight: Fine-Tuning Auto-Scheduling Optimizations for Model Deployment via Visual Analytics
inferred← citeshttps://doi.org/10.1145/3642970.3655835openalex-snapshot
Deferred Continuous Batching in Resource-Efficient Large Language Model Serving
inferred← citeshttps://doi.org/10.1145/3658617.3697648openalex-snapshot
Learning to Prune and Low-Rank Adaptation for Compact Language Model Deployment
inferred← citeshttps://doi.org/10.1145/3706418openalex-snapshot
Resource-efficient Algorithms and Systems of Foundation Models: A Survey
inferred← citeshttps://doi.org/10.1145/3799457.3799547openalex-snapshot
The Impact of Artificial Intelligence Literacy on Students’ Social-Emotional Competence: An Empirical Study Using Random Forest Feature Importance Modeling
inferred← citeshttps://doi.org/10.1145/3805621.3807623openalex-snapshot
A Case for a Simulation-Driven Exploration of Distributed GenAI Platforms
inferred← citeshttps://doi.org/10.1145/3805621.3807633openalex-snapshot
Sampling Where It Matters: Predicting LLM Serving Performance
inferred← citeshttps://doi.org/10.1145/3805621.3807653openalex-snapshot
With a Hop, Skip, and a Prefill: How Benchmark Volatility Distorts the Accuracy of Long-Context Benchmarks and How To Combat It
inferred← citeshttps://doi.org/10.1145/3805712.3809737openalex-snapshot
Deja Vu in Plots: Leveraging Cross-Session Evidence with Retrieval-Augmented LLMs for Live Streaming Risk Assessment
inferred← citeshttps://doi.org/10.1145/3809166openalex-snapshot
Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities
inferred← citeshttps://doi.org/10.1145/3832810.3832894openalex-snapshot
Cross-Layer Performance Analysis of Single-GPU Large Language Model Inference
inferred← citeshttps://doi.org/10.14778/3827998.3828107openalex-snapshot
RSR-core: A High-Performance Engine for Low-Bit Matrix-Vector Multiplication
inferred← citeshttps://doi.org/10.21203/rs.3.rs-4063228/v1openalex-snapshot
Efficiency in Language Understanding and Generation: An Evaluation of Four Open-Source Large Language Models
inferred← citeshttps://doi.org/10.2139/ssrn.5365971openalex-snapshot
Context is King: From Prompt Engineering to Context Engineering in Healthcare AI
inferred← citeshttps://doi.org/10.22399/ijcesen.5049openalex-snapshot
AI Runtime Infrastructure: Establishing a Foundational Layer for Distributed AI Systems
inferred← citeshttps://doi.org/10.23919/cje.2024.00.070openalex-snapshot
A Survey on the Scheduling of DL and LLM Training Jobs in GPU Clusters
inferred← citeshttps://doi.org/10.3390/math13223689openalex-snapshot
Rethinking I/O Caching for Large Language Model Inference on Resource-Constrained Mobile Platforms
inferred← citeshttps://doi.org/10.36227/techrxiv.171665607.76504195/v1openalex-snapshot
Reducing LLM Hallucination Using Knowledge Distillation: A Case Study with Mistral Large and MMLU Benchmark
inferred← citeshttps://doi.org/10.5753/sbrc.2026.19707openalex-snapshot
Melhorando a Eficiência Energética na Execução de LLMs via Controle de Potência de GPUs Orientado por SLAs
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.