On the public citation graph

A deep recurrent Q network towards self‐adapting distributed microservice architecture

https://doi.org/10.1002/spe.2778
0 signed · 71 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1006/jfan.1995.1084openalex-snapshot
On the Ornstein-Uhlenbeck Operator in Spaces of Continuous Functions
inferredcites →https://doi.org/10.1007/978-1-4615-3618-5_2openalex-snapshot
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
inferredcites →https://doi.org/10.1007/978-3-030-04771-9_28openalex-snapshot
Using Reinforcement Learning to Handle the Runtime Uncertainties in Self-adaptive Software
inferredcites →https://doi.org/10.1007/978-3-319-46454-1_30openalex-snapshot
Look-Ahead Before You Leap: End-to-End Active Recognition by Forecasting the Effect of Motion
inferredcites →https://doi.org/10.1007/978-3-319-71682-4_5openalex-snapshot
Cooperative Multi-agent Control Using Deep Reinforcement Learning
inferredcites →https://doi.org/10.1007/978-3-540-88871-0_46openalex-snapshot
Optimizing the Utility Function-Based Self-adaptive Behavior of Context-Aware Systems Using User Feedback
inferredcites →https://doi.org/10.1007/978-3-642-02161-9_1openalex-snapshot
Software Engineering for Self-Adaptive Systems: A Research Roadmap
inferredcites →https://doi.org/10.1007/978-3-642-27645-3_7openalex-snapshot
Reinforcement Learning in Continuous State and Action Spaces
inferredcites →https://doi.org/10.1007/978-3-642-35813-5_1openalex-snapshot
Software Engineering for Self-Adaptive Systems: A Second Research Roadmap
inferredcites →https://doi.org/10.1007/b136551openalex-snapshot
Self-star Properties in Complex Information Systems
inferredcites →https://doi.org/10.1007/bf00992696openalex-snapshot
Simple statistical gradient-following algorithms for connectionist reinforcement learning
inferredcites →https://doi.org/10.1016/j.future.2017.09.050openalex-snapshot
MiCADO—Microservice-based Cloud Application-level Dynamic Orchestrator
inferredcites →https://doi.org/10.1038/nature16961openalex-snapshot
Mastering the game of Go with deep neural networks and tree search
inferredcites →https://doi.org/10.1109/5254.769885openalex-snapshot
An architecture-based approach to self-adaptive software
inferredcites →https://doi.org/10.1109/cvpr.2017.148openalex-snapshot
Action-Decision Networks for Visual Tracking with Deep Reinforcement Learning
inferredcites →https://doi.org/10.1109/dasc.2011.31openalex-snapshot
Self-Adaptive Authorization Framework for Policy Based RBAC/ABAC Models
inferredcites →https://doi.org/10.1109/icas.2008.35openalex-snapshot
Adaptive Action Selection in Autonomic Software Using Reinforcement Learning
inferredcites →https://doi.org/10.1109/iccv.2015.286openalex-snapshot
Active Object Localization with Deep Reinforcement Learning
inferredcites →https://doi.org/10.1109/icws.2007.186openalex-snapshot
Utility-based QoS Brokering in Service Oriented Architectures
inferredcites →https://doi.org/10.1109/mic.2007.21openalex-snapshot
Reinforcement Learning in Autonomic Computing: A Manifesto and Case Studies
inferredcites →https://doi.org/10.1109/qosa.2016.13openalex-snapshot
Fuzzy Self-Learning Controllers for Elasticity Management in Dynamic Cloud Architectures
inferredcites →https://doi.org/10.1109/seams.2009.5069076openalex-snapshot
Reinforcement learning-based dynamic adaptation planning method for architecture-based self-managed software
inferredcites →https://doi.org/10.1109/seams.2009.5069082openalex-snapshot
Evaluating the effectiveness of the Rainbow self-adaptive system
inferredcites →https://doi.org/10.1109/step.2005.6openalex-snapshot
A Policy-Based Decision Making Approach for Orchestrating Autonomic Elements
inferredcites →https://doi.org/10.1109/tgrs.2016.2636241openalex-snapshot
Deep Recurrent Neural Networks for Hyperspectral Image Classification
inferredcites →https://doi.org/10.1109/tnn.1998.712192openalex-snapshot
Reinforcement Learning: An Introduction
inferredcites →https://doi.org/10.1109/tsc.2016.2528246openalex-snapshot
Imperfect Information Dynamic Stackelberg Game Based Resource Allocation Using Hidden Markov for Cloud Computing
inferredcites →https://doi.org/10.1109/tsmcc.2007.913919openalex-snapshot
A Comprehensive Survey of Multiagent Reinforcement Learning
inferredcites →https://doi.org/10.1145/1075405.1075413openalex-snapshot
Self-managed decentralised systems using K-components and collaborative reinforcement learning
inferredcites →https://doi.org/10.1145/1141277.1141444openalex-snapshot
Distributed context management in a mobility and adaptation enabling middleware (MADAM)
inferredcites →https://doi.org/10.1145/1352678.1352688openalex-snapshot
Context-oriented programming
inferredcites →https://doi.org/10.1145/1376866.1376872openalex-snapshot
Self-adaptation of event-driven component-oriented middleware using aspects of assembly
inferredcites →https://doi.org/10.1145/1453101.1453136openalex-snapshot
Model-based fault detection in context-aware adaptive applications
inferredcites →https://doi.org/10.1145/1810295.1810329openalex-snapshot
Requirements reflection
inferredcites →https://doi.org/10.1145/239098.239106openalex-snapshot
Using object-oriented typing to support architectural design in the C2 style
inferredcites →https://doi.org/10.1145/250707.239106openalex-snapshot
Using object-oriented typing to support architectural design in the C2 style
inferredcites →https://doi.org/10.1162/neco.1997.9.8.1735openalex-snapshot
Long Short-Term Memory
inferredcites →https://doi.org/10.1287/mnsc.28.1.1openalex-snapshot
State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
inferredcites →https://doi.org/10.1512/iumj.1957.6.56038openalex-snapshot
A Markovian Decision Process
inferredcites →https://doi.org/10.1609/aaai.v30i1.10295openalex-snapshot
Deep Reinforcement Learning with Double Q-Learning
inferredcites →https://doi.org/10.1609/aaai.v31i1.10827openalex-snapshot
Playing FPS Games with Deep Reinforcement Learning
inferredcites →https://doi.org/10.3115/v1/w14-4012openalex-snapshot
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
inferredcites →https://doi.org/10.3390/s17112556openalex-snapshot
Deep Recurrent Neural Networks for Human Activity Recognition
inferredcites →https://doi.org/10.48550/arxiv.1409.4561openalex-snapshot
Decentralised Multi-Agent Reinforcement Learning for Dynamic and Uncertain Environments
inferredcites →https://doi.org/10.48550/arxiv.1412.3555openalex-snapshot
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
inferredcites →https://doi.org/10.48550/arxiv.1507.06527openalex-snapshot
Deep Recurrent Q-Learning for Partially Observable MDPs
inferredcites →https://doi.org/10.48550/arxiv.1509.02971openalex-snapshot
Continuous control with deep reinforcement learning
inferredcites →https://doi.org/10.48550/arxiv.1703.06182openalex-snapshot
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
inferredcites →https://doi.org/10.48550/arxiv.1802.08757openalex-snapshot
Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents
inferredcites →https://doi.org/10.5381/jot.2008.7.3.a4openalex-snapshot
Context-oriented Programming.

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1002/spe.3240openalex-snapshot
Microservice‐driven privacy‐aware cross‐platform social relationship prediction based on sequential information
inferred← citeshttps://doi.org/10.1007/978-3-031-75608-5_1openalex-snapshot
Enhancing Resource Scalability in Cloud Computing: A Comparative Investigation of Neural Network Predictive Techniques
inferred← citeshttps://doi.org/10.1007/978-981-96-2220-7_32openalex-snapshot
Design and Implementation of Adaptive Management Framework for Avionics System Services
inferred← citeshttps://doi.org/10.1007/978-981-96-7238-7_3openalex-snapshot
Self-adaptation in Microservice Systems: A Literature Review
inferred← citeshttps://doi.org/10.1007/s10723-024-09760-8openalex-snapshot
Micro Frontend Based Performance Improvement and Prediction for Microservices Using Machine Learning
inferred← citeshttps://doi.org/10.1007/s11227-026-08435-3openalex-snapshot
An explainable network-aware self-adaptive cyber-resilient architecture using policy-based reinforcement learning
inferred← citeshttps://doi.org/10.1007/s11276-023-03530-2openalex-snapshot
FDRP: federated deep relationship prediction with sequential information
inferred← citeshttps://doi.org/10.1007/s12065-021-00694-8openalex-snapshot
Adaptive deep Q learning network with reinforcement learning for crime prediction
inferred← citeshttps://doi.org/10.1016/j.compeleceng.2025.110550openalex-snapshot
A systematic review of QoS enhancement techniques in microservices architecture
inferred← citeshttps://doi.org/10.1016/j.cosrev.2023.100535openalex-snapshot
Web service adaptation: A decade’s overview
inferred← citeshttps://doi.org/10.1109/access.2025.3595387openalex-snapshot
Supporting the Evolution of Event-Based Choreographies of BPMN Fragments in Microservices Environments
inferred← citeshttps://doi.org/10.1109/icccnt61001.2024.10724643openalex-snapshot
Enhancing Cloud Resource Management through Predictive Neural Networks and Reinforcement Learning
inferred← citeshttps://doi.org/10.1109/icma49215.2020.9233667openalex-snapshot
Path Tracking Control of Hybrid-driven Robotic Fish Based on Deep Reinforcement Learning
inferred← citeshttps://doi.org/10.1109/netsoft64993.2025.11080597openalex-snapshot
Meta Learning for Improved Policy Transfer in Changing Network Environments
inferred← citeshttps://doi.org/10.1109/noms59830.2024.10575398openalex-snapshot
Comparing Transfer Learning and Rollout for Policy Adaptation in a Changing Network Environment
inferred← citeshttps://doi.org/10.1109/seams51251.2021.00030openalex-snapshot
Self-Adaptive Microservice-based Systems - Landscape and Research Opportunities
inferred← citeshttps://doi.org/10.1109/sse60056.2023.00025openalex-snapshot
Distributed and Intelligent API Mediation Service for Enterprise-Grade Hybrid-Multicloud Computing
inferred← citeshttps://doi.org/10.1109/tnsm.2024.3434328openalex-snapshot
A Framework for Dynamically Meeting Performance Objectives on a Service Mesh
inferred← citeshttps://doi.org/10.1109/ucc48980.2020.00071openalex-snapshot
Emergent Microservices in Emergent Ecosystems
inferred← citeshttps://doi.org/10.23919/cnsm55787.2022.9964775openalex-snapshot
A Geometric Approach to Real-time Quality of Experience Prediction in Volatile Edge Networks
inferred← citeshttps://doi.org/10.3390/software4010006openalex-snapshot
Designing Microservices Using AI: A Systematic Literature Review
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.