Reference health
Existence of optimal stationary policies in average reward Markov decision processes with a recurrent state
6/6 checkable references clean · checked 2026-09-03
Every reference with a DOI in the deposited reference list resolved to a known work in Crossref or DataCite at the dated check, and none carried a retraction, withdrawal, or removal notice.
9 without a DOI — not checked. A reference deposited without a DOI is never matched by title or guessed at; it stays outside the checked set, and this line discloses that.
The 6 checked references that resolve
resolves10.1109/CDC.1984.272195
Stability, parameter estimation and adaptive control for discrete-time competing queues
resolves10.1007/BF01448194
Necessary conditions for the optimality equation in average-reward Markov decision processes
resolves10.1016/0167-6911(88)90043-6
Necessary and sufficient conditions for a bounded solution to the optimality equation in average reward Markov decision chains
resolves10.1214/aos/1176343590
Conditions for the Equivalence of Optimality Criteria in Dynamic Programming
resolves10.1007/978-3-642-46229-0
Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter
resolves10.1016/0167-6377(86)90095-7
A new condition for the existence of optimal stationary policies in average cost Markov decision processes
The 9 references without a DOI — listed, not checked
no DOI — not checkedAsh, R. B., Real Analysis and Probability, Academic Press, New York, 1972.
no DOI — not checkedHeyman, D. and M. Sobel, Stochastic Models in Operations Research, Vol. II, McGraw-Hill, New York, 1984.
no DOI — not checkedMunkres, J., Topology, A First Course, Prentice-Hall, Englewood Cliffs, NJ, 1975.
no DOI — not checkedRoss, S. M., Applied Probability Models with Optimization Applications, Holden-Day, San Francisco, 1970.
no DOI — not checkedRoss, S. M., Introduction to Stochastic Dynamic Programming, Academic Press, New York, 1983.
no DOI — not checkedRoss, S. M., Stochastic Processes, Wiley, New York, 1983.
no DOI — not checkedRudin, W., Principles of Mathematical Analysis, McGraw-Hill, New York, 1964.
no DOI — not checkedRoyden, H. L., Real Analysis, Macmillan, New York, 1968.
no DOI — not checkedThomas, L. C., Connectedness conditions for denumerable state Markov decision processes, in Recent Developments in Markov Decision Processes (R. Hartley, L. C. Thomas and D. J. White, eds.), Academic Press, New York, 1980, pp. 181?204.
What this badge says. CiteStamped means the CHECKABLE references of this
work were clean at the dated check: each resolved to a known work in a public registry, and none
carried a retraction notice at that time. It says nothing about the quality, findings,
or importance of the work itself, and nothing about references deposited without a DOI.
checked 2026-09-03 — re-checked daily as this page is visited; titles and statuses come from Crossref and DataCite and are not part of the signed record
Embed this badge
Both snippets point at the live badge image and link back to this page. The badge re-renders from the daily check, so an embed never goes stale by more than a day of visits.
<a href="https://citestamp.com/citestamped/10.1007/bf01189029"><img src="https://citestamp.com/citestamped/10.1007/bf01189029/badge.svg" alt="CiteStamped reference-health badge" width="460" height="64"></a>
[](https://citestamp.com/citestamped/10.1007/bf01189029)