A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes

Bhatnagar, Shalabh ; Borkar, Vivek S. (1995) A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes Mathematics of Operations Research, 20 (4). pp. 923-936. ISSN 0364-765X

Full text not available from this repository.

Official URL: http://doi.org/10.1287/moor.20.4.923

Related URL: http://dx.doi.org/10.1287/moor.20.4.923

Abstract

The ergodic control problem for semi-Markov processes is reformulated as an optimization problem over the set of suitably defined ‘ergodic occupation measures.’ This set is shown to be closed and convex, with its extreme points corresponding to stationary strategies. This leads to the existence of optimal stationary strategies under additional hypotheses. A pathwise analysis of the joint empirical occupation measures of the state and control processes shows that this optimality is in the strong (i.e., almost sure) sense.

Item Type:Article
Source:Copyright of this article belongs to The Institute for Operations Research and the Management Sciences.
Keywords:Semi-Markov Processes; Optimal Controler; Godic Cost; Ergodic Occupation Measures; Stationary Strategies.
ID Code:116590
Deposited On:12 Apr 2021 07:07
Last Modified:12 Apr 2021 07:07

Repository Staff Only: item control page