Recent trends in Markov decision processes

Vivek, Borkar S. ; Mrinal, Ghosh K. (1995) Recent trends in Markov decision processes Journal of the Indian Institute of Science, 75 (1). pp. 5-24. ISSN 0970-4140

Full text not available from this repository.

Official URL:


A short tutorial introduction is given to Markov decision processes (MDP), including the latest activity in the field. Classical theory, most notably dynamic programming and its consequences, is briefly reviewed along with MDP computational techniques for MDP. A brief overview is given of issues that remain open in the classical framework. Some 'nonclassical' problems that have attracted much attention recently are addressed, including problems involving nonclassical costs and multiobjective problems. Problems involving partial information about the state of the process or about model uncertainty are considered. Some application areas and the closely related areas of continuous time stochastic control and stochastic games are addressed. (AIAA).

Item Type:Article
Source:Copyright of this article belongs to The Indian Institute of Science (IISc).
ID Code:81433
Deposited On:06 Feb 2012 04:55
Last Modified:06 Feb 2012 04:55

Repository Staff Only: item control page