Browse by Fellow

Robledo, Francisco ; Borkar, Vivek ; Ayesta, Urtzi ; Avrachenkov, Konstantin (2022) QWI: Q-learning with Whittle Index ACM SIGMETRICS Performance Evaluation Review, 49 (2). pp. 47-50.

Borkar, Vivek S. (2022) The Birth of MCMC Resonance, 27 (7). pp. 1105-1106. ISSN 0973-712X

Dolhare, Harsh ; Borkar, Vivek (2022) A Concentration Bound for Distributed Stochastic Approximation In: 2022 58th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 27-30 September 2022, Monticello, IL, USA.

Borkar, Vivek S. (2022) Corrigendum to “A concentration bound for contractive stochastic approximation” [Syst. Control Lett. 153 (2021) 104947] Systems & Control Letters, 159 . p. 105086. ISSN 0167-6911

Avrachenkov, Konstantin E. ; Borkar, Vivek S. ; Moharir, Sharayu ; Shah, Suhail (2022) Dynamic Social Learning Under Graph Constraints IEEE Transactions on Control of Network Systems, 9 (3). pp. 1435-1446. ISSN 2372-2533

Borkar, Vivek S. (2022) Markov Chain Monte Carlo (MCMC) Resonance, 27 (7). pp. 1107-1115. ISSN 0973-712X

Roy, Arghyadip ; Borkar, Vivek ; Karandikar, Abhay ; Chaporkar, Prasanna (2022) Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes IEEE Transactions on Automatic Control, 67 (7). pp. 3722-3729. ISSN 0018-9286

Borkar, Vivek S. ; Reiffers-Masson, Alexandre (2022) Opinion Shaping in Social Networks Using Reinforcement Learning IEEE Transactions on Control of Network Systems, 9 (3). pp. 1305-1316. ISSN 2372-2533

Borkar, Vivek S. ; Manjunath, D. (2022) Revisiting SIR in the Age of COVID-19: Explicit Solutions and Control Problems SIAM Journal on Control and Optimization, 60 (2). S370-S395. ISSN 0363-0129

GVB, Karthik ; Borkar, Vivek S. ; Kasbekar, Gaurav S. (2022) Scheduling in Wireless Networks using Whittle Index Theory In: 2022 National Conference on Communications (NCC), 24-27 May 2022, Mumbai, India.

Singh, Santosh Kumar ; Borkar, Vivek S. ; Kasbekar, Gaurav S. (2022) User Association in Dense mmWave Networks as Restless Bandits IEEE Transactions on Vehicular Technology, 71 (7). pp. 7919-7929. ISSN 0018-9545

Avrachenkov, Konstantin E. ; Borkar, Vivek S. (2022) Whittle index based Q-learning for restless bandits with average reward Automatica, 139 . p. 110186. ISSN 0005-1098

Borkar, Vivek S. ; Pattathil, Sarath (2022) Whittle indexability in egalitarian processor sharing systems Annals of Operations Research, 317 (2). pp. 417-437. ISSN 0254-5330

Arapostathis, Ari ; Borkar, Vivek S. (2021) Linear and Dynamic Programs for Risk-Sensitive Cost Minimization In: 2021 60th IEEE Conference on Decision and Control (CDC), 14-17 December 2021, Austin, TX, USA.

Borkar, Vivek S. ; Chandak, Siddharth (2021) Prospect-theoretic Q-learning Systems & Control Letters, 156 . p. 105009. ISSN 0167-6911

Borkar, Vivek S. ; Choudhary, Shantanu ; Gupta, Vaibhav Kumar ; Kasbekar, Gaurav S. (2021) Scheduling in wireless networks with spatial reuse of spectrum as restless bandits Performance Evaluation, 149-15 . p. 102208. ISSN 0166-5316

Priyadarshini, K. ; Chaudhuri, Siddhartha ; Borkar, Vivek ; Chaudhuri, Subhasis (2021) A Unified Batch Selection Policy for Active Metric Learning Lecture Notes in Computer Science, 12976 . pp. 599-616. ISSN 0302-9743

Borkar, Vivek S. (2021) A concentration bound for contractive stochastic approximation Systems & Control Letters, 153 . p. 104947. ISSN 0167-6911

Roy, Arghyadip ; Borkar, Vivek ; Chaporkar, Prasanna ; Karandikar, Abhay (2020) Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet IEEE Transactions on Mobile Computing, 19 (2). pp. 376-389. ISSN 1536-1233

Borkar, Vivek ; Miclo, Laurent (2020) On the fastest finite Markov processes Journal of Mathematical Analysis and Applications, 481 (2). p. 123488. ISSN 0022-247X

Arapostathis, Ari ; Biswas, Anup ; Borkar, Vivek S. ; Kumar, K. Suresh (2020) A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on $\mathbb{R}^d$ SIAM Journal on Control and Optimization, 58 (6). pp. 3785-3813. ISSN 0363-0129

Borkar, Aseem V. ; Borkar, Vivek S. ; Sinha, Arpita (2019) Aerial monitoring of slow moving convoys using elliptical orbits European Journal of Control, 46 . pp. 90-102. ISSN 0947-3580

Borkar, Vivek S. ; Gaitsgory, Vladimir ; Shvartsman, Ilya (2019) LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case SIAM Journal on Control and Optimization, 57 (3). pp. 1783-1817. ISSN 0363-0129

Borkar, Vivek S. ; Gaitsgory, Vladimir (2019) Linear Programming Formulation of Long-Run Average Optimal Control Problem Journal of Optimization Theory and Applications, 181 (1). pp. 101-125. ISSN 0022-3239

Avrachenkov, Konstantin ; Borkar, Vivek S. (2019) Metastability in Stochastic Replicator Dynamics Dynamic Games and Applications, 9 (2). pp. 366-390. ISSN 2153-0785

Kumar, Bhumesh ; Borkar, Vivek ; Shetty, Akhil (2019) Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents Mathematics of Control, Signals, and Systems, 31 (4). pp. 589-614. ISSN 0932-4194

Borkar, Vivek ; Gaitsgory, Vladimir ; Shvartsman, Ilya (2019) On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case In: 2019 IEEE 58th Conference on Decision and Control (CDC), 11-13 December 2019, Nice, France.

Kalvit, Anand ; Borkar, Vivek S. ; Karamchandani, Nikhil (2019) Stochastic approximation algorithms for rumor source inference on graphs Performance Evaluation, 132 . pp. 1-20. ISSN 0166-5316

Borkar, Vivek S. ; Pattathil, Sarath (2018) Concentration bounds for two time scale stochastic approximation In: 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 02-05 October 2018, Monticello, IL, USA.

Arapostathis, Ari ; Biswas, Anup ; Borkar, Vivek S. (2018) Controlled equilibrium selection in stochastically perturbed dynamics Annals of Probability, 46 (5). ISSN 0091-1798

Shah, Suhail Mohmad ; Borkar, Vivek S. (2018) Distributed Stochastic Approximation with Local Projections SIAM Journal on Optimization, 28 (4). pp. 3375-3401. ISSN 1052-6234

Borkar, Vivek S. ; Kasbekar, Gaurav S. ; Pattathil, Sarath ; Shetty, Priyesh Y. (2018) Opportunistic Scheduling as Restless Bandits IEEE Transactions on Control of Network Systems, 5 (4). pp. 1952-1961. ISSN 2372-2533

Shah, Suhail M. ; Borkar, Vivek S. (2018) Q-learning for Markov decision processes with a satisfiability criterion Systems & Control Letters, 113 . pp. 45-51. ISSN 0167-6911

BORKAR, VIVEK S ; JAIN, ANKUSH V (2018) Reinforcement learning, Sequential Monte Carlo and the EM algorithm Sadhana (Academy Proceedings in Engineering Sciences), 43 (8). ISSN 0256-2499

Avrachenkov, Konstantin ; Borkar, Vivek S. ; Kadavankandy, Arun ; Sreedharan, Jithin K. (2018) Revisiting random walk based sampling in networks: evasion of burn-in period and frequent regenerations Computational Social Networks, 5 (1). ISSN 2197-4314

Borkar, Vivek S. ; Chadha, Karan (2018) A reinforcement learning algorithm for restless bandits In: 2018 Indian Control Conference (ICC), 04-06 January 2018, Kanpur, India.

Kalathil, Dileep ; Borkar, Vivek S. ; Jain, Rahul (2017) Approachability in Stackelberg Stochastic Games with Vector Costs Dynamic Games and Applications, 7 (3). pp. 422-442. ISSN 2153-0785

Arapostathis, Ari ; Borkar, Vivek S. (2017) A Correction to “A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions'' SIAM Journal on Control and Optimization, 55 (3). pp. 1711-1715. ISSN 0363-0129

Phade, Soham R. ; Borkar, Vivek S. (2017) A Distributed Boyle--Dykstra--Han Scheme SIAM Journal on Optimization, 27 (3). pp. 1880-1897. ISSN 1052-6234

Mathkar, Adwaitvedant ; Borkar, Vivek S. (2017) Distributed Reinforcement Learning via Gossip IEEE Transactions on Automatic Control, 62 (3). pp. 1465-1470. ISSN 0018-9286

Borkar, Vivek S. (2017) Linear and dynamic programming approaches to degenerate risk-sensitive reward processes In: 2017 IEEE 56th Annual Conference on Decision and Control (CDC), 12-15 December 2017, Melbourne, VIC, Australia.

Kumar, Ankit ; Borkar, Vivek. S. ; Karamchandani, Nikhil (2017) Temporally Agnostic Rumor-Source Detection IEEE Transactions on Signal and Information Processing over Networks, 3 (2). pp. 316-329. ISSN 2373-7778

Anantharam, V. ; Borkar, V. S. (2017) A Variational Formula for Risk-Sensitive Reward SIAM Journal on Control and Optimization, 55 (2). pp. 961-988. ISSN 0363-0129

Borkar, Vivek S. (2017) Whittle Index for Partially Observed Binary Markov Decision Processes IEEE Transactions on Automatic Control, 62 (12). pp. 6614-6618. ISSN 0018-9286

Kowli, Anupama ; Jose, Joel ; Borkar, Vivek S. ; Ahamed, Imthias T.P. (2017) A dynamic programming framework for optimal home scheduling In: 2017 IEEE Innovative Smart Grid Technologies - Asia (ISGT-Asia), 04-07 December 2017, Auckland, New Zealand.

Prabuchandran, K. J. ; Bhatnagar, Shalabh ; Borkar, Vivek S. (2016) Actor-Critic Algorithms with Online Feature Adaptation ACM Transactions on Modeling and Computer Simulation, 26 (4). pp. 1-26. ISSN 1049-3301

Borkar, Vivek S. ; Dwivedi, Raaz ; Sahasrabudhe, Neeraja (2016) Gaussian approximations in high dimensional estimation Systems & Control Letters, 92 . pp. 42-45. ISSN 0167-6911

Mathkar, Adwaitvedant S. ; Borkar, Vivek S. (2016) Nonlinear Gossip SIAM Journal on Control and Optimization, 54 (3). pp. 1535-1557. ISSN 0363-0129

Borkar, Vivek S. ; Karamchandani, Nikhil ; Mirani, Sharad (2016) Randomized Kaczmarz for rank aggregation from pairwise comparisons In: 2016 IEEE Information Theory Workshop (ITW), 11-14 Sept 2016, Cambridge, UK.

Arapostathis, Ari ; Borkar, Vivek S. ; Kumar, K. Suresh (2016) Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula Journal of Theoretical Probability, 29 (4). pp. 1458-1484. ISSN 0894-9840

Borkar, VS (2015) Playing Dice with the Universe: Algorithms for Random Environments Proceedings of the Indian National Science Academy - Part A: Physical Sciences, 81 (3). ISSN 0370-0046

Anantharam, V. ; Borkar, V. S. (2015) Rocking in two by two: From Collatz-Wielandt to Donsker-Varadhan In: 2015 Information Theory and Applications Workshop (ITA), San Diego, CA, USA, 01-06 February 2015.

Avrachenkov, Konstantin E. ; Borkar, Vivek S. (2015) Whittle index policy for crawling ephemeral content In: 2015 54th IEEE Conference on Decision and Control (CDC), Osaka, Japan, 15-18 December 2015.

Arapostathis, Ari ; Borkar, Vivek S. ; Kumar, K. Suresh (2014) Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs SIAM Journal on Control and Optimization, 52 (1). pp. 1-31. ISSN 0363-0129

Ahamed, T. P. Imthias ; Borkar, Vivek S. (2014) An efficient scheduling algorithm for solving load commitment problem under Time of Use Pricing with bound on Maximum Demand In: 2014 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES), 16-19 December 2014, Mumbai, India.

Thoppe, Gugan ; Borkar, Vivek ; Manjunath, D. (2014) A stochastic Kaczmarz algorithm for network tomography Automatica, 50 (3). pp. 910-914. ISSN 0005-1098

Bhatnagar, Shalabh ; Borkar, Vivek S. ; K. J., Prabuchandran (2013) Feature Search in the Grassmanian in Online Reinforcement Learning IEEE Journal of Selected Topics in Signal Processing, 7 (5). pp. 746-758. ISSN 1932-4553

Karnik, Aditya ; Saroop, Atul ; Borkar, Vivek (2013) On the diffusion of messages in on-line social networks Performance Evaluation, 70 (4). pp. 271-285. ISSN 0166-5316

Borkar, Vivek S. (2013) Stochastic approximation Resonance - Journal of Science Education, 18 (12). pp. 1086-1094. ISSN 0971-8044

Meshram, Rahul ; Borkar, V. S. ; Manjunath, D. (2012) Problem-aware scheduling of in-network computation over multi-hop wireless networks In: 2012 International Conference on Signal Processing and Communications (SPCOM), 22-25 July 2012, Bangalore, India.

Arapostathis, Ari ; Borkar, Vivek S. (2012) A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions SIAM Journal on Control and Optimization, 50 (4). pp. 1886-1902. ISSN 0363-0129

Anantharam, V. ; Borkar, V. S. (2012) Stochastic approximation with long range dependent and heavy tailed noise Queueing Systems, 71 (1-2). pp. 221-242. ISSN 0257-0130

Azad, A. P. ; Alouf, S. ; Altman, E. ; Borkar, V. ; Paschos, G. S. (2011) Optimal control of sleep periods for wireless terminals IEEE Journal on Selected Areas in Communications, 29 (8). pp. 1605-1617. ISSN 0733-8716

Borkar, Vivek S. ; Filar, Jerzy A. (2011) Markov chains, Hamiltonian cycles and volumes of convex bodies Journal of Global Optimization . No PP. Given.. ISSN 0925-5001

Borkar, Vivek S. ; Ghosh, Mrinal K. ; Rangarajan, G. (2010) Application of nonlinear filtering to credit risk Operations Research Letters, 38 (6). pp. 527-532. ISSN 0167-6377

Biswas, Anup ; Borkar, Vivek S. (2010) On a controlled Eigenvalue problem Systems & Control Letters, 59 (11). pp. 734-735. ISSN 0167-6911

Salodkar, N. ; Karandikar, A. ; Borkar, V. S. (2010) A stable online algorithm for energy-efficient multiuser scheduling IEEE Transactions on Mobile Computing, 9 (10). pp. 1391-1406. ISSN 1536-1233

Arapostathis, Ari ; Borkar, Vivek S. (2010) Uniform recurrence properties of controlled diffusions and applications to optimal control SIAM Journal on Control and Optimization, 48 (7). pp. 4181-4223. ISSN 0363-0129

Borkar, V. S. ; Suresh Kumar, K. (2010) McKean-Vlasov limit in portfolio optimization Stochastic Analysis and Applications, 28 (5). pp. 884-906. ISSN 0736-2994

Biswas, Anup ; Borkar, V. S. ; Suresh Kumar, K. (2010) Risk-sensitive control with near monotone cost Applied Mathematics and Optimization, 62 (2). pp. 145-163. ISSN 0095-4616

Borkar, V. S. ; Suresh Kumar, K. (2010) Singular perturbations in risk-sensitive stochastic control SIAM Journal on Control and Optimization, 48 (6). pp. 3675-3697. ISSN 0363-0129

Borkar, V. S. ; Suresh Kumar, K. (2010) A new Markov selection procedure for degenerate diffusions Journal of Theoretical Probability, 23 (3). pp. 729-747. ISSN 0894-9840

Kulkarni, Ankur A. ; Borkar, Vivek S. (2009) Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space Automatica, 45 (12). pp. 2815-2822. ISSN 0005-1098

Borkar, Vivek S. ; Ejov, Vladimir ; Filar, Jerzy A. (2009) On the hamiltonicity gap and doubly stochastic matrices Random Structures & Algorithms, 34 (4). pp. 502-519. ISSN 1042-9832

Borkar, Vivek S. (2009) Cooperative dynamics and Wardrop equilibria Systems & Control Letters, 58 (2). pp. 91-93. ISSN 0167-6911

Borkar, Vivek S. (2009) Opportunistic transmission over randomly varying channels Lecture Notes in Computer Science, 5425 . pp. 62-69. ISSN 0302-9743

Borkar, Vivek S. ; Pinto, Jervis ; Prabhu, Tarun (2009) A new learning algorithm for optimal stopping Discrete Event Dynamic Systems: Theory and Applications, 19 (1). pp. 91-113. ISSN 0924-6703

Borkar, Vivek S. ; Das, Dibyajyoti (2008) A novel ACO algorithm for optimization via reinforcement and initial bias Swarm Intelligence, 3 (1). pp. 3-34. ISSN 1935-3812

Basu, Arnab ; Bhattacharyya, Tirthankar ; Borkar, Vivek S. (2008) A learning algorithm for risk-sensitive cost Mathematics of Operations Research, 33 (4). pp. 880-898. ISSN 0364-765X

Borkar, Vivek S. ; Manjunath, D. (2008) Distributed topology control of wireless networks Wireless Networks, 14 (5). pp. 671-682. ISSN 1022-0038

Barman, Kishor ; Borkar, Vivek S. (2008) A note on linear function approximation using random projections Systems & Control Letters, 57 (9). pp. 784-786. ISSN 0167-6911

Agarwal, M. ; Borkar, V. S. ; Karandikar, A. (2008) Structural properties of optimal transmission policies over a randomly varying channel IEEE Transactions on Automatic Control, 53 (6). pp. 1476-1491. ISSN 0018-9286

Salodkar, N. ; Bhorkar, A. ; Karandikar, A. ; Borkar, V. S. (2008) An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel IEEE Journal on Selected Areas in Communications, 26 (4). pp. 732-742. ISSN 0733-8716

Basu, Arnab ; Borkar, Vivek S. (2008) Stochastic control with imperfect models SIAM Journal on Control and Optimization, 47 (3). pp. 1274-1300. ISSN 0363-0129

Borkar, Vivek ; Gaitsgory, Vladimir (2007) On averaging of singularly perturbed stochastic differential equations Applied Mathematics and Optimization, 56 (2). pp. 169-209. ISSN 0095-4616

Anantharama, Venkat ; Borkar, Vivek (2007) Common randomness and distributed control: a counter example Systems & Control Letters, 56 (7-8). pp. 568-572. ISSN 0167-6911

Borkar, Vivek S. (2007) Dynamic programming for ergodic control of markov chains under partial observations: a correction SIAM Journal on Control and Optimization, 45 (6). pp. 2299-2304. ISSN 0363-0129

Borkar, Vivek S. ; Gaitsgory, Vladimir (2007) Singular perturbations in ergodic control of diffusions SIAM Journal on Control and Optimization, 46 (5). pp. 1562-1577. ISSN 0363-0129

Bhorkar, A. ; Karandikar, A. ; Borkar, V. S. (2006) WLC39-3: Power optimal opportunistic scheduling Global Telecommunications Conference, 27 . pp. 1-5. ISSN 1930-529X

Bhatnagar, Shalabh ; Borkar, Vivek S. ; Akarapu, Madhukar (2006) A simulation-based algorithm for ergodic control of Markov chains conditioned on rare events Journal of Machine Learning Research, 7 . pp. 1937-1962. ISSN 1532-4435

Ahamed, T. P. I. ; Borkar, V. S. ; Juneja, S. (2006) Adaptive importance sampling technique for markov chains using stochastic approximation Operations Research, 54 (3). pp. 489-504. ISSN 0030-364X

Borkar, V. S. (2005) An actor-critic algorithm for constrained markov decision processes Systems & Control Letters, 54 (3). pp. 207-213. ISSN 0167-6911

Borkar, Vivek S. (2005) Controlled diffusion processes Probability Surveys, 2 . pp. 213-244. ISSN 1549-5787

Borkar, V. S. ; Dave, M. S. ; Shyamasundar, R. K. (2005) Design and implementation of SeTiA: secure multi auction system I: Auction mechanisms Journal of Intelligent Systems, 14 (1). pp. 45-68. ISSN 0334-1860

Borkar, V. S. ; Dave, M. S. ; Shyamasundar, R. K. (2005) Design and implementation of SeTiA: secure multi auction system II: Architecture and implementation issues Journal of Intelligent Systems, 14 (1). pp. 69-93. ISSN 0334-1860

Borkar, Vivek ; Budhiraja, Amarjit (2005) Ergodic control for constrained diffusions: characterization using HJB equations SIAM Journal on Control and Optimization, 43 (4). pp. 1467-1492. ISSN 0363-0129

Borkar, Vivek ; Gaitsgory, Vladimir (2005) On existence of limit occupational measures set of a controlled stochastic differential equation SIAM Journal on Control and Optimization, 44 (4). pp. 1436-1473. ISSN 0363-0129

Rajadhyaksha, Gauresh ; Borkar, Vivek S. (2005) Transmission rate control over randomly varying channels Probability in the Engineering and Informational Sciences, 19 (1). pp. 73-82. ISSN 0269-9648

Borkar, Vivek S. ; Manjunath, D. (2004) Charge-based control of diffServ-like queues Automatica, 40 (12). pp. 2043-2057. ISSN 0005-1098

Borkar, Vivek S. ; Ejov, Vladimir ; Filar, Jerzy A. (2004) Directed graphs, Hamiltonicity and doubly stochastic matrices Random Structures & Algorithms, 25 (4). pp. 376-395. ISSN 1042-9832

Borkar, V. S. ; Juneja, S. ; Kherani, A. A. (2004) Performance analysis conditioned on rare events: an adaptive simulation scheme Communications in Information and Systems, 3 (4). pp. 259-278. ISSN 1526-7555

Borkar, V. S. ; Borkar, S. ; Budhiraja, Amarjit (2004) A further remark on dynamic programming for partially observed markov processes Stochastic Processes and their Applications, 112 (1). pp. 79-93. ISSN 0304-4149

Borkar, V. S. ; Mitter, S. K. ; Venkatesh, S. R. (2004) Variations on a theme by Neyman and Pearson Sankhya, 66 (2). pp. 292-305. ISSN 0972-7671

Borkar, V. S. ; Konda, V. R. ; Mitter, S. K. (2004) On De finetti coherence and kolmogorov probability Statistics & Probability Letters, 66 (4). pp. 417-421. ISSN 0167-7152

Bhatnagar, Shalabh ; Borkar, Vivek S. (2003) Multiscale chaotic SPSA and smoothed functional algorithms for simulation optimization Simulation, 79 (10). pp. 568-580. ISSN 0037-5497

Borkar, V. S. (2003) Avoidance of traps in stochastic approximation Systems & Control Letters, 50 (1). pp. 1-9. ISSN 0167-6911

Borkar, Vivek S. ; Ghosh, Mrinal K. (2003) Ergodic control of partially degenerate diffusions in a compact domain Stochastics An International Journal of Probability and Stochastic Processes, 75 (4). pp. 221-231. ISSN 1744-2508

Borkar, V. S. ; Kumar, P. R. (2003) Dynamic cesaro-wardrop equilibration in networks IEEE Transactions on Automatic Control, 48 (3). pp. 382-396. ISSN 0018-9286

Borkar, V. S. (2003) Dynamic programming for ergodic control with partial observations Stochastic Processes and their Applications, 103 (2). pp. 293-310. ISSN 0304-4149

Borkar, Vivek S. ; Mitter, Sanjoy K. (2003) A note on stochastic dissipativeness Lecture Notes in Control and Information Sciences,, 286 . pp. 41-49. ISSN 0170-8643

Borkar, V. S. (2002) Q-learning for risk-sensitive control Mathematics of Operations Research, 27 (2). pp. 294-311. ISSN 0364-765X

Borkar, V. S. ; Meyn, S. P. (2002) Risk-sensitive optimal control for Markov decision processes with monotone cost Mathematics of Operations Research, 27 (1). pp. 192-209. ISSN 0364-765X

Borkar, Vivek S. (2002) Newton's method Resonance - Journal of Science Education, 7 (1). pp. 31-36. ISSN 0971-8044

Borkar, V. S. (2002) On the lock-in probability of stochastic approximation Combinatorics, Probability and Computing, 11 (1). pp. 11-20. ISSN 0963-5483

Borkar, Vivek S. ; Chandru, Vijay ; Mitter, Sanjoy K. (2002) Mathematical programming embeddings of logic Journal of Automated Reasoning, 29 (1). pp. 91-106. ISSN 0168-7433

Borkar, V. S. (2002) Reinforcement learning in Markovian evolutionary games Advances in Complex Systems, 5 (1). pp. 55-72. ISSN 0219-5259

Abounadi, Jinane ; Bertsekas, Dimitri P. ; Borkar, Vivek (2002) Stochastic approximation for nonexpansive maps: application to Q-learning algorithms SIAM Journal on Control and Optimization, 41 (1). pp. 1-22. ISSN 0363-0129

Borkar, V. S. (2001) A sensitivity formula for risk-sensitive cost and the actor-critic algorithm Systems & Control Letters, 44 (5). pp. 339-346. ISSN 0167-6911

Borkar, V. S. ; Mitter, Sanjoy ; Tatikonda, Sekhar (2001) Markov control problems under communication contraints Communications in Information and Systems, 1 (1). pp. 15-32. ISSN 1526-7555

Abounadi, J. ; Bertsekas, D. ; Borkar, V. S. (2001) Learning algorithms for Markov decisionprocesses with average cost SIAM Journal on Control and Optimization, 40 (3). pp. 681-698. ISSN 0363-0129

Borkar, Vivek S. ; Mitter, Sanjoy K. ; Tatikonda, Sekhar (2001) Optimal sequential vector quantization of Markov sources SIAM Journal on Control and Optimization, 40 (1). pp. 135-148. ISSN 0363-0129

Borkar, V. S. (2000) Stability of annealing schemes and related processes Systems & Control Letters, 41 (5). pp. 325-331. ISSN 0167-6911

Borkar, Vivek S. (2000) Method in the madness Laws and order in probability Resonance - Journal of Science Education, 5 (11). pp. 37-46. ISSN 0971-8044

Borkar, V. S. (2000) Sample complexity for markov chain self-tuner Systems & Control Letters, 41 (2). pp. 95-104. ISSN 0167-6911

Borkar, V. S. (2000) A learning algorithm for discrete-time stochastic control Probability in the Engineering and Informational Sciences, 14 (2). pp. 243-258. ISSN 0269-9648

Borkar, V. S. ; Meyn, S. P. (2000) The O.D.E. method for convergence of stochastic approximation and reinforcement learning SIAM Journal on Control and Optimization, 38 (2). pp. 447-469. ISSN 0363-0129

Borkar, V. S. (2000) Average cost dynamic programming equations for controlled Markov chains with partial observations SIAM Journal on Control and Optimization, 39 (3). pp. 673-681. ISSN 0363-0129

Borkar, V. S. (2000) The value function in ergodic control of diffusion processes with partial observations -II Applicationes Mathematicae, 27 (4). pp. 455-464. ISSN 1233-7234

Bharath, B. ; Borkar, V. S. (1999) Stochastic approximation algorithms: overview and recent trends Sadhana (Academy Proceedings in Engineering Sciences), 24 (4-5). pp. 425-452. ISSN 0256-2499

Borkar, V. S. ; Gupta, P. (1999) Randomized neural networks for learning stochastic dependences Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 29 (4). pp. 469-480. ISSN 1083-4419

Borkar, V. S. ; Ghosh, M. K. ; Sahay, P. (1999) Optimal control of a stochastic hybrid system with discounted cost Journal of Optimization Theory and Applications, 101 (3). pp. 557-580. ISSN 0022-3239

Soumyanath, K. ; Borkar, V. S. (1999) An analog scheme for fixed-point computation - Part II. Applications IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, 46 (4). pp. 442-451. ISSN 1057-7122

Borkar, V. S. ; Mitter, S. K. (1999) A strong approximation theorem for stochastic recursive algorithms Journal of Optimization Theory and Applications, 100 (3). pp. 499-513. ISSN 0022-3239

Borkar, Vivek S. ; Jain, Sanjay ; Rangarajan, Govindan (1999) Evolutionary games with two timescales Physica D: Nonlinear Phenomena, 125 (1-2). pp. 155-166. ISSN 0167-2789

Borkar, Vivek S. (1999) Norbert Wiener and control engineering Resonance - Journal of Science Education, 4 (1). pp. 3-4. ISSN 0971-8044

Konda, Vijaymohan R. ; Borkar, Vivek S. (1999) Actor-critic--type learning algorithms for markov decision processes SIAM Journal on Control and Optimization, 38 (1). pp. 94-123. ISSN 0363-0129

Borkar, V. S. ; Mundra, S. M. (1999) Bayesian parameter estimation and adaptive control of Markov processes with time-averaged cost Applicationes Mathematicae, 25 (4). pp. 339-358. ISSN 1233-7234

Borkar, Vivek S. ; Jain, Sanjay ; Rangarajan, Govindan (1999) Generalized replicator dynamics as a model of specialization and diversity in societies Advances in Complex Systems, 1 (4). pp. 325-359. ISSN 0219-5259

Borkar, V. S. (1999) The value function in ergodic control of diffusion processes with partial observations Stochastics and Stochastic Reports, 67 (3-4). pp. 255-266. ISSN 1045-1129

Borkar, Vivek S. (1998) Pictures at an exhibition - a Lagrange multiplier gallery Resonance - Journal of Science Education, 3 (2). pp. 83-90. ISSN 0971-8044

Borkar, Vivek S. (1998) There's no such thing as a free lunch The Bias-Variance dilemma Resonance - Journal of Science Education, 3 (6). pp. 40-51. ISSN 0971-8044

Borkar, Vivek S. (1998) Asynchronous stochastic approximation SIAM Journal on Control and Optimization, 36 (3). pp. 840-851. ISSN 0363-0129

Borkar, Vivek S. ; Jain, Sanjay ; Rangarajan, Govindan (1998) Dynamics of individual specialization and global diversification in communities Complexity, 3 (3). pp. 50-56. ISSN 1076-2787

Borkar, Vivek S. (1998) Why do clocks move clockwise? The dynamics of collective learning Resonance - Journal of Science Education, 3 (1). pp. 27-35. ISSN 0971-8044

Branicky, M. S. ; Borkar, V. S. ; Mitter , S. K. (1998) A unified framework for hybrid control: model and optimal control theory IEEE Transactions on Automatic Control, 43 (1). pp. 31-45. ISSN 0018-9286

Borkar, V. S. (1998) Convexity in stochastic control Differential Equations and Dynamical Systems, 6 (1-2). pp. 37-49. ISSN 0971-3514

Ranjan, Uma S. ; Borkar, V. S. ; Sastry, P. S. (1998) Edge detection through a time-homogeneous Markov system Journal of the Indian Institute of Science, 78 (1). pp. 31-43. ISSN 0970-4140

Bharath, B. ; Borkar, V. S. (1998) Robust parameter optimization of hidden Markov models Journal of the Indian Institute of Science, 78 (2). pp. 119-130. ISSN 0970-4140

Borkar, Vivek S. (1998) A convex analytic approach to markov decision processes Probability Theory and Related Fields, 78 (4). pp. 583-602. ISSN 0178-8051

Borkar, Vivek S. ; Konda, Vijaymohan R. (1997) The actor-critic algorithm as multi-time-scale stochastic approximation Sadhana (Academy Proceedings in Engineering Sciences), 22 (4). pp. 525-543. ISSN 0256-2499

Borkar, Vivek S. ; Konda, Vijaymohan R. (1997) The actor-critic algorithm as multi-time-scale stochastic approximation Sadhana, 22 (4). pp. 525-543. ISSN 0256-2499

Borkar, V. S. ; Soumyanatha, K. (1997) An analog scheme for fixed point computation: I. Iheory IEEE Transactions on Circuits and Systems Part I: Fundamental Theory and Applications, 44 (4). pp. 351-355. ISSN 1057-7122

Borkar, Vivek S. (1997) How low can you sink? In search of global minima Resonance - Journal of Science Education, 2 (2). pp. 52-63. ISSN 0971-8044

Borkar, Vivek S. (1997) Stochastic approximation with two time scales Systems & Control Letters, 29 (5). pp. 291-294. ISSN 0167-6911

Basak, Gopal K. ; Borkar, Vivek S. ; Ghosh, Mrinal K. (1997) Ergodic control of degenerate diffusions Stochastic Analysis and Applications, 15 (1). pp. 1-17. ISSN 0736-2994

Gupta, Piyush ; Borkar, Vivek S. (1997) Learning decentralized goal-based vector-quantization Complex Systems, 11 . pp. 73-106. ISSN 0891-2513

Bhatnagar, Shalabh ; Borkar, Vivek S. (1997) Multiscale stochastic approximation for parametric optimization of hidden Markov models Probability in the Engineering and Informational Sciences, 11 (4). pp. 509-522. ISSN 0269-9648

Borkar, Vivek S. (1996) Distributed computation of fixed points of ∞-nonexpansive maps Proceedings of the Indian Academy of Sciences - Mathematical Sciences, 106 (3). pp. 289-300. ISSN 0253-4142

Bhatt, Abhay G. ; Borkar, Vivek S. (1996) Occupation measures for controlled Markov processes: characterization and optimality The Annals of Probability, 24 (3). pp. 1531-1562. ISSN 0091-1798

Borkar, V. S. ; Mitter, S. K. (1996) Stochastic processes that generate polygonal and related random fields IEEE Transactions on Information Theory, 42 (2). pp. 606-617. ISSN 0018-9448

Borkar, V. S. (1996) Recursive self-tuning control of finite Markov chains Applicationes Mathematicae, 24 (2). pp. 169-188. ISSN 1233-7234

Bhatnagar, Shalabh ; Borkar, Vivek S. (1995) A convex analytic framework for ergodic control of semi-Markov processes Mathematics of Operations Research, 20 (4). pp. 923-936. ISSN 0364-765X

Borkar, V. S. (1995) On ergodic control of degenerate diffusions Journal of Optimization Theory and Applications, 86 (1). pp. 251-261. ISSN 0022-3239

Borkar, V. S. ; Kumar, Sunil (1995) On extremal solutions of controlled nonlinear filtering equations SIAM Journal on Control and Optimization, 33 (3). pp. 718-724. ISSN 0363-0129

Vivek, Borkar S. ; Mrinal, Ghosh K. (1995) Recent trends in Markov decision processes Journal of the Indian Institute of Science, 75 (1). pp. 5-24. ISSN 0970-4140

Borkar, V. S. ; Phansalkar, V. V. (1994) Managing interprocessor delays in distributed recursive algorithms Sadhana, 19 (6). pp. 995-1003. ISSN 0256-2499

Borkar, V. S. ; Govindan, T. E. (1994) Optimal control of semilinear stochastic evolution equations Nonlinear Analysis, Theory, Methods & Applications, 23 (1). pp. 15-35. ISSN 0362-546X

Borkar, Vivek S. (1994) Ergodic control of markov chains with constraints-the general case SIAM Journal on Control and Optimization, 32 (1). pp. 176-186. ISSN 0363-0129

Borkar, Vivek S. (1993) On infinitesimal σ-fields generated by random processes Proceedings of the Indian Academy of Sciences - Mathematical Sciences, 103 (3). pp. 329-332. ISSN 0253-4142

Borkar, Vivek S. (1993) White-noise representations in stochastic realization theory SIAM Journal on Control and Optimization, 31 (5). pp. 1093-1102. ISSN 0363-0129

Borkar, V. S. (1993) Controlled diffusions with Constraints, II Journal of Mathematical Analysis and Applications, 176 (2). pp. 310-321. ISSN 0022-247X

Borkar, V. S. (1993) On the milito-cruz adaptive control scheme for Markov chains Journal of Optimization Theory and Applications, 77 (2). pp. 387-397. ISSN 0022-3239

Arapostathis, Aristotle ; Borkar, Vivek S. ; Fernandez-Gaucherand, Emmanuel ; Ghosh, Mrinal K. ; Marcus, Steven I. (1993) Discrete-time controlled markov processes with average cost criterion: a survey SIAM Journal on Control and Optimization, 31 (2). pp. 282-344. ISSN 0363-0129

Borkar, Vivek S. (1993) On extremal solutions to stochastic control problems. II Applied Mathematics and Optimization, 28 (1). pp. 49-56. ISSN 0095-4616

Borkar, V. S. ; Ghosh, M. K. (1992) Stochastic differential games: occupation measure based approach Journal of Optimization Theory and Applications, 73 (2). pp. 359-385. ISSN 0022-3239

Borkar, Vivek S. ; Ghosh, Mrinal K. (1992) Ergodic and adaptive control of nearest-neighbor motions Mathematics of Control, Signals, and Systems, 5 (4). p. 453. ISSN 0932-4194

Borkar, V. S. (1991) Self-tuning control of diffusions without the identifiability condition Journal of Optimization Theory and Applications, 68 (1). pp. 117-138. ISSN 0022-3239

Borkar, Vivek S. ; Ghosh, Mrinal K. (1991) Ergodic and adaptive control of nearest-neighbor motions Mathematics of Control, Signals, and Systems (MCSS), 4 (1). pp. 81-98. ISSN 0932-4194

Borkar, Vivek S. (1991) On extremal solutions to stochastic control problems Applied Mathematics and Optimization, 24 (1). pp. 317-330. ISSN 0095-4616

Borkar, Vivek S. (1991) A remark on control of partially observed Markov chains Annals of Operations Research, 29 (1). pp. 429-438. ISSN 0254-5330

Borkar, Vivek S. (1990) Controlled Markov chains with constraints Sadhana (Academy Proceedings in Engineering Sciences), 15 (4-5). pp. 405-413. ISSN 0256-2499

Borkar, Vivek S. ; Ghosh, Mrinal K. (1990) Controlled diffusions with constraints Journal of Mathematical Analysis and Applications, 152 (1). pp. 88-108. ISSN 0022-247X

Borkar, V. S. (1990) The Kumar-Becker-Lin scheme revisited Journal of Optimization Theory and Applications, 66 (2). pp. 289-309. ISSN 0022-3239

Borkar, Vivek S. ; Ghosh, Mrinal K. (1990) Ergodic control of multidimensional diffusions, II: adaptive control Applied Mathematics and Optimization, 21 (1). pp. 191-220. ISSN 0095-4616

Borkar, Vivek S. (1989) Control of Markov chains with long-run average cost criterion: the dynamic programming equations SIAM Journal on Control and Optimization, 27 (3). pp. 642-657. ISSN 0363-0129

Borkar, Vivek S. (1989) Mimicking finite dimensional marginals of a controlled diffusion by simpler controls Stochastic Processes and their Applications, 31 (2). pp. 333-342. ISSN 0304-4149

Borkar, Vivek S. (1989) A topology for markov controls Applied Mathematics and Optimization, 20 (1). pp. 55-62. ISSN 0095-4616

Borkar, V. S. ; Chari, R. T. ; Mitter, S. K. (1988) Stochastic quantization of field theory in finite and infinite volume Journal of Functional Analysis, 81 (1). pp. 184-206. ISSN 0022-1236

Borkar, Vivek S. ; Ghosh, Mrinal K. (1988) Ergodic control of multidimensional diffusions I: the existence results SIAM Journal on Control and Optimization, 26 (1). pp. 112-126. ISSN 0363-0129

Borkar, Vivek S. (1988) Controlled diffusions with boundary-crossing costs Applied Mathematics and Optimization, 18 (1). pp. 67-83. ISSN 0095-4616

Borkar, Vivek S. (1988) The probabilistic structure of controlled diffusion processes Acta Applicandae Mathematicae, 11 (1). pp. 19-48. ISSN 0167-8019

Borkar, Vivek S. (1987) Control of a partially observed diffusion up to an exit time Systems & Control Letters, 8 (5). pp. 429-434. ISSN 0167-6911

Borkar, Vivek S. (1987) A comparison principle for certain convex functionals of a diffusion process without drift Stochastic Processes and their Applications, 25 . pp. 245-248. ISSN 0304-4149

Borkar, Vivek S. (1986) The nisio semigroup for controlled diffusions with partial observations Stochastics, 17 (1-2). pp. 145-160. ISSN 1744-2508

Borkar, Vivek S. (1986) A remark on the attainable distributions of controlled diffusions Stochastics, 18 (1). pp. 17-23. ISSN 1744-2508

Bensoussan, A. ; Borkar, V. (1984) Ergodic control problem for one-dimensional diffusions with near-monotone cost Systems & Control Letters, 5 (2). pp. 127-133. ISSN 0167-6911

Borkar, Vivek S. (1984) On minimum cost per unit time control of markov chains SIAM Journal on Control and Optimization, 22 (6). pp. 965-978. ISSN 0363-0129

Borkar, Vivek S. (1984) A note on controlled diffusions on line with time-averaged cost Systems & Control Letters, 4 (1). pp. 1-4. ISSN 0167-6911

Borkar, Vivek S. (1984) Evolution of interacting particles in a Brownian medium Stochastics, 14 (1). pp. 33-79. ISSN 1744-2508

Bagchi, Arunabha ; Borkar, Vivek (1984) Parameter identification in infinte dimensional linear systems Stochastics, 12 (3-4). pp. 201-213. ISSN 1744-2508

Borkar, Vivek S. (1983) Controlled markov chains and stochastic networks SIAM Journal on Control and Optimization, 21 (4). pp. 652-666. ISSN 0363-0129

Borkar , Vivek S. (1983) Existence of optimal controls for partially observed diffusions Stochastics, 11 (1-2). pp. 103-141. ISSN 1744-2508

Borkar, Vivek S. (1982) Parameter estimation in stochastic systems: some recent results and applications Systems & Control Letters, 1 (4). pp. 221-226. ISSN 0167-6911

Borkar, Vivek ; Varaiya, Pravin (1982) Identification and adaptive control of Markov chains SIAM Journal on Control and Optimization, 20 (4). pp. 470-489. ISSN 0363-0129

Borkara, Vivek ; Bagchia, Arunabha (1982) Parameter estimation in continuous-time stochastic processes Stochastics, 8 (3). pp. 193-212. ISSN 1744-2508

Borkar, Vivek S. (1982) Pathwise smoothing of Markov processes with noisy observations Journal of Mathematical Analysis and Applications, 90 (2). pp. 525-535. ISSN 0022-247X

Borkar, V. ; Varaiya, P. (1981) Finite chain approximation for a continuous stochastic control problem IEEE Transactions on Automatic Control, 26 (2). pp. 466-470. ISSN 0018-9286

Borkar, V. ; Varaiya, P. (1979) Adaptive control of Markov chains. I. Finite parameter set Automatic Control, IEEE Transactions on, 24 (6). pp. 953-957. ISSN 0018-9286