Items where Author is "Borkar, Vivek"

Article

Robledo, Francisco ; Borkar, Vivek ; Ayesta, Urtzi ; Avrachenkov, Konstantin (2022) QWI: Q-learning with Whittle Index ACM SIGMETRICS Performance Evaluation Review, 49 (2). pp. 47-50.

Roy, Arghyadip ; Borkar, Vivek ; Karandikar, Abhay ; Chaporkar, Prasanna (2022) Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes IEEE Transactions on Automatic Control, 67 (7). pp. 3722-3729. ISSN 0018-9286

Priyadarshini, K. ; Chaudhuri, Siddhartha ; Borkar, Vivek ; Chaudhuri, Subhasis (2021) A Unified Batch Selection Policy for Active Metric Learning Lecture Notes in Computer Science, 12976 . pp. 599-616. ISSN 0302-9743

Roy, Arghyadip ; Borkar, Vivek ; Chaporkar, Prasanna ; Karandikar, Abhay (2020) Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet IEEE Transactions on Mobile Computing, 19 (2). pp. 376-389. ISSN 1536-1233

Borkar, Vivek ; Miclo, Laurent (2020) On the fastest finite Markov processes Journal of Mathematical Analysis and Applications, 481 (2). p. 123488. ISSN 0022-247X

Kumar, Bhumesh ; Borkar, Vivek ; Shetty, Akhil (2019) Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents Mathematics of Control, Signals, and Systems, 31 (4). pp. 589-614. ISSN 0932-4194

Thoppe, Gugan ; Borkar, Vivek ; Manjunath, D. (2014) A stochastic Kaczmarz algorithm for network tomography Automatica, 50 (3). pp. 910-914. ISSN 0005-1098

Karnik, Aditya ; Saroop, Atul ; Borkar, Vivek (2013) On the diffusion of messages in on-line social networks Performance Evaluation, 70 (4). pp. 271-285. ISSN 0166-5316

Borkar, Vivek ; Gaitsgory, Vladimir (2007) On averaging of singularly perturbed stochastic differential equations Applied Mathematics and Optimization, 56 (2). pp. 169-209. ISSN 0095-4616

Anantharama, Venkat ; Borkar, Vivek (2007) Common randomness and distributed control: a counter example Systems & Control Letters, 56 (7-8). pp. 568-572. ISSN 0167-6911

Karnik, Aditya ; Kumar, Anurag ; Borkar, Vivek (2006) Distributed self-tuning of sensor networks Wireless Networks, 12 (5). pp. 531-544. ISSN 1022-0038

Borkar, Vivek ; Budhiraja, Amarjit (2005) Ergodic control for constrained diffusions: characterization using HJB equations SIAM Journal on Control and Optimization, 43 (4). pp. 1467-1492. ISSN 0363-0129

Borkar, Vivek ; Gaitsgory, Vladimir (2005) On existence of limit occupational measures set of a controlled stochastic differential equation SIAM Journal on Control and Optimization, 44 (4). pp. 1436-1473. ISSN 0363-0129

Abounadi, Jinane ; Bertsekas, Dimitri P. ; Borkar, Vivek (2002) Stochastic approximation for nonexpansive maps: application to Q-learning algorithms SIAM Journal on Control and Optimization, 41 (1). pp. 1-22. ISSN 0363-0129

Bagchi, Arunabha ; Borkar, Vivek (1984) Parameter identification in infinte dimensional linear systems Stochastics, 12 (3-4). pp. 201-213. ISSN 1744-2508

Borkar, Vivek ; Varaiya, Pravin (1982) Identification and adaptive control of Markov chains SIAM Journal on Control and Optimization, 20 (4). pp. 470-489. ISSN 0363-0129

Conference or Workshop Item

Dolhare, Harsh ; Borkar, Vivek (2022) A Concentration Bound for Distributed Stochastic Approximation In: 2022 58th Annual Allerton Conference on Communication, Control, and Computing (Allerton), 27-30 September 2022, Monticello, IL, USA.

Borkar, Vivek ; Gaitsgory, Vladimir ; Shvartsman, Ilya (2019) On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case In: 2019 IEEE 58th Conference on Decision and Control (CDC), 11-13 December 2019, Nice, France.