×

Borkar, Vivek Shripad

Compute Distance To:
Author ID: borkar.vivek-shripad Recent zbMATH articles by "Borkar, Vivek Shripad"
Published as: Borkar, Vivek S.; Borkar, V. S.; Borkar, Vivek; Borkar, V.; Borkar, Vivek Shripad
Homepage: https://www.ee.iitb.ac.in/web/faculty/homepage/borkar
External Links: MGP · Wikidata · dblp · GND · IdRef · theses.fr
all top 5

Co-Authors

74 single-authored
16 Ghosh, Mrinal Kanti
13 Arapostathis, Aristotle
13 Mitter, Sanjoy K.
12 Kumar, K. Suresh
7 Biswas, Anup
6 Avrachenkov, Konstantin Evgen’evich
6 Gaitsgory, Vladimir G.
6 Varaiya, Pravin Pratap
5 Bhatnagar, Shalabh
4 Filar, Jerzy A.
4 Manjunath, D.
3 Anantharam, Venkat
3 Bagchi, Arunabha
3 Bertsekas, Dimitri Panteli
3 Jain, Rahul
3 Konda, Vijaymohan R.
3 Meyn, Sean P.
3 Sahasrabudhe, Neeraja
3 Shah, Suhail Mohmad
2 Abounadi, Jinane
2 Basu, Arnab K.
2 Bensoussan, Alain
2 Bharath, B.
2 Bhatt, Abhay G.
2 Branicky, Michael S.
2 Budhiraja, Amarjit S.
2 Ezhov, Vladimir Vladimirovich
2 Juneja, Sandeep
2 Kalathil, Dileep
2 Karandikar, Abhay
2 Mathkar, Adwaitvedant S.
2 Rajadhyaksha, Gauresh
2 Rangarajan, Govindan
2 Saboo, Krishnakant
2 Shvartsman, Ilya A.
2 Sundaresan, Rajesh
2 Tatikonda, Sekhar
2 Thoppe, Gugan C.
1 Agarwal, Mukul
1 Ahamed, T. P. I.
1 Akarapu, Madhukar
1 Ashok Vardhan, M.
1 Athreya, Siva R.
1 Barman, Kishor
1 Basak, Gopal Krishna
1 Bhattacharyya, Tirthankar
1 Borkar, Aseem V.
1 Chandak, Siddharth
1 Chandru, Vijay
1 Chandru, Vijaya
1 Chaporkar, Prasanna
1 Chari, R. T.
1 Dolhare, Hars P.
1 Dwaracherla, Vikranth R.
1 Dwivedi, Raaz
1 Fernández-Gaucherand, Emmanuel
1 Garg, Dinesh
1 Govindan, T. E.
1 Gupta, Piyush
1 Jain, Ankush V.
1 Jain, Sanjay
1 Karnik, Aditya
1 Kasbekar, Gaurav S.
1 Kherani, Arzad A.
1 Kulkarni, Ankur A.
1 Kumar, Bhumesh
1 Kumar, Sunil
1 Kuri, Joy
1 Marcus, Steven I.
1 Micciancio, Daniele
1 Miclo, Laurent
1 Mundra, S. M.
1 Nair, Jayakrishnan
1 Nalli, Sanketh
1 Nedić, Angelia
1 Nemirovsky, Danil
1 Nguyen, Giang Thu
1 Patil, Kishor
1 Pattathil, Sarath
1 Phade, Soham R.
1 Phansalkar, V. V.
1 Pinto, Jervis
1 Prabhu, Tarun
1 Prabuchandran, K. J.
1 Roy, Arghyadip
1 Shetty, Akhil
1 Shetty, Priyesh Y.
1 Sinha, Arpita
1 Soumyanath, K.
1 Venkatesh, Saligrama R.
all top 5

Serials

32 SIAM Journal on Control and Optimization
23 Systems & Control Letters
11 IEEE Transactions on Automatic Control
10 Applied Mathematics and Optimization
10 Journal of Optimization Theory and Applications
6 Stochastics
5 Journal of Mathematical Analysis and Applications
5 Automatica
5 Probability in the Engineering and Informational Sciences
5 Sādhanā
4 Mathematics of Operations Research
4 Stochastic Processes and their Applications
4 Applicationes Mathematicae
3 Journal of the Indian Institute of Science
3 MCSS. Mathematics of Control, Signals, and Systems
3 Stochastic Systems
2 The Annals of Probability
2 Stochastic Analysis and Applications
2 Acta Applicandae Mathematicae
2 Journal of Theoretical Probability
2 Proceedings of the Indian Academy of Sciences. Mathematical Sciences
2 Stochastics and Stochastics Reports
2 SIAM Journal on Optimization
2 Journal of Machine Learning Research (JMLR)
2 Communications in Information and Systems
2 Sankhyā
2 Dynamic Games and Applications
2 IEEE Transactions on Control of Network Systems
1 IEEE Transactions on Information Theory
1 Indian Journal of Pure & Applied Mathematics
1 Journal of Applied Probability
1 Journal of Computational and Applied Mathematics
1 Journal of Functional Analysis
1 Operations Research
1 Statistics & Probability Letters
1 Operations Research Letters
1 Physica D
1 Probability Theory and Related Fields
1 Journal of Automated Reasoning
1 Complex Systems
1 Queueing Systems
1 Annals of Operations Research
1 Random Structures & Algorithms
1 Journal of Global Optimization
1 Discrete Event Dynamic Systems
1 IEEE Transactions on Circuits and Systems. I: Fundamental Theory and Applications
1 Theory of Probability and Mathematical Statistics
1 Combinatorics, Probability and Computing
1 ACM Transactions on Modeling and Computer Simulation
1 European Journal of Control
1 Differential Equations and Dynamical Systems
1 Advances in Complex Systems
1 Encyclopedia of Mathematics and Its Applications
1 International Series in Operations Research & Management Science
1 Texts and Readings in Mathematics
1 Probability Surveys
1 Nonlinear Analysis. Theory, Methods & Applications
1 Journal of Algebra and Related Topics
1 Pure and Applied Functional Analysis

Publications by Year

Citations contained in zbMATH Open

171 Publications have been cited 1,736 times in 1,128 Documents Cited by Year
A unified framework for hybrid control: Model and optimal control theory. Zbl 0951.93002
Branicky, Michael S.; Borkar, Vivek S.; Mitter, Sanjoy K.
183
1998
Discrete-time controlled Markov processes with average cost criterion: A survey. Zbl 0770.93064
Arapostathis, Aristotle; Borkar, Vivek S.; Fernández-Gaucherand, Emmanuel; Ghosh, Mrinal K.; Marcus, Steven I.
113
1993
Stochastic approximation. A dynamical systems viewpoint. Zbl 1181.62119
Borkar, Vivek S.
92
2008
Ergodic control of diffusion processes. Zbl 1236.93137
Arapostathis, Ari; Borkar, Vivek S.; Ghosh, Mrinal K.
82
2012
The O. D. E. method for convergence of stochastic approximation and reinforcement learning. Zbl 0990.62071
Borkar, V. S.; Meyn, S. P.
60
2000
Stochastic approximation with two time scales. Zbl 0895.62085
Borkar, Vivek S.
52
1997
Optimal control of diffusion processes. Zbl 0669.93065
Borkar, Vivek S.
46
1989
Topics in controlled Markov chains. Zbl 0725.93082
Borkar, V. S.
41
1991
Risk-sensitive optimal control for Markov decision processes with monotone cost. Zbl 1082.90577
Borkar, V. S.; Meyn, S. P.
38
2002
Occupation measures for controlled Markov processes: Characterization and optimality. Zbl 0863.93086
Bhatt, Abhay G.; Borkar, Vivek S.
35
1996
Asymptotic agreement in distributed estimation. Zbl 0497.93037
Borkar, Vivek; Varaiya, Pravin P.
34
1982
Stochastic approximation. A dynamical systems viewpoint. Zbl 1159.60002
Borkar, Vivek S.
33
2008
Probability theory. An advanced course. Zbl 0838.60001
Borkar, Vivek S.
32
1995
A convex analytic approach to Markov decision processes. Zbl 0628.90090
Borkar, Vivek S.
28
1988
Stochastic differential games: Occupation measure based approach. Zbl 0794.90086
Borkar, V. S.; Ghosh, M. K.
27
1992
Actor-critic-type learning algorithms for Markov decision processes. Zbl 0938.93069
Konda, Vijaymohan R.; Borkar, Vivek S.
23
1999
Stochastic quantization of field theory in finite and infinite volume. Zbl 0657.60084
Borkar, V. S.; Chari, R. T.; Mitter, S. K.
21
1988
On minimum cost per unit time control of Markov chains. Zbl 0566.93069
Borkar, Vivek S.
21
1984
Convex analytic methods in Markov decision processes. Zbl 1003.90048
Borkar, Vivek S.
21
2002
Asynchronous stochastic approximations. Zbl 0922.62081
Borkar, Vivek S.
20
1998
Control of Markov chains with long-run average cost criterion: The dynamic programming equations. Zbl 0668.60059
Borkar, Vivek S.
19
1989
Learning algorithms for Markov decision processes with average cost. Zbl 1001.93091
Abounadi, J.; Bertsekas, D.; Borkar, V. S.
19
2001
Distributed asynchronous incremental subgradient methods. Zbl 0997.90102
Nedić, A.; Bertsekas, D. P.; Borkar, V. S.
19
2001
Controlled diffusion processes. Zbl 1189.93143
Borkar, Vivek S.
18
2005
Parameter estimation in continuous-time stochastic processes. Zbl 0499.62076
Borkar, Vivek; Bagchi, Arunabha
18
1982
Averaging of singularly perturbed controlled stochastic differential equations. Zbl 1139.93022
Borkar, Vivek; Gaitsgory, Vladimir
18
2007
White-noise representations in stochastic realization theory. Zbl 0788.93081
Borkar, Vivek S.
17
1993
McKean-Vlasov limit in portfolio optimization. Zbl 1232.91607
Borkar, V. S.; Kumar, K. Suresh
16
2010
Adaptive control of Markov chains. I: Finite parameter set. Zbl 0416.93065
Borkar, V.; Varaiya, P.
16
1979
Ergodic control of multidimensional diffusions. I. The existence results. Zbl 0646.93068
Borkar, Vivek S.; Ghosh, Mrinal K.
15
1988
Risk-sensitive control with near monotone cost. Zbl 1214.93119
Biswas, Anup; Borkar, V. S.; Suresh Kumar, K.
15
2010
An actor-critic algorithm for constrained Markov decision processes. Zbl 1129.90322
Borkar, V. S.
13
2005
Ergodic control for constrained diffusions: Characterization using HJB equations. Zbl 1101.93082
Borkar, Vivek; Budhiraja, Amarjit
13
2005
Average cost dynamic programming equations for controlled Markov chains with partial observations. Zbl 1011.93110
Borkar, V. S.
12
2000
Uniform recurrence properties of controlled diffusions and applications to optimal control. Zbl 1210.93079
Arapostathis, Ari; Borkar, Vivek S.
12
2010
Ergodic control of multidimensional diffusions. II: Adaptive control. Zbl 0691.93027
Borkar, Vivek S.; Ghosh, Mrinal K.
12
1990
Parameter identification in infinite dimensional linear systems. Zbl 0541.93072
Bagchi, Arunabha; Borkar, Vivek
11
1984
Risk-sensitive control and an abstract Collatz-Wielandt formula. Zbl 1360.60149
Arapostathis, Ari; Borkar, Vivek S.; Kumar, K. Suresh
11
2016
Ergodic control of Markov chains with constraints – the general case. Zbl 0795.93100
Borkar, Vivek S.
11
1994
Identification and adaptive control of Markov chains. Zbl 0491.93063
Borkar, Vivek; Varaiya, Pravin
11
1982
Stochastic approximation for nonexpansive maps: application to Q-learning algorithms. Zbl 1063.62567
Abounadi, Jinane; Bertsekas, Dimitri P.; Borkar, Vivek
10
2002
\(Q\)-learning for risk-sensitive control. Zbl 1082.90576
Borkar, V. S.
9
2002
Dynamic programming for ergodic control with partial observations. Zbl 1075.60522
Borkar, V. S.
9
2003
Ergodic control of degenerate diffusions. Zbl 0872.93079
Basak, Gopal K.; Borkar, Vivek S.; Ghosh, Mrinal K.
9
1997
A learning algorithm for risk-sensitive cost. Zbl 1217.93188
Basu, Arnab; Bhattacharyya, Tirthankar; Borkar, Vivek S.
9
2008
A remark on the attainable distributions of controlled diffusions. Zbl 0599.93067
Borkar, Vivek S.
9
1986
A variational formula for risk-sensitive reward. Zbl 1361.93065
Anantharam, V.; Borkar, V. S.
9
2017
Denumerable state stochastic games with limiting average payoff. Zbl 0797.90128
Borkar, V. S.; Ghosh, M. K.
8
1993
The value function in ergodic control of diffusion processes with partial observations. Zbl 0947.93038
Borkar, V. S.
8
1999
On existence of limit occupational measures set of a controlled stochastic differential equation. Zbl 1109.93033
Borkar, Vivek; Gaitsgory, Vladimir
8
2005
Adaptive importance sampling technique for Markov chains using stochastic approximation. Zbl 1167.60343
Ahamed, T. P. I.; Borkar, V. S.; Juneja, S.
8
2006
A topology for Markov controls. Zbl 0682.60031
Borkar, Vivek S.
8
1989
Evolution of interacting particles in a Brownian medium. Zbl 0567.60099
Borkar, Vivek S.
8
1984
A further remark on dynamic programming for partially observed Markov processes. Zbl 1114.93098
Borkar, Vivek S.; Budhiraja, Amarjit
7
2004
A note on stochastic dissipativeness. Zbl 1059.93132
Borkar, Vivek S.; Mitter, Sanjoy K.
7
2003
A two timescale stochastic approximation scheme for simulation-based parametric optimization. Zbl 0982.93072
Bhatnagar, Shalabh; Borkar, Vivek S.
7
1998
A sensitivity formula for risk-sensitive cost and the actor-critic algorithm. Zbl 0987.93080
Borkar, V. S.
6
2001
Singular perturbations in ergodic control of diffusions. Zbl 1143.93024
Borkar, Vivek S.; Gaitsgory, Vladimir
6
2007
Controlled diffusions with constraints. Zbl 0746.60078
Borkar, Vivek S.; Ghosh, Mrinal K.
6
1990
Ergodic and adaptive control of nearest-neighbor motions. Zbl 0736.93078
Borkar, Vivek S.; Ghosh, Mrinal K.
6
1991
A new Markov selection procedure for degenerate diffusions. Zbl 1214.60022
Borkar, V. S.; Suresh Kumar, K.
6
2010
Asymptotics of the invariant measure in mean field models with jumps. Zbl 1296.60258
Borkar, Vivek Shripad; Sundaresan, Rajesh
6
2012
LP formulations of discrete Time long-run average optimal control problems: the nonergodic case. Zbl 1420.49036
Borkar, Vivek S.; Gaitsgory, Vladimir; Shvartsman, Ilya
6
2019
Control of Markov chains with long-run average cost criterion. Zbl 0663.93078
Borkar, Vivek S.
5
1988
Reinforcement learning in Markovian evolutionary games. Zbl 1053.91022
Borkar, V. S.
5
2002
Controlled Markov chains with constraints. Zbl 1075.93546
Borkar, Vivek
5
1990
Linear programming formulation of long-run average optimal control problem. Zbl 1417.49028
Borkar, Vivek S.; Gaitsgory, Vladimir
5
2019
A unified framework for hybrid control. Zbl 0925.93019
Branicky, Michael S.; Borkar, Vivek S.; Mitter, Sanjoy K.
5
1994
Small noise asymptotics for invariant densities for a class of diffusions: a control theoretic view. Zbl 1175.93209
Biswas, Anup; Borkar, Vivek S.
5
2009
Optimal control of a stochastic hybrid system with discounted cost. Zbl 1009.49019
Borkar, V. S.; Ghosh, M. K.; Sahay, P.
5
1999
On the Hamiltonicity gap and doubly stochastic matrices. Zbl 1208.05069
Borkar, Vivek S.; Ejov, Vladimir; Filar, Jerzy A.
5
2009
A relative value iteration algorithm for nondegenerate controlled diffusions. Zbl 1252.93125
Arapostathis, Ari; Borkar, Vivek S.
5
2012
Erratum to: Risk-sensitive control with near monotone cost. Zbl 1207.49030
Biswas, Anup; Borkar, V. S.; Suresh Kumar, K.
5
2010
Convergence of the relative value iteration for the ergodic control problem of nondegenerate diffusions under near-monotone costs. Zbl 1292.93138
Arapostathis, Ari; Borkar, Vivek S.; Kumar, K. Suresh
5
2014
The Kumar-Becker-Lin scheme revisited. Zbl 0682.93060
Borkar, V. S.
5
1990
Performance analysis conditioned on rare events: an adaptive simulation scheme. Zbl 1087.94014
Borkar, V. S.; Juneja, S.; Kherani, A. A.
5
2003
Stochastic approximation with ‘controlled Markov’ noise. Zbl 1129.62407
Borkar, Vivek S.
5
2006
A variational characterization of the risk-sensitive average reward for controlled diffusions on \(\mathbb{R}^d\). Zbl 1457.60122
Arapostathis, Ari; Biswas, Anup; Borkar, Vivek S.; Kumar, K. Suresh
5
2020
Controlled diffusions with boundary-crossing costs. Zbl 0644.60080
Borkar, Vivek S.
4
1988
Optimal sequential vector quantization of Markov sources. Zbl 1009.90127
Borkar, Vivek S.; Mitter, Sanjoy K.; Tatikonda, Sekhar
4
2001
Stochastic approximation algorithms: overview and recent trends. Zbl 1075.62608
Bharath, B.; Borkar, V. S.
4
1999
On extremal solutions to stochastic control problems. Zbl 0752.93077
Borkar, Vivek S.
4
1991
Errata corrige to: Stochastic differential games: Occupation measure based approach. Zbl 0845.90138
Borkar, V. S.; Ghosh, M. K.
4
1996
Quasi-stationary distributions as centrality measures for the giant strongly connected component of a reducible graph. Zbl 1215.05153
Avrachenkov, Konstantin; Borkar, Vivek; Nemirovsky, Danil
4
2010
A concentration bound for stochastic approximation via Alekseev’s formula. Zbl 1442.62187
Thoppe, Gugan; Borkar, Vivek
4
2019
Dynamic Cesàro-Wardrop equilibration in networks. Zbl 1364.90081
Borkar, Vivek S.; Kumar, P. R.
4
2003
The probabilistic structure of controlled diffusion processes. Zbl 0635.93079
Borkar, Vivek S.
3
1988
On de Finetti coherence and Kolmogorov probability. Zbl 1081.28004
Borkar, V. S.; Konda, V. R.; Mitter, S. K.
3
2004
Managing interprocessor delays in distributed recursive algorithms. Zbl 1012.65509
Borkar, V. S.; Phansalkar, V. V.
3
1994
On the lock-in probability of stochastic approximation. Zbl 0988.62052
Borkar, V. S.
3
2002
Whittle index policy for crawling ephemeral content. Zbl 06995919
Avrachenkov, Konstantin E.; Borkar, Vivek S.
3
2018
Markov chains, Hamiltonian cycles and volumes of convex bodies. Zbl 1268.90113
Borkar, Vivek S.; Filar, Jerzy A.
3
2013
Cooperative dynamics and Wardrop equilibria. Zbl 1156.91325
Borkar, Vivek S.
3
2009
Stochastic approximation with long range dependent and heavy tailed noise. Zbl 1275.60053
Anantharam, V.; Borkar, V. S.
3
2012
Common randomness and distributed control: A counterexample. Zbl 1118.93053
Anantharam, Venkat; Borkar, Vivek
3
2007
Dynamic programming for ergodic control of Markov chains under partial observations: A correction. Zbl 1126.93435
Borkar, Vivek S.
3
2007
Singular perturbations in risk-sensitive stochastic control. Zbl 1203.93207
Borkar, V. S.; Kumar, K. Suresh
3
2010
A note on controlled diffusions on line with time-averaged cost. Zbl 0534.93072
Borkar, Vivek S.
3
1984
Mimicking finite dimensional marginals of a controlled diffusion by simpler controls. Zbl 0669.60057
Borkar, Vivek S.
3
1989
Ergodic control of diffusion processes. Zbl 1108.93076
Borkar, Vivek S.
3
2006
Empirical \(Q\)-value iteration. Zbl 1461.68184
Kalathil, Dileep; Borkar, Vivek S.; Jain, Rahul
1
2021
A concentration bound for contractive stochastic approximation. Zbl 1475.93106
Borkar, Vivek S.
1
2021
A variational characterization of the risk-sensitive average reward for controlled diffusions on \(\mathbb{R}^d\). Zbl 1457.60122
Arapostathis, Ari; Biswas, Anup; Borkar, Vivek S.; Kumar, K. Suresh
5
2020
LP formulations of discrete Time long-run average optimal control problems: the nonergodic case. Zbl 1420.49036
Borkar, Vivek S.; Gaitsgory, Vladimir; Shvartsman, Ilya
6
2019
Linear programming formulation of long-run average optimal control problem. Zbl 1417.49028
Borkar, Vivek S.; Gaitsgory, Vladimir
5
2019
A concentration bound for stochastic approximation via Alekseev’s formula. Zbl 1442.62187
Thoppe, Gugan; Borkar, Vivek
4
2019
Metastability in stochastic replicator dynamics. Zbl 1429.91044
Avrachenkov, Konstantin; Borkar, Vivek S.
2
2019
Aerial monitoring of slow moving convoys using elliptical orbits. Zbl 1412.93004
Borkar, Aseem V.; Borkar, Vivek S.; Sinha, Arpita
1
2019
Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents. Zbl 1426.93313
Kumar, Bhumesh; Borkar, Vivek; Shetty, Akhil
1
2019
Whittle index policy for crawling ephemeral content. Zbl 06995919
Avrachenkov, Konstantin E.; Borkar, Vivek S.
3
2018
Controlled equilibrium selection in stochastically perturbed dynamics. Zbl 1408.35232
Arapostathis, Ari; Biswas, Anup; Borkar, Vivek S.
1
2018
Opportunistic scheduling as restless bandits. Zbl 07045049
Borkar, Vivek S.; Kasbekar, Gaurav S.; Pattathil, Sarath; Shetty, Priyesh Y.
1
2018
Classical Zariski topology on prime spectrum of lattice modules. Zbl 1438.06022
Borkar, V.; Girase, P.; Phadatare, N.
1
2018
Distributed stochastic approximation with local projections. Zbl 1407.62301
Shah, Suhail Mohmad; Borkar, Vivek S.
1
2018
Q-learning for Markov decision processes with a satisfiability criterion. Zbl 1386.93271
Shah, Suhail M.; Borkar, Vivek S.
1
2018
A variational formula for risk-sensitive reward. Zbl 1361.93065
Anantharam, V.; Borkar, V. S.
9
2017
Distributed reinforcement learning via gossip. Zbl 1368.68284
Mathkar, Adwaitvedant; Borkar, Vivek S.
3
2017
An index policy for dynamic pricing in cloud computing under price commitments. Zbl 1375.90300
Borkar, V. S.; Ravikumar, K.; Saboo, Krishnakant
2
2017
Whittle index for partially observed binary Markov decision processes. Zbl 1390.90557
Borkar, Vivek S.
1
2017
A correction to “A relative value iteration algorithm for nondegenerate controlled diffusions”. Zbl 1365.93536
Arapostathis, Ari; Borkar, Vivek S.
1
2017
A distributed Boyle-Dykstra-Han scheme. Zbl 1370.90178
Phade, Soham R.; Borkar, Vivek S.
1
2017
Approachability in Stackelberg stochastic games with vector costs. Zbl 1391.91029
Kalathil, Dileep; Borkar, Vivek S.; Jain, Rahul
1
2017
Risk-sensitive control and an abstract Collatz-Wielandt formula. Zbl 1360.60149
Arapostathis, Ari; Borkar, Vivek S.; Kumar, K. Suresh
11
2016
Nonlinear gossip. Zbl 1344.68274
Mathkar, Adwaitvedant S.; Borkar, Vivek S.
3
2016
Distributed and asynchronous methods for semi-supervised learning. Zbl 1398.68429
Avrachenkov, Konstantin; Borkar, Vivek S.; Saboo, Krishnakant
1
2016
Actor-critic algorithms with online feature adaptation. Zbl 1369.90190
Prabuchandran, K. J.; Bhatnagar, Shalabh; Borkar, Vivek S.
1
2016
Convergence of the relative value iteration for the ergodic control problem of nondegenerate diffusions under near-monotone costs. Zbl 1292.93138
Arapostathis, Ari; Borkar, Vivek S.; Kumar, K. Suresh
5
2014
Risk-constrained Markov decision processes. Zbl 1360.90272
Borkar, Vivek; Jain, Rahul
2
2014
Small noise large time asymptotics for the normalized Feynman-Kac semigroup. Zbl 1330.93237
Borkar, Vivek S.; Kumar, K. Suresh
1
2014
A stochastic Kaczmarz algorithm for network tomography. Zbl 1298.93308
Thoppe, Gugan; Borkar, Vivek; Manjunath, D.
1
2014
Markov chains, Hamiltonian cycles and volumes of convex bodies. Zbl 1268.90113
Borkar, Vivek S.; Filar, Jerzy A.
3
2013
Relative value iteration for stochastic differential games. Zbl 1304.91035
Arapostathis, Ari; Borkar, Vivek S.; Kumar, K. Suresh
3
2013
Ergodic control of diffusion processes. Zbl 1236.93137
Arapostathis, Ari; Borkar, Vivek S.; Ghosh, Mrinal K.
82
2012
Asymptotics of the invariant measure in mean field models with jumps. Zbl 1296.60258
Borkar, Vivek Shripad; Sundaresan, Rajesh
6
2012
A relative value iteration algorithm for nondegenerate controlled diffusions. Zbl 1252.93125
Arapostathis, Ari; Borkar, Vivek S.
5
2012
Stochastic approximation with long range dependent and heavy tailed noise. Zbl 1275.60053
Anantharam, V.; Borkar, V. S.
3
2012
Hamiltonian cycle problem and Markov chains. Zbl 1246.90001
Borkar, Vivek S.; Ejov, Vladimir; Filar, Jerzy A.; Nguyen, Giang T.
3
2012
Oja’s algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control. Zbl 1310.93049
Borkar, V.; Meyn, S. P.
1
2012
McKean-Vlasov limit in portfolio optimization. Zbl 1232.91607
Borkar, V. S.; Kumar, K. Suresh
16
2010
Risk-sensitive control with near monotone cost. Zbl 1214.93119
Biswas, Anup; Borkar, V. S.; Suresh Kumar, K.
15
2010
Uniform recurrence properties of controlled diffusions and applications to optimal control. Zbl 1210.93079
Arapostathis, Ari; Borkar, Vivek S.
12
2010
A new Markov selection procedure for degenerate diffusions. Zbl 1214.60022
Borkar, V. S.; Suresh Kumar, K.
6
2010
Erratum to: Risk-sensitive control with near monotone cost. Zbl 1207.49030
Biswas, Anup; Borkar, V. S.; Suresh Kumar, K.
5
2010
Quasi-stationary distributions as centrality measures for the giant strongly connected component of a reducible graph. Zbl 1215.05153
Avrachenkov, Konstantin; Borkar, Vivek; Nemirovsky, Danil
4
2010
Singular perturbations in risk-sensitive stochastic control. Zbl 1203.93207
Borkar, V. S.; Kumar, K. Suresh
3
2010
Erratum to: Risk-sensitive control with near monotone cost. Zbl 1214.93120
Biswas, Anup; Borkar, V. S.; Suresh Kumar, K.
2
2010
On a controlled eigenvalue problem. Zbl 1218.49006
Biswas, Anup; Borkar, Vivek S.
2
2010
Small noise asymptotics for invariant densities for a class of diffusions: a control theoretic view. Zbl 1175.93209
Biswas, Anup; Borkar, Vivek S.
5
2009
On the Hamiltonicity gap and doubly stochastic matrices. Zbl 1208.05069
Borkar, Vivek S.; Ejov, Vladimir; Filar, Jerzy A.
5
2009
Cooperative dynamics and Wardrop equilibria. Zbl 1156.91325
Borkar, Vivek S.
3
2009
A new learning algorithm for optimal stopping. Zbl 1168.91356
Borkar, Vivek S.; Pinto, Jervis; Prabhu, Tarun
2
2009
Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space. Zbl 1192.90133
Kulkarni, Ankur A.; Borkar, Vivek S.
1
2009
Stochastic approximation. A dynamical systems viewpoint. Zbl 1181.62119
Borkar, Vivek S.
92
2008
Stochastic approximation. A dynamical systems viewpoint. Zbl 1159.60002
Borkar, Vivek S.
33
2008
A learning algorithm for risk-sensitive cost. Zbl 1217.93188
Basu, Arnab; Bhattacharyya, Tirthankar; Borkar, Vivek S.
9
2008
A note on linear function approximation using random projections. Zbl 1153.93037
Barman, Kishor; Borkar, Vivek S.
2
2008
Stochastic control with imperfect models. Zbl 1161.93027
Basu, Arnab; Borkar, Vivek S.
2
2008
Structural properties of optimal transmission policies over a randomly varying channel. Zbl 1367.90110
Agarwal, Mukul; Borkar, Vivek S.; Karandikar, Abhay
2
2008
Averaging of singularly perturbed controlled stochastic differential equations. Zbl 1139.93022
Borkar, Vivek; Gaitsgory, Vladimir
18
2007
Singular perturbations in ergodic control of diffusions. Zbl 1143.93024
Borkar, Vivek S.; Gaitsgory, Vladimir
6
2007
Common randomness and distributed control: A counterexample. Zbl 1118.93053
Anantharam, Venkat; Borkar, Vivek
3
2007
Dynamic programming for ergodic control of Markov chains under partial observations: A correction. Zbl 1126.93435
Borkar, Vivek S.
3
2007
Some examples of stochastic approximation in communications. Zbl 1181.68065
Borkar, Vivek S.
1
2007
Adaptive importance sampling technique for Markov chains using stochastic approximation. Zbl 1167.60343
Ahamed, T. P. I.; Borkar, V. S.; Juneja, S.
8
2006
Stochastic approximation with ‘controlled Markov’ noise. Zbl 1129.62407
Borkar, Vivek S.
5
2006
Ergodic control of diffusion processes. Zbl 1108.93076
Borkar, Vivek S.
3
2006
A simulation-based algorithm for ergodic control of Markov chains conditioned on rare events. Zbl 1222.93210
Bhatnagar, Shalabh; Borkar, Vivek S.; Akarapu, Madhukar
1
2006
Controlled diffusion processes. Zbl 1189.93143
Borkar, Vivek S.
18
2005
An actor-critic algorithm for constrained Markov decision processes. Zbl 1129.90322
Borkar, V. S.
13
2005
Ergodic control for constrained diffusions: Characterization using HJB equations. Zbl 1101.93082
Borkar, Vivek; Budhiraja, Amarjit
13
2005
On existence of limit occupational measures set of a controlled stochastic differential equation. Zbl 1109.93033
Borkar, Vivek; Gaitsgory, Vladimir
8
2005
Network pricing for QoS: a ‘regulation’ approach. Zbl 1127.90319
Garg, Dinesh; Borkar, Vivek S.; Manjunath, D.
1
2005
Correction to: “Transmission rate control over randomly varying channels”. Zbl 1336.90102
Rajadhyaksha, Gauresh; Borkar, Vivek S.
1
2005
A further remark on dynamic programming for partially observed Markov processes. Zbl 1114.93098
Borkar, Vivek S.; Budhiraja, Amarjit
7
2004
On de Finetti coherence and Kolmogorov probability. Zbl 1081.28004
Borkar, V. S.; Konda, V. R.; Mitter, S. K.
3
2004
Charge-based control of DiffServ-like queues. Zbl 1076.90012
Borkar, Vivek S.; Manjunath, D.
2
2004
Dynamic programming for ergodic control with partial observations. Zbl 1075.60522
Borkar, V. S.
9
2003
A note on stochastic dissipativeness. Zbl 1059.93132
Borkar, Vivek S.; Mitter, Sanjoy K.
7
2003
Performance analysis conditioned on rare events: an adaptive simulation scheme. Zbl 1087.94014
Borkar, V. S.; Juneja, S.; Kherani, A. A.
5
2003
Dynamic Cesàro-Wardrop equilibration in networks. Zbl 1364.90081
Borkar, Vivek S.; Kumar, P. R.
4
2003
Ergodic control of partially degenerate diffusions in a compact domain. Zbl 1046.93048
Borkar, Vivek S.; Ghosh, Mrinal K.
1
2003
Avoidance of traps in stochastic approximation. Zbl 1157.62479
Borkar, V. S.
1
2003
Risk-sensitive optimal control for Markov decision processes with monotone cost. Zbl 1082.90577
Borkar, V. S.; Meyn, S. P.
38
2002
Convex analytic methods in Markov decision processes. Zbl 1003.90048
Borkar, Vivek S.
21
2002
Stochastic approximation for nonexpansive maps: application to Q-learning algorithms. Zbl 1063.62567
Abounadi, Jinane; Bertsekas, Dimitri P.; Borkar, Vivek
10
2002
\(Q\)-learning for risk-sensitive control. Zbl 1082.90576
Borkar, V. S.
9
2002
Reinforcement learning in Markovian evolutionary games. Zbl 1053.91022
Borkar, V. S.
5
2002
On the lock-in probability of stochastic approximation. Zbl 0988.62052
Borkar, V. S.
3
2002
The value function in ergodic control of diffusion processes with partial observations. II. Zbl 1047.93555
Borkar, Vivek S.
2
2002
Learning algorithms for Markov decision processes with average cost. Zbl 1001.93091
Abounadi, J.; Bertsekas, D.; Borkar, V. S.
19
2001
Distributed asynchronous incremental subgradient methods. Zbl 0997.90102
Nedić, A.; Bertsekas, D. P.; Borkar, V. S.
19
2001
A sensitivity formula for risk-sensitive cost and the actor-critic algorithm. Zbl 0987.93080
Borkar, V. S.
6
2001
Optimal sequential vector quantization of Markov sources. Zbl 1009.90127
Borkar, Vivek S.; Mitter, Sanjoy K.; Tatikonda, Sekhar
4
2001
Markov control problems under communication constraints. Zbl 1038.93086
Borkar, V. S.; Mitter, Sanjoy; Tatikonda, Sekhar
2
2001
The O. D. E. method for convergence of stochastic approximation and reinforcement learning. Zbl 0990.62071
Borkar, V. S.; Meyn, S. P.
60
2000
Average cost dynamic programming equations for controlled Markov chains with partial observations. Zbl 1011.93110
Borkar, V. S.
12
2000
A learning algorithm for discrete-time stochastic control. Zbl 1029.93065
Borkar, V. S.
1
2000
Uniform stability of controlled Markov processes. Zbl 0997.93098
Borkar, Vivek S.
1
2000
Sample complexity for Markov chain self-tuner. Zbl 0985.93061
Borkar, V. S.
1
2000
Actor-critic-type learning algorithms for Markov decision processes. Zbl 0938.93069
Konda, Vijaymohan R.; Borkar, Vivek S.
23
1999
...and 71 more Documents
all top 5

Cited by 1,451 Authors

96 Borkar, Vivek Shripad
28 Ghosh, Mrinal Kanti
27 Cavazos-Cadena, Rolando
26 Arapostathis, Aristotle
25 Bhatnagar, Shalabh
21 Biswas, Anup
20 Guo, Xianping
17 Hernández-Lerma, Onésimo
13 Dufour, François
12 Gaitsgory, Vladimir G.
12 Kumar, K. Suresh
12 Yüksel, Serdar
11 Jasso-Fuentes, Héctor
11 Stettner, Łukasz
10 Azhmyakov, Vadim
9 Egerstedt, Magnus B.
9 Goreac, Dan
9 Marcus, Steven I.
9 Menaldi, Jose-Luis
9 Piunovskiĭ, Alekseĭ Borisovich
9 Röckner, Michael
8 Albeverio, Sergio A.
8 Bertsekas, Dimitri Panteli
8 Haddad, Wassim Michael
8 Kurano, Masami
8 Nedić, Angelia
8 Pradhan, Somnath
8 Prieto-Rumeau, Tomás
8 Yu, Huizhen
8 Zhu, Quanxin
7 Avrachenkov, Konstantin Evgen’evich
7 Budhiraja, Amarjit S.
7 Escobedo-Trujillo, Beatris Adriana
7 Feinberg, Eugene Aleksandrovich
7 Ji, Min
7 Saha, Subhamay
7 Yi, Yingfei
6 Azuma, Shun-Ichi
6 Bagchi, Arunabha
6 Bortakovskii, A. S.
6 Hernández-Hernández, Daniel
6 Lygeros, John
6 Meyn, Sean P.
6 Montes-de-Oca, Raúl
6 Quincampoix, Marc
6 Shvartsman, Ilya A.
6 Stockbridge, Richard H.
5 Altman, Eitan
5 Basu, Arnab K.
5 Chatterjee, Debasish
5 Cruz Suárez, Hugo Adán
5 Feng, Enmin
5 Fernández-Gaucherand, Emmanuel
5 Ferretti, Roberto Giorgio
5 Fort, Gersende
5 Jain, Rahul
5 Jaśkiewicz, Anna
5 Johansson, Karl Henrik
5 Kawai, Reiichiro
5 Leslie, David S.
5 López-Barrientos, José Daniel
5 Pang, Guodong
5 Pasik-Duncan, Bozenna
5 Robin, Maurice
5 Sennott, Linn I.
5 Serea, Oana-Silvia
5 Wang, Mengdi
5 Zhang, Kanjian
4 Aghayeva, Charkaz
4 Anulova, Svetlana
4 Bardi, Martino
4 Basak, Gopal Krishna
4 Buckdahn, Rainer
4 Chellaboina, Vijaysekhar
4 Duncan, Tyrone E.
4 Festa, Adriano
4 Filar, Jerzy A.
4 Gaubert, Stéphane
4 Goncharova, Elena Vladimirovna
4 Huang, Wen
4 Ichihara, Naoyuki
4 Levanony, David
4 Liu, Zhenxin
4 Mendoza-Pérez, Armando Felipe
4 Nowak, Andrzej S.
4 Pakshin, P. V.
4 Pal, Chandan
4 Poznyak, Aleksandr Semënovich
4 Prashanth, L. A.
4 Ramachandran, Kandethody M.
4 Sacone, Simona
4 Saldi, Naci
4 Staritsyn, Maksim Vladimirovich
4 Teo, Kok Lay
4 Vega-Amaya, Oscar
4 Wardi, Yorai
4 Yong, Jiongmin
3 Antsaklis, Panos J.
3 Atar, Rami
3 Barles, Guy
...and 1,351 more Authors
all top 5

Cited in 244 Serials

66 Systems & Control Letters
63 Automatica
63 SIAM Journal on Control and Optimization
41 Applied Mathematics and Optimization
40 Journal of Optimization Theory and Applications
36 Journal of Mathematical Analysis and Applications
23 Stochastic Processes and their Applications
22 The Annals of Applied Probability
21 International Journal of Control
21 Nonlinear Analysis. Hybrid Systems
19 Stochastic Analysis and Applications
17 Discrete Event Dynamic Systems
17 Automation and Remote Control
17 Mathematical Methods of Operations Research
16 Mathematics of Operations Research
15 Stochastics
14 Mathematical Programming. Series A. Series B
14 SIAM Journal on Optimization
12 Annals of Operations Research
11 MCSS. Mathematics of Control, Signals, and Systems
10 Journal of Applied Probability
10 Statistics & Probability Letters
10 Operations Research Letters
10 Mathematical Problems in Engineering
10 European Journal of Control
9 Nonlinear Analysis. Theory, Methods & Applications. Series A: Theory and Methods
9 Operations Research
9 International Journal of Robust and Nonlinear Control
9 Dynamic Games and Applications
8 Journal of Statistical Physics
8 The Annals of Probability
8 Kybernetika
8 Queueing Systems
8 European Journal of Operational Research
8 Journal of Computer and Systems Sciences International
8 European Series in Applied and Industrial Mathematics (ESAIM): Control, Optimization and Calculus of Variations
8 Sādhanā
8 Stochastic Systems
7 Journal of the Franklin Institute
7 Journal of Economic Theory
7 Probability Theory and Related Fields
7 Machine Learning
7 Journal of Global Optimization
6 Advances in Applied Probability
6 Stochastics
6 Journal of Differential Equations
6 ZOR. Zeitschrift für Operations Research
6 Discrete and Continuous Dynamical Systems
5 Applied Mathematics and Computation
5 Journal of Functional Analysis
5 Acta Applicandae Mathematicae
5 Stochastics and Stochastics Reports
5 Abstract and Applied Analysis
5 Journal of Machine Learning Research (JMLR)
5 Journal of Dynamics and Games
5 SIAM Journal on Mathematics of Data Science
4 Indian Journal of Pure & Applied Mathematics
4 Journal of Information & Optimization Sciences
4 Neural Computation
4 Applied Mathematical Modelling
4 NoDEA. Nonlinear Differential Equations and Applications
4 Bernoulli
4 Probability in the Engineering and Informational Sciences
4 Electronic Journal of Statistics
4 Asian Journal of Control
4 Mathematical Control and Related Fields
4 International Journal of Systems Science. Principles and Applications of Systems and Integration
3 Computers & Mathematics with Applications
3 Communications in Mathematical Physics
3 Journal of Computational and Applied Mathematics
3 Theoretical Computer Science
3 Transactions of the American Mathematical Society
3 Circuits, Systems, and Signal Processing
3 Physica D
3 Optimization
3 Journal of Theoretical Probability
3 Neural Networks
3 Communications in Partial Differential Equations
3 Linear Algebra and its Applications
3 Proceedings of the Indian Academy of Sciences. Mathematical Sciences
3 Journal of Dynamics and Differential Equations
3 Applicationes Mathematicae
3 Top
3 Monte Carlo Methods and Applications
3 Doklady Mathematics
3 European Series in Applied and Industrial Mathematics (ESAIM): Probability and Statistics
3 Differential Equations
3 Discrete and Continuous Dynamical Systems. Series B
3 Statistics and Computing
2 Artificial Intelligence
2 International Journal of General Systems
2 Journal of Mathematical Biology
2 Theoretical and Mathematical Physics
2 Information Sciences
2 Journal of Multivariate Analysis
2 Proceedings of the American Mathematical Society
2 Theoretical Population Biology
2 Optimal Control Applications & Methods
2 Information and Computation
2 Mathematical and Computer Modelling
...and 144 more Serials
all top 5

Cited in 38 Fields

563 Systems theory; control (93-XX)
387 Probability theory and stochastic processes (60-XX)
360 Operations research, mathematical programming (90-XX)
238 Calculus of variations and optimal control; optimization (49-XX)
170 Game theory, economics, finance, and other social and behavioral sciences (91-XX)
108 Computer science (68-XX)
105 Statistics (62-XX)
81 Numerical analysis (65-XX)
66 Partial differential equations (35-XX)
44 Ordinary differential equations (34-XX)
25 Dynamical systems and ergodic theory (37-XX)
24 Biology and other natural sciences (92-XX)
17 Statistical mechanics, structure of matter (82-XX)
17 Information and communication theory, circuits (94-XX)
16 Operator theory (47-XX)
11 Combinatorics (05-XX)
10 Linear and multilinear algebra; matrix theory (15-XX)
10 Measure and integration (28-XX)
10 Mechanics of particles and systems (70-XX)
10 Quantum theory (81-XX)
6 Real functions (26-XX)
5 Mathematical logic and foundations (03-XX)
5 Functional analysis (46-XX)
3 Potential theory (31-XX)
2 Number theory (11-XX)
2 Category theory; homological algebra (18-XX)
2 Integral equations (45-XX)
2 Global analysis, analysis on manifolds (58-XX)
2 Mechanics of deformable solids (74-XX)
2 Optics, electromagnetic theory (78-XX)
1 Functions of a complex variable (30-XX)
1 Several complex variables and analytic spaces (32-XX)
1 Difference and functional equations (39-XX)
1 Approximations and expansions (41-XX)
1 Harmonic analysis on Euclidean spaces (42-XX)
1 Geometry (51-XX)
1 Convex and discrete geometry (52-XX)
1 Classical thermodynamics, heat transfer (80-XX)

Citations by Year

The data are displayed as stored in Wikidata under a Creative Commons CC0 License. Updates and corrections should be made in Wikidata.