Vivek S. Borkar

According to our database, Vivek S. Borkar authored at least 206 papers between 1991 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Tabular and Deep Learning for the Whittle Index.

Francisco Robledo Relaño, Vivek S. Borkar, Urtzi Ayesta, Konstantin Avrachenkov

ACM Trans. Model. Perform. Evaluation Comput. Syst., September, 2024

Controlled Martingale Problems and Their Markov Mimics.

Siva Athreya, Vivek S. Borkar, Nitya Gadhiwala

SIAM J. Control. Optim., 2024

Reinforcement learning in non-Markovian environments.

Siddharth Chandak, Pratik Shah, Vivek S. Borkar, Parth Dodhia

Syst. Control. Lett., 2024

Whittle Index Based User Association in Dense Millimeter Wave Networks.

Mandar R. Nalavade, Gaurav S. Kasbekar, Vivek S. Borkar

CoRR, 2024

Minkowski Descent: An Algorithm for Stochastic Global Optimization.

Keshav Patel Keval, Vivek Shripad Borkar, Ananya Singhal

Proceedings of the 60th Annual Allerton Conference on Communication, 2024

2023

Stochastic control and stability with applications: Ari Arapostathis memorial issue.

Vivek S. Borkar, Prashant G. Mehta, Guodong Pang, Serdar Yüksel

Syst. Control. Lett., April, 2023

Special Issue : Multi-Agent Dynamic Decision Making and Learning.

Konstantin Avrachenkov, Vivek S. Borkar, U. Jayakrishnan Nair

Dyn. Games Appl., March, 2023

Ergodic risk-sensitive control - A survey.

Anup Biswas, Vivek S. Borkar

Annu. Rev. Control., January, 2023

A concentration bound for LSPE(λ).

Siddharth Chandak, Vivek S. Borkar, Harsh Dolhare

Syst. Control. Lett., 2023

Actor-Critic or Critic-Actor? A Tale of Two Time Scales.

Shalabh Bhatnagar, Vivek S. Borkar, Soumyajit Guin

IEEE Control. Syst. Lett., 2023

A Concentration Bound for TD(0) with Function Approximation.

Siddharth Chandak, Vivek S. Borkar

CoRR, 2023

Approximation of Convex Envelope Using Reinforcement Learning.

Vivek S. Borkar, Adit Akarsh

CoRR, 2023

Decentralised Q-Learning for Multi-Agent Markov Decision Processes with a Satisfiability Criterion.

Keshav P. Keval, Vivek S. Borkar

CoRR, 2023

Node Cardinality Estimation in the Internet of Things Using Privileged Feature Distillation.

Pranav S. Page, Anand S. Siyote, Vivek S. Borkar, Gaurav S. Kasbekar

CoRR, 2023

Full Gradient Deep Reinforcement Learning for Average-Reward Criterion.

Tejas Pagare, Vivek S. Borkar, Konstantin Avrachenkov

Proceedings of the Learning for Dynamics and Control Conference, 2023

Online Parameter Estimation in Partially Observed Markov Decision Processes.

Sai Sumedh R. Hindupur, Vivek S. Borkar

Proceedings of the 59th Annual Allerton Conference on Communication, 2023

2022

User Association in Dense mmWave Networks as Restless Bandits.

Santosh Kumar Singh, Vivek S. Borkar, Gaurav S. Kasbekar

IEEE Trans. Veh. Technol., 2022

Opinion Shaping in Social Networks Using Reinforcement Learning.

Vivek S. Borkar, Alexandre Reiffers-Masson

IEEE Trans. Control. Netw. Syst., 2022

Dynamic Social Learning Under Graph Constraints.

Konstantin E. Avrachenkov, Vivek S. Borkar, Sharayu Moharir, Suhail Mohmad Shah

IEEE Trans. Control. Netw. Syst., 2022

Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes.

Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar

IEEE Trans. Autom. Control., 2022

QWI: Q-learning with Whittle Index.

Francisco Robledo, Vivek S. Borkar, Urtzi Ayesta, Konstantin Avrachenkov

SIGMETRICS Perform. Evaluation Rev., 2022

Revisiting SIR in the Age of COVID-19: Explicit Solutions and Control Problems.

Vivek S. Borkar, D. Manjunath

SIAM J. Control. Optim., 2022

ERRATUM: LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The Nonergodic Case.

Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman

SIAM J. Control. Optim., 2022

Corrigendum to "A concentration bound for contractive stochastic approximation" [Syst. Control Lett. 153 (2021) 104947].

Vivek S. Borkar

Syst. Control. Lett., 2022

Learning to cooperate in agent-based control of queueing networks.

Vivek S. Borkar

Queueing Syst. Theory Appl., 2022

Reinforcement Learning in Non-Markovian Environments.

Siddharth Chandak, Vivek S. Borkar, Parth Dodhia

CoRR, 2022

Concentration bounds for SSP Q-learning for average cost MDPs.

Shaan Ul Haque, Vivek S. Borkar

CoRR, 2022

Whittle index based Q-learning for restless bandits with average reward.

Konstantin E. Avrachenkov, Vivek S. Borkar

Autom., 2022

Whittle indexability in egalitarian processor sharing systems.

Vivek S. Borkar, Sarath Pattathil

Ann. Oper. Res., 2022

Scheduling in Wireless Networks using Whittle Index Theory.

Karthik G. V. B., Vivek S. Borkar, Gaurav S. Kasbekar

Proceedings of the 27th National Conference on Communications, 2022

A Concentration Bound for Distributed Stochastic Approximation.

Harsh Dolhare, Vivek S. Borkar

Proceedings of the 58th Annual Allerton Conference on Communication, 2022

2021

Prospect-theoretic Q-learning.

Vivek S. Borkar, Siddharth Chandak

Syst. Control. Lett., 2021

A concentration bound for contractive stochastic approximation.

Vivek S. Borkar

Syst. Control. Lett., 2021

Scheduling in wireless networks with spatial reuse of spectrum as restless bandits.

Vivek S. Borkar, Shantanu Choudhary, Vaibhav Kumar Gupta, Gaurav S. Kasbekar

Perform. Evaluation, 2021

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning.

Vivek S. Borkar, Shuhang Chen, Adithya M. Devraj, Ioannis Kontoyiannis, Sean P. Meyn

CoRR, 2021

Concentration of Contractive Stochastic Approximation and Reinforcement Learning.

Siddharth Chandak, Vivek S. Borkar

CoRR, 2021

Full Gradient DQN Reinforcement Learning: A Provably Convergent Scheme.

Konstantin Avrachenkov, Vivek S. Borkar, H. P. Dolhare, K. Patil

CoRR, 2021

Maximizing Conditional Entropy for Batch-Mode Active Learning of Perceptual Metrics.

Priyadarshini Kumari, Siddhartha Chaudhuri, Vivek S. Borkar, Subhasis Chaudhuri

CoRR, 2021

Accelerating MCMC by Rare Intermittent Resets.

Vivek S. Borkar, Syomantak Chaudhuri

Proceedings of the Performance Evaluation Methodologies and Tools, 2021

A Unified Batch Selection Policy for Active Metric Learning.

Priyadarshini Kumari, Siddhartha Chaudhuri, Vivek S. Borkar, Subhasis Chaudhuri

Proceedings of the Machine Learning and Knowledge Discovery in Databases. Research Track, 2021

Linear and Dynamic Programs for Risk-Sensitive Cost Minimization.

Ari Arapostathis, Vivek S. Borkar

Proceedings of the 2021 60th IEEE Conference on Decision and Control (CDC), 2021

2020

Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet.

Arghyadip Roy, Vivek S. Borkar, Prasanna Chaporkar, Abhay Karandikar

IEEE Trans. Mob. Comput., 2020

A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝ^d.

Ari Arapostathis, Anup Biswas, Vivek S. Borkar, K. Suresh Kumar

SIAM J. Control. Optim., 2020

2019

LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case.

Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman

SIAM J. Control. Optim., 2019

Stochastic approximation algorithms for rumor source inference on graphs.

Anand Kalvit, Vivek S. Borkar, Nikhil Karamchandani

Perform. Evaluation, 2019

Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents.

Bhumesh Kumar, Vivek S. Borkar, Akhil Shetty

Math. Control. Signals Syst., 2019

Linear Programming Formulation of Long-Run Average Optimal Control Problem.

Vivek S. Borkar, Vladimir Gaitsgory

J. Optim. Theory Appl., 2019

Aerial monitoring of slow moving convoys using elliptical orbits.

Aseem Vivek Borkar, Vivek S. Borkar, Arpita Sinha

Eur. J. Control, 2019

Metastability in Stochastic Replicator Dynamics.

Konstantin Avrachenkov, Vivek S. Borkar

Dyn. Games Appl., 2019

Average cost optimal control under weak hypotheses: Relative value iterations.

Ari Arapostathis, Vivek S. Borkar

CoRR, 2019

A Structure-aware Online Learning Algorithm for Markov Decision Processes.

Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar

Proceedings of the 12th EAI International Conference on Performance Evaluation Methodologies and Tools, 2019

On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case.

Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman

Proceedings of the 58th IEEE Conference on Decision and Control, 2019

A learning algorithm for the Whittle index policy for scheduling web crawlers.

Konstantin Avrachenkov, Vivek S. Borkar

Proceedings of the 57th Annual Allerton Conference on Communication, 2019

2018

Opportunistic Scheduling as Restless Bandits.

Vivek S. Borkar, Gaurav S. Kasbekar, Sarath Pattathil, Priyesh Y. Shetty

IEEE Trans. Control. Netw. Syst., 2018

Whittle Index Policy for Crawling Ephemeral Content.

Konstantin E. Avrachenkov, Vivek S. Borkar

IEEE Trans. Control. Netw. Syst., 2018

Distributed Stochastic Approximation with Local Projections.

Suhail Mohmad Shah, Vivek S. Borkar

SIAM J. Optim., 2018

Q-learning for Markov decision processes with a satisfiability criterion.

Suhail M. Shah, Vivek S. Borkar

Syst. Control. Lett., 2018

Distributed Algorithms: Tsitsiklis and Beyond.

Vivek S. Borkar, Suhail Mohmad Shah

Proceedings of the 2018 Information Theory and Applications Workshop, 2018

Concentration bounds for two time scale stochastic approximation.

Vivek S. Borkar, Sarath Pattathil

Proceedings of the 56th Annual Allerton Conference on Communication, 2018

2017

Temporally Agnostic Rumor-Source Detection.

Ankit Kumar, Vivek S. Borkar, Nikhil Karamchandani

IEEE Trans. Signal Inf. Process. over Networks, 2017

Distributed Reinforcement Learning via Gossip.

Adwaitvedant S. Mathkar, Vivek S. Borkar

IEEE Trans. Autom. Control., 2017

Whittle Index for Partially Observed Binary Markov Decision Processes.

Vivek S. Borkar

IEEE Trans. Autom. Control., 2017

A Distributed Boyle-Dykstra-Han Scheme.

Soham R. Phade, Vivek S. Borkar

SIAM J. Optim., 2017

A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions".

Ari Arapostathis, Vivek S. Borkar

SIAM J. Control. Optim., 2017

A Variational Formula for Risk-Sensitive Reward.

V. Anantharam, Vivek S. Borkar

SIAM J. Control. Optim., 2017

Gradient Estimation with Simultaneous Perturbation and Compressive Sensing.

Vivek S. Borkar, Vikranth Reddy Dwaracherla, Neeraja Sahasrabudhe

J. Mach. Learn. Res., 2017

Approachability in Stackelberg Stochastic Games with Vector Costs.

Dileep M. Kalathil, Vivek S. Borkar, Rahul Jain

Dyn. Games Appl., 2017

Distributed Server Allocation for Content Delivery Networks.

Sarath Pattathil, Vivek S. Borkar, Gaurav S. Kasbekar

CoRR, 2017

MCMC Approaches to Rumor Source Inference using Pairwise Information.

Anand Kalvit, Vivek S. Borkar, Nikhil Karamchandani

Proceedings of the 11th EAI International Conference on Performance Evaluation Methodologies and Tools, 2017

A dynamic programming framework for optimal home scheduling.

Anupama Kowli, Joel Jose, Vivek S. Borkar, Imthias Ahamed T. P.

Proceedings of the 2017 IEEE Innovative Smart Grid Technologies - Asia, 2017

Vector field guidance for convoy monitoring using elliptical orbits.

Aseem Vivek Borkar, Vivek S. Borkar, Arpita Sinha

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

Linear and dynamic programming approaches to degenerate risk-sensitive reward processes.

Vivek S. Borkar

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

Controlling G-AIMD by index policy.

Konstantin E. Avrachenkov, Vivek S. Borkar, Sarath Pattathil

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

2016

Actor-Critic Algorithms with Online Feature Adaptation.

Prabuchandran K. J., Shalabh Bhatnagar, Vivek S. Borkar

ACM Trans. Model. Comput. Simul., 2016

Fast rumor source identification via random walks.

Alankar Jain, Vivek S. Borkar, Dinesh Garg

Soc. Netw. Anal. Min., 2016

Nonlinear Gossip.

Adwaitvedant S. Mathkar, Vivek S. Borkar

SIAM J. Control. Optim., 2016

Gaussian approximations in high dimensional estimation.

Vivek S. Borkar, Raaz Dwivedi, Neeraja Sahasrabudhe

Syst. Control. Lett., 2016

An Adaptive Window Scheme for Backoff in 802.11 MAC Protocol.

Priyesh Y. Shetty, Vivek S. Borkar, Gaurav S. Kasbekar

EAI Endorsed Trans. Wirel. Spectr., 2016

Distributed and Asynchronous Methods for Semi-supervised Learning.

Konstantin Avrachenkov, Vivek S. Borkar, Krishnakant V. Saboo

Proceedings of the Algorithms and Models for the Web Graph - 13th International Workshop, 2016

Randomized Kaczmarz for rank aggregation from pairwise comparisons.

Vivek S. Borkar, Nikhil Karamchandani, Sharad Mirani

Proceedings of the 2016 IEEE Information Theory Workshop, 2016

A concentration result for stochastic approximation (Extended abstract).

Gugan Thoppe, Vivek S. Borkar

Proceedings of the 2016 Information Theory and Applications Workshop, 2016

Comparison of Random Walk Based Techniques for Estimating Network Averages.

Konstantin Avrachenkov, Vivek S. Borkar, Arun Kadavankandy, Jithin Kazuthuveettil Sreedharan

Proceedings of the Computational Social Networks - 5th International Conference, 2016

Edge conductance estimation using MCMC.

Ashish Bora, Vivek S. Borkar, Dinesh Garg, Rajesh Sundaresan

Proceedings of the 54th Annual Allerton Conference on Communication, 2016

2015

Manufacturing Consent.

Vivek S. Borkar, Aditya Karnik, Jayakrishnan Nair, Sanketh Nalli

IEEE Trans. Autom. Control., 2015

Parallel and Distributed Approaches for Graph Based Semi-supervised Learning.

Konstantin Avrachenkov, Vivek S. Borkar, Krishnakant V. Saboo

CoRR, 2015

A variational formula for risk-sensitive reward.

Venkatachalam Anantharam, Vivek Shripad Borkar

CoRR, 2015

Rocking in two by two: From Collatz-Wielandt to Donsker-Varadhan.

V. Anantharam, Vivek S. Borkar

Proceedings of the 2015 Information Theory and Applications Workshop, 2015

2014

Risk-Constrained Markov Decision Processes.

Vivek S. Borkar, Rahul Jain

IEEE Trans. Autom. Control., 2014

Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs.

Ari Arapostathis, Vivek S. Borkar, K. Suresh Kumar

SIAM J. Control. Optim., 2014

Asynchronous Gossip for Averaging and Spectral Ranking.

Vivek S. Borkar, Rahul Makhijani, Rajesh Sundaresan

IEEE J. Sel. Top. Signal Process., 2014

An Improved Block Coordinate Descent Method for Quadratic Programming in High Dimensions.

Gugan Thoppe, Vivek S. Borkar, Dinesh Garg

CoRR, 2014

Empirical Q-Value Iteration.

Dileep M. Kalathil, Vivek S. Borkar, Rahul Jain

CoRR, 2014

A Learning Scheme for Approachability in MDPs and Stackelberg Stochastic Games.

Dileep M. Kalathil, Vivek S. Borkar, Rahul Jain

CoRR, 2014

A stochastic Kaczmarz algorithm for network tomography.

Gugan Thoppe, Vivek S. Borkar, D. Manjunath

Autom., 2014

Submodularity in Team Formation Problem.

Avradeep Bhowmik, Vivek S. Borkar, Dinesh Garg, Madhavan Pallan

Proceedings of the 2014 SIAM International Conference on Data Mining, 2014

Reinforcement learning, particle filters and the EM algorithm.

Vivek S. Borkar, Ankushkumar Jain

Proceedings of the 2014 Information Theory and Applications Workshop, 2014

Reinforcement Learning for Matrix Computations: PageRank as an Example.

Vivek S. Borkar, Adwaitvedant S. Mathkar

Proceedings of the Distributed Computing and Internet Technology, 2014

Blackwell's approachability in stackelberg stochastic games: A learning version.

Dileep M. Kalathil, Vivek S. Borkar, Rahul Jain

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

An actor critic algorithm based on Grassmanian search.

Prabuchandran K. J., Shalabh Bhatnagar, Vivek S. Borkar

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

From Collatz-Weilandt to Donkser-Varadhan via Krein-Rutman.

Ari Arapostathis, Vivek S. Borkar, K. Suresh Kumar

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions.

Ari Arapostathis, Vivek S. Borkar, K. Suresh Kumar

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

2013

On the diffusion of messages in on-line social networks.

Aditya Karnik, Atul Saroop, Vivek S. Borkar

Perform. Evaluation, 2013

Feature Search in the Grassmanian in Online Reinforcement Learning.

Shalabh Bhatnagar, Vivek S. Borkar, Prabuchandran K. J.

IEEE J. Sel. Top. Signal Process., 2013

Markov chains, Hamiltonian cycles and volumes of convex bodies.

Vivek S. Borkar, Jerzy A. Filar

J. Glob. Optim., 2013

Model-based clock synchronization protocol for wireless sensor networks.

Nikolaos M. Freris, Vivek S. Borkar, P. R. Kumar

CoRR, 2013

How to gossip if you must.

Vivek S. Borkar, Rahul Makhijani, Rajesh Sundaresan

CoRR, 2013

Gossip with transmission constraints.

Vivek S. Borkar, Rahul Makhijani, Rajesh Sundaresan

Proceedings of the 2013 Information Theory and Applications Workshop, 2013

2012

A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions.

Ari Arapostathis, Vivek S. Borkar

SIAM J. Control. Optim., 2012

Stochastic approximation with long range dependent and heavy tailed noise.

Venkat Anantharam, Vivek S. Borkar

Queueing Syst. Theory Appl., 2012

Relative Value Iteration for Stochastic Differential Games

Ari Arapostathis, Vivek S. Borkar, K. Suresh Kumar

CoRR, 2012

Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control.

Vivek S. Borkar, Sean P. Meyn

Autom., 2012

A relative value iteration for controlled diffusions under ergodic cost.

Ari Arapostathis, Vivek S. Borkar

Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Who is the fairest of them all?

Vivek S. Borkar, Rahul M. Makhijani

Proceedings of the 50th Annual Allerton Conference on Communication, 2012

2011

Optimal Control of Sleep Periods for Wireless Terminals.

Amar Prakash Azad, Sara Alouf, Eitan Altman, Vivek S. Borkar, Georgios S. Paschos

IEEE J. Sel. Areas Commun., 2011

Stochastic approximation with 'bad' noise.

Venkat Anantharam, Vivek S. Borkar

Proceedings of the Information Theory and Applications Workshop, 2011

Risk sensitive optimal control framework applied to delay tolerant networks.

Eitan Altman, Veeraruna Kavitha, Francesco De Pellegrini, Vijay Kamble, Vivek S. Borkar

Proceedings of the INFOCOM 2011. 30th IEEE International Conference on Computer Communications, 2011

Convergence analysis for an online recommendation system.

Anh Truong, Negar Kiyavash, Vivek S. Borkar

Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference, 2011

Asymptotics of the invariant measure in mean field models with jumps.

Vivek Shripad Borkar, Rajesh Sundaresan

Proceedings of the 49th Annual Allerton Conference on Communication, 2011

Controlled gossip.

Vivek S. Borkar, Aditya Karnik

Proceedings of the 49th Annual Allerton Conference on Communication, 2011

2010

A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling.

Nitin Salodkar, Abhay Karandikar, Vivek S. Borkar

IEEE Trans. Mob. Comput., 2010

Singular Perturbations in Risk-Sensitive Stochastic Control.

Vivek S. Borkar, K. Suresh Kumar

SIAM J. Control. Optim., 2010

ERRATUM: White-Noise Representations in Stochastic Realization Theory.

Vivek S. Borkar

SIAM J. Control. Optim., 2010

Uniform Recurrence Properties of Controlled Diffusions and Applications to Optimal Control.

Ari Arapostathis, Vivek S. Borkar

SIAM J. Control. Optim., 2010

On a controlled eigenvalue problem.

Anup Biswas, Vivek S. Borkar

Syst. Control. Lett., 2010

Application of nonlinear filtering to credit risk.

Vivek S. Borkar, Mrinal K. Ghosh, Govindan Rangarajan

Oper. Res. Lett., 2010

Quasi-stationary distributions as centrality measures for the giant strongly connected component of a reducible graph.

Konstantin Avrachenkov, Vivek S. Borkar, Danil Nemirovsky

J. Comput. Appl. Math., 2010

Manufacturing consent.

Vivek S. Borkar, Jayakrishnan Nair, Sanketh Nalli

Proceedings of the 48th Annual Allerton Conference on Communication, 2010

2009

A novel ACO algorithm for optimization via reinforcement and initial bias.

Vivek S. Borkar, Dibyajyoti Das

Swarm Intell., 2009

Cooperative dynamics and Wardrop equilibria.

Vivek S. Borkar

Syst. Control. Lett., 2009

On the Hamiltonicity Gap and doubly stochastic matrices.

Vivek S. Borkar, Vladimir Ejov, Jerzy A. Filar

Random Struct. Algorithms, 2009

A New Learning Algorithm for Optimal Stopping.

Vivek S. Borkar, Jervis Pinto, Tarun Prabhu

Discret. Event Dyn. Syst., 2009

A Stable On-line Algorithm for Energy Efficient Multi-user Scheduling

Nitin Salodkar, Abhay Karandikar, Vivek S. Borkar

CoRR, 2009

Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space.

Ankur A. Kulkarni, Vivek S. Borkar

Autom., 2009

Vacation policy optimization with application to IEEE 802.16e power saving mechanism.

Amar P. Azad, Sara Alouf, Eitan Altman, Vivek S. Borkar, Georgios S. Paschos

Proceedings of the 2nd IFIP Wireless Days, 2009

A Theory of QoS for Wireless.

I-Hong Hou, Vivek S. Borkar, P. R. Kumar

Proceedings of the INFOCOM 2009. 28th IEEE International Conference on Computer Communications, 2009

Convergence of population dynamics in symmetric routing games with a finite number of playersz.

Eitan Altman, Vijay Kamble, Vivek S. Borkar

Proceedings of the 1st International Conference on Game Theory for Networks, 2009

A model-based approach to clock synchronization.

Nikolaos M. Freris, Vivek S. Borkar, P. R. Kumar

Proceedings of the 48th IEEE Conference on Decision and Control, 2009

Optimal sampling for state change detection with application to the control of sleep mode.

Amar Prakash Azad, Sara Alouf, Eitan Altman, Vivek S. Borkar, George Paschos

Proceedings of the 48th IEEE Conference on Decision and Control, 2009

2008

Distributed topology control of wireless networks.

Vivek S. Borkar, D. Manjunath

Wirel. Networks, 2008

Structural Properties of Optimal Transmission Policies Over a Randomly Varying Channel.

Mukul Agarwal, Vivek S. Borkar, Abhay Karandikar

IEEE Trans. Autom. Control., 2008

Stochastic Control with Imperfect Models.

Arnab Basu, Vivek S. Borkar

SIAM J. Control. Optim., 2008

A note on linear function approximation using random projections.

Kishor Barman, Vivek S. Borkar

Syst. Control. Lett., 2008

A Learning Algorithm for Risk-Sensitive Cost.

Arnab Basu, Tirthankar Bhattacharyya, Vivek S. Borkar

Math. Oper. Res., 2008

An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel.

Nitin Salodkar, Abhijeet Bhorkar, Abhay Karandikar, Vivek S. Borkar

IEEE J. Sel. Areas Commun., 2008

Oja's algorithm for graph clustering and Markov spectral decomposition.

Vivek S. Borkar, Sean P. Meyn

Proceedings of the 3rd International ICST Conference on Performance Evaluation Methodologies and Tools, 2008

Opportunistic Transmission over Randomly Varying Channels.

Vivek S. Borkar

Proceedings of the Network Control and Optimization, Second Euro-NF Workshop, 2008

Index Policies for Real-Time Multicast Scheduling for Wireless Broadcast Systems.

Vivek Raghunathan, Vivek S. Borkar, Min Cao, P. R. Kumar

Proceedings of the INFOCOM 2008. 27th IEEE International Conference on Computer Communications, 2008

A learning scheme for stationary probabilities of large markov chains with examples.

Vivek S. Borkar, D. J. Das, Abhijit Datta Banik, D. Manjunath

Proceedings of the 46th Annual Allerton Conference on Communication, 2008

2007

Singular Perturbations in Ergodic Control of Diffusions.

Vivek S. Borkar, Vladimir Gaitsgory

SIAM J. Control. Optim., 2007

Dynamic Programming for Ergodic Control of Markov Chains under Partial Observations: A Correction.

Vivek S. Borkar

SIAM J. Control. Optim., 2007

Common randomness and distributed control: A counterexample.

Venkat Anantharam, Vivek S. Borkar

Syst. Control. Lett., 2007

Power Efficient Scheduling under Delay Constraints over Multi-user Wireless Channels

Nitin Salodkar, Abhay Karandikar, Vivek S. Borkar

CoRR, 2007

Quasi-stationary distributions as centrality measures of reducible graphs

Konstantin Avrachenkov, Vivek S. Borkar, Danil Nemirovsky

CoRR, 2007

Some Examples of Stochastic Approximation in Communications.

Vivek S. Borkar

Proceedings of the Network Control and Optimization, 2007

An Information Theoretic View of Stochastic Resonance.

Venkat Anantharam, Vivek S. Borkar

Proceedings of the IEEE International Symposium on Information Theory, 2007

2006

Distributed self-tuning of sensor networks.

Aditya Karnik, Anurag Kumar, Vivek S. Borkar

Wirel. Networks, 2006

Erratum to "Avoidance of traps in stochastic approximation" [Systems Control Letters 50 (2003) 1-9].

Vivek S. Borkar

Syst. Control. Lett., 2006

Stochastic approximation with 'controlled Markov' noise.

Vivek S. Borkar

Syst. Control. Lett., 2006

A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events.

Shalabh Bhatnagar, Vivek S. Borkar, Madhukar Akarapu

J. Mach. Learn. Res., 2006

Adaptive Importance Sampling Technique for Markov Chains Using Stochastic Approximation.

T. P. I. Ahamed, Vivek S. Borkar, S. Juneja

Oper. Res., 2006

Power Optimal Opportunistic Scheduling.

Abhijeet Bhorkar, Abhay Karandikar, Vivek S. Borkar

Proceedings of the Global Telecommunications Conference, 2006. GLOBECOM '06, San Francisco, CA, USA, 27 November, 2006

A New Distributed Time Synchronization Protocol for Multihop Wireless Networks.

Roberto Solis-Robles, Vivek S. Borkar, Panganamala R. Kumar

Proceedings of the 45th IEEE Conference on Decision and Control, 2006

Existence of limit occupational measures set used for averaging of singularly perturbed controlled stochastic differential equations.

Vivek S. Borkar, Vladimir Gaitsgory

Proceedings of the 45th IEEE Conference on Decision and Control, 2006

2005

On Existence of Limit Occupational Measures Set of a Controlled Stochastic Differential Equation.

Vivek S. Borkar, Vladimir Gaitsgory

SIAM J. Control. Optim., 2005

An actor-critic algorithm for constrained Markov decision processes.

Vivek S. Borkar

Syst. Control. Lett., 2005

Closed and Open Loop Optimal Control of Buffer and Energy of a Wireless Device.

Vivek S. Borkar, Arzad Alam Kherani, B. J. Prabhu

Proceedings of the 3rd International Symposium on Modeling and Optimization in Mobile, 2005

Sequential Source Coding: An optimization viewpoint.

Vivek S. Borkar, Sanjoy K. Mitter, Anant Sahai, Sekhar Tatikonda

Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

HJB Equations for Ergodic Control Problems for Constrained Diffusions in Polyhedral Domains.

Vivek S. Borkar, Amarjit Budhiraja

Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

2004

Ergodic Control for Constrained Diffusions: Characterization Using HJB Equations.

Vivek S. Borkar, Amarjit Budhiraja

SIAM J. Control. Optim., 2004

Directed graphs, Hamiltonicity and doubly stochastic matrices.

Vivek S. Borkar, Vladimir Ejov, Jerzy A. Filar

Random Struct. Algorithms, 2004

Charge-based control of DiffServ-like queues.

Vivek S. Borkar, D. Manjunath

Autom., 2004

Optimal random access in networks with two-way traffic.

Eitan Altman, Vivek S. Borkar, Arzad Alam Kherani

Proceedings of the IEEE 15th International Symposium on Personal, 2004

Some Game-Theoretic Problems in Wireless Ad-Hoc Networks.

Eitan Altman, Vivek S. Borkar, Arzad Alam Kherani, Pietro Michiardi, Refik Molva

Proceedings of the Wireless Systems and Mobility in Next Generation Internet, 2004

2003

Dynamic Cesaro-Wardrop equilibration in networks.

Vivek S. Borkar, Panganamala Ramana Kumar

IEEE Trans. Autom. Control., 2003

Multiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization.

Shalabh Bhatnagar, Vivek S. Borkar

Simul., 2003

Avoidance of traps in stochastic approximation.

Vivek S. Borkar

Syst. Control. Lett., 2003

Peformance Analysis Conditioned on Rare Events: An Adaptive Simulation Scheme.

Vivek S. Borkar, S. Juneja, Arzad Alam Kherani

Commun. Inf. Syst., 2003

Algorithmic Mechanisms for Secure Multi-Auction Systems.

Vivek S. Borkar, Mehul S. Dave, R. K. Shyamasundar

Proceedings of the 1st Indian International Conference on Artificial Intelligence, 2003

Value functions and performance evaluation in stochastic network models.

Vivek S. Borkar, Sean P. Meyn

Proceedings of the 42nd IEEE Conference on Decision and Control, 2003

2002

Stochastic Approximation for Nonexpansive Maps: Application to Q-Learning Algorithms.

Jinane Abounadi, Dimitri P. Bertsekas, Vivek S. Borkar

SIAM J. Control. Optim., 2002

Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost.

Vivek S. Borkar, Sean P. Meyn

Math. Oper. Res., 2002

Q-Learning for Risk-Sensitive Control.

Vivek S. Borkar

Math. Oper. Res., 2002

Mathematical Programming Embeddings of Logic.

Vivek S. Borkar, Vijay Chandru, Sanjoy K. Mitter

J. Autom. Reason., 2002

On The Lock-In Probability Of Stochastic Approximation.

Vivek S. Borkar

Comb. Probab. Comput., 2002

Reinforcement Learning in Markovian Evolutionary Games.

Vivek S. Borkar

Adv. Complex Syst., 2002

Differential Join Prices for Parallel Queues: Social Optimality, Dynamic Pricing Algorithms and Application to Internet Pricing.

Parijat Dube, Vivek S. Borkar, D. Manjunath

Proceedings of the Proceedings IEEE INFOCOM 2002, 2002

2001

Optimal Sequential Vector Quantization of Markov Sources.

Vivek S. Borkar, Sanjoy K. Mitter, Sekhar Tatikonda

SIAM J. Control. Optim., 2001

Learning Algorithms for Markov Decision Processes with Average Cost.

Jinane Abounadi, Dimitri P. Bertsekas, Vivek S. Borkar

SIAM J. Control. Optim., 2001

A sensitivity formula for risk-sensitive cost and the actor-critic algorithm.

Vivek S. Borkar

Syst. Control. Lett., 2001

Markov control problems under communication constraints.

Vivek S. Borkar, Sanjoy K. Mitter, Sekhar Tatikonda

Commun. Inf. Syst., 2001

2000

The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning.

Vivek S. Borkar, Sean P. Meyn

SIAM J. Control. Optim., 2000

Erratum: Asynchronous Stochastic Approximations.

Vivek S. Borkar

SIAM J. Control. Optim., 2000

Average Cost Dynamic Programming Equations For Controlled Markov Chains With Partial Observations.

Vivek S. Borkar

SIAM J. Control. Optim., 2000

A learning algorithm for Markov decision processes with adaptive state aggregation.

John S. Baras, Vivek S. Borkar

Proceedings of the 39th IEEE Conference on Decision and Control, 2000

1999

Randomized neural networks for learning stochastic dependences.

Vivek S. Borkar, Piyush Gupta

IEEE Trans. Syst. Man Cybern. Part B, 1999

Actor-Critic - Type Learning Algorithms for Markov Decision Processes.

Vijaymohan Konda, Vivek S. Borkar

SIAM J. Control. Optim., 1999

1998

A unified framework for hybrid control: model and optimal control theory.

Michael S. Branicky, Vivek S. Borkar, Sanjoy K. Mitter

IEEE Trans. Autom. Control., 1998

Dynamics of individual specialization and global diversification in communities.

Vivek S. Borkar, Sanjay Jain, Govindan Rangarajan

Complex., 1998

Generalized Replicator Dynamics as a Model of Specialization and Diversity in Societies.

Vivek S. Borkar, Sanjay Jain, Govindan Rangarajan

Adv. Complex Syst., 1998

1997

Learning Decentralized Goal-based Vector Quantization.

Piyush Gupta, Vivek S. Borkar

Complex Syst., 1997

1996

Stochastic processes that generate polygonal and related random fields.

Vivek S. Borkar, Sanjoy K. Mitter

IEEE Trans. Inf. Theory, 1996

1995

A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes.

Shalabh Bhatnagar, Vivek S. Borkar

Math. Oper. Res., 1995

Epsilon-Approximation of Differential Inclusions.

Anuj Puri, Vivek S. Borkar, Pravin Varaiya

Proceedings of the Hybrid Systems III: Verification and Control, 1995

1992

Ergodic and adaptive control of nearest-neighbor motions.

Vivek S. Borkar, Mrinal K. Ghosh

Math. Control. Signals Syst., 1992

Weak convergence methods and singularly perturbed stochastic control and filtering problems: Harold J. Kushner.

Vivek S. Borkar

Autom., 1992

1991

A remark on control of partially observed Markov chains.

Vivek S. Borkar

Ann. Oper. Res., 1991