Rahul Jain

IEEE Trans. Autom. Control., January, 2025

2024

Optimal Communication and Control Strategies in a Cooperative Multiagent MDP Problem.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., October, 2024

Probabilistic Contraction Analysis of Iterated Random Operators.

[BibT_eX]

[DOI]

Abhishek Gupta

Peter W. Glynn

IEEE Trans. Autom. Control., September, 2024

Compositional Planning for Logically Constrained Multi-Agent Markov Decision Processes.

[BibT_eX]

[DOI]

CoRR, 2024

Markov Balance Satisfaction Improves Performance in Strictly Batch Offline Imitation Learning.

[BibT_eX]

[DOI]

CoRR, 2024

Online Bandit Learning with Offline Preference Data.

[BibT_eX]

[DOI]

CoRR, 2024

e-COP : Episodic Constrained Optimization of Policies.

[BibT_eX]

[DOI]

CoRR, 2024

Pure Exploration for Constrained Best Mixed Arm Identification with a Fixed Budget.

[BibT_eX]

[DOI]

CoRR, 2024

ACPO: A Policy Optimization Algorithm for Average MDPs with Constraints.

[BibT_eX]

[DOI]

Akhil Agnihotri

Proceedings of the Forty-first International Conference on Machine Learning, 2024

A Bayesian Learning Algorithm for Unknown Zero-sum Stochastic Games with an Arbitrary Opponent.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2024

2023

Bridging Imitation and Online Reinforcement Learning: An Optimistic Tale.

[BibT_eX]

[DOI]

Trans. Mach. Learn. Res., 2023

Efficient Online Learning with Offline Datasets for Infinite Horizon MDPs: A Bayesian Approach.

[BibT_eX]

[DOI]

CoRR, 2023

Regret Analysis of the Posterior Sampling-based Learning Algorithm for Episodic POMDPs.

[BibT_eX]

[DOI]

CoRR, 2023

Conditional Kernel Imitation Learning for Continuous State Environments.

[BibT_eX]

[DOI]

CoRR, 2023

Optimal Control of Logically Constrained Partially Observable and Multi-Agent Markov Decision Processes.

[BibT_eX]

[DOI]

CoRR, 2023

Average-Constrained Policy Optimization.

[BibT_eX]

[DOI]

Akhil Agnihotri

CoRR, 2023

Safe Posterior Sampling for Constrained MDPs with Bounded Constraint Violation.

[BibT_eX]

[DOI]

CoRR, 2023

Posterior sampling-based online learning for the stochastic shortest path model.

[BibT_eX]

[DOI]

Proceedings of the Uncertainty in Artificial Intelligence, 2023

Leveraging Demonstrations to Improve Online Learning: Quality Matters.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2023

A Novel Point-Based Algorithm for Multi-Agent Control Using the Common Information Approach.

[BibT_eX]

[DOI]

Dengwang Tang

Proceedings of the 62nd IEEE Conference on Decision and Control, 2023

Exact and Cost-Effective Automated Transformation of Neural Network Controllers to Decision Tree Controllers.

[BibT_eX]

[DOI]

Proceedings of the 62nd IEEE Conference on Decision and Control, 2023

2022

Two-Stage Electricity Markets With Renewable Energy Integration: Market Mechanisms and Equilibrium Analysis.

[BibT_eX]

[DOI]

IEEE Trans. Control. Netw. Syst., 2022

Scheduling Flexible Nonpreemptive Loads in Smart-Grid Networks.

[BibT_eX]

[DOI]

IEEE Trans. Control. Netw. Syst., 2022

New directions in learning and control of stochastic networks.

[BibT_eX]

[DOI]

Vijay Kamble

Queueing Syst. Theory Appl., 2022

Learning Infinite-Horizon Average-Reward Markov Decision Processes with Constraints.

[BibT_eX]

[DOI]

CoRR, 2022

Optimal control of partially observable Markov decision processes with finite linear temporal logic constraints.

[BibT_eX]

[DOI]

Proceedings of the Uncertainty in Artificial Intelligence, 2022

Learning Infinite-horizon Average-reward Markov Decision Process with Constraints.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2022

Improved No-Regret Algorithms for Stochastic Shortest Path with Linear MDP.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2022

Optimal Communication and Control Strategies for a Multi-Agent System in the Presence of an Adversary.

[BibT_eX]

[DOI]

Proceedings of the 61st IEEE Conference on Decision and Control, 2022

Online Learning for Cooperative Multi-Player Multi-Armed Bandits.

[BibT_eX]

[DOI]

William Chang

Proceedings of the 61st IEEE Conference on Decision and Control, 2022

Practical Control Design for the Deep Learning Age: Distillation of Deep RL-Based Controllers.

[BibT_eX]

[DOI]

Kevin Chang

Proceedings of the 58th Annual Allerton Conference on Communication, 2022

Online Learning for Unknown Partially Observable MDPs.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2022

2021

Model-Free Reinforcement Learning for Optimal Control of MarkovDecision Processes Under Signal Temporal Logic Specifications.

[BibT_eX]

[DOI]

CoRR, 2021

Learning Zero-sum Stochastic Games with Posterior Sampling.

[BibT_eX]

[DOI]

CoRR, 2021

Online Learning for Stochastic Shortest Path Model via Posterior Sampling.

[BibT_eX]

[DOI]

CoRR, 2021

Optimal communication and control strategies in a multi-agent MDP problem.

[BibT_eX]

[DOI]

CoRR, 2021

Implicit Finite-Horizon Approximation and Efficient Optimal Algorithms for Stochastic Shortest Path.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Model-Free Reinforcement Learning for Optimal Control of Markov Decision Processes Under Signal Temporal Logic Specifications.

[BibT_eX]

[DOI]

Proceedings of the 2021 60th IEEE Conference on Decision and Control (CDC), 2021

Optimal Control of Discounted-Reward Markov Decision Processes Under Linear Temporal Logic Specifications.

[BibT_eX]

[DOI]

Proceedings of the 2021 American Control Conference, 2021

Learning Infinite-horizon Average-reward MDPs with Linear Function Approximation.

[BibT_eX]

[DOI]

Chen-Yu Wei

Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

A Sample-Efficient Algorithm for Episodic Finite-Horizon MDP with Constraints.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Posterior Sampling-Based Reinforcement Learning for Control of Unknown Linear Systems.

[BibT_eX]

[DOI]

Mukul Gagrani

IEEE Trans. Autom. Control., 2020

A Universal Empirical Dynamic Programming Algorithm for Continuous State MDPs.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., 2020

Synthesis of Discounted-Reward Optimal Policies for Markov Decision Processes Under Linear Temporal Logic Specifications.

[BibT_eX]

[DOI]

CoRR, 2020

Designing Interpretable Approximations to Deep Reinforcement Learning with Soft Decision Trees.

[BibT_eX]

[DOI]

Nikhil Naik

CoRR, 2020

Randomized Policy Learning for Continuous State and Action MDPs.

[BibT_eX]

[DOI]

CoRR, 2020

Non-indexability of the stochastic appointment scheduling problem.

[BibT_eX]

[DOI]

Autom., 2020

Model-free Reinforcement Learning in Infinite-horizon Average-reward Markov Decision Processes.

[BibT_eX]

[DOI]

Chen-Yu Wei

Proceedings of the 37th International Conference on Machine Learning, 2020

Finite Time Guarantees for Continuous State MDPs with Generative Model.

[BibT_eX]

[DOI]

Proceedings of the 59th IEEE Conference on Decision and Control, 2020

Scheduling of Flexible Non-Preemptive Loads.

[BibT_eX]

[DOI]

Proceedings of the 59th IEEE Conference on Decision and Control, 2020

A Risk Aware Two-Stage Market Mechanism for Electricity with Renewable Generation.

[BibT_eX]

[DOI]

Proceedings of the 2020 American Control Conference, 2020

2019

Approximate Relative Value Learning for Average-reward Continuous State MDPs.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Fifth Conference on Uncertainty in Artificial Intelligence, 2019

An Empirical Relative Value Learning Algorithm for Non-parametric MDPs with Continuous State Space.

[BibT_eX]

[DOI]

Abhishek K. Gupta

Proceedings of the 17th European Control Conference, 2019

Empirical Algorithms for General Stochastic Systems with Continuous States and Actions.

[BibT_eX]

[DOI]

Proceedings of the 58th IEEE Conference on Decision and Control, 2019

A Two-Stage Market Mechanism for Electricity with Renewable Generation.

[BibT_eX]

[DOI]

Proceedings of the 58th IEEE Conference on Decision and Control, 2019

A Two Stage Stochastic Mechanism for Selling Random Power.

[BibT_eX]

[DOI]

Proceedings of the 2019 American Control Conference, 2019

An Approximately Optimal Relative Value Learning Algorithm for Averaged MDPs with Continuous States and Actions.

[BibT_eX]

[DOI]

Proceedings of the 57th Annual Allerton Conference on Communication, 2019

2018

Aggregating Correlated Wind Power With Full Surplus Extraction.

[BibT_eX]

[DOI]

IEEE Trans. Smart Grid, 2018

Optimal Decentralized Control With Asymmetric One-Step Delayed Information Sharing.

[BibT_eX]

[DOI]

IEEE Trans. Control. Netw. Syst., 2018

On Regret-Optimal Learning in Decentralized Multiplayer Multiarmed Bandits.

[BibT_eX]

[DOI]

IEEE Trans. Control. Netw. Syst., 2018

A Two Stage Mechanism For Selling Random Power.

[BibT_eX]

[DOI]

CoRR, 2018

A Fixed Point Theorem for Iterative Random Contraction Operators over Banach Spaces.

[BibT_eX]

[DOI]

Abhishek K. Gupta

Peter W. Glynn

CoRR, 2018

Dynamic Economic Dispatch and Price Evolution under Ramping Constraints and Uncertain Demand.

[BibT_eX]

[DOI]

Abhishek K. Gupta

Balsam Dakhil

Proceedings of the 56th Annual Allerton Conference on Communication, 2018

2017

Approachability in Stackelberg Stochastic Games with Vector Costs.

[BibT_eX]

[DOI]

Dyn. Games Appl., 2017

Learning-based Control of Unknown Linear Systems with Thompson Sampling.

[BibT_eX]

[DOI]

Mukul Gagrani

CoRR, 2017

Learning Unknown Markov Decision Processes: A Thompson Sampling Approach.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Randomized function fitting-based empirical value iteration.

[BibT_eX]

[DOI]

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

A random monotone operator framework for strongly convex stochastic optimization.

[BibT_eX]

[DOI]

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

Control of unknown linear systems with Thompson sampling.

[BibT_eX]

[DOI]

Mukul Gagrani

Proceedings of the 55th Annual Allerton Conference on Communication, 2017

Inexact iteration of averaged operators for non-strongly convex stochastic optimization.

[BibT_eX]

[DOI]

Proceedings of the 55th Annual Allerton Conference on Communication, 2017

2016

Dynamic Economic Dispatch Game: The Value of Storage.

[BibT_eX]

[DOI]

IEEE Trans. Smart Grid, 2016

Empirical Dynamic Programming.

[BibT_eX]

[DOI]

Math. Oper. Res., 2016

A dynamical systems framework for stochastic iterative optimization.

[BibT_eX]

[DOI]

Proceedings of the 55th IEEE Conference on Decision and Control, 2016

On the existence of near-optimal fixed time control of traffic intersection signals.

[BibT_eX]

[DOI]

Proceedings of the 54th Annual Allerton Conference on Communication, 2016

2015

A Convex Analytic Approach to Risk-Aware Markov Decision Processes.

[BibT_eX]

[DOI]

SIAM J. Control. Optim., 2015

A queueing model with independent arrivals, and its fluid and diffusion limits.

[BibT_eX]

[DOI]

Queueing Syst. Theory Appl., 2015

Strategic Arrivals into Queueing Networks: The Network Concert Queueing Game.

[BibT_eX]

[DOI]

Oper. Res., 2015

On Regret-Optimal Learning in Decentralized Multi-player Multi-armed Bandits.

[BibT_eX]

[DOI]

CoRR, 2015

Pricing sequential forward power contracts.

[BibT_eX]

[DOI]

Proceedings of the 2015 IEEE International Conference on Smart Grid Communications, 2015

Equilibria in two-stage electricity markets.

[BibT_eX]

[DOI]

Proceedings of the 54th IEEE Conference on Decision and Control, 2015

An empirical algorithm for relative value iteration for average-cost MDPs.

[BibT_eX]

[DOI]

Abhishek Gupta

Peter W. Glynn

Proceedings of the 54th IEEE Conference on Decision and Control, 2015

Scheduling, pricing, and efficiency of non-preemptive flexible loads under direct load control.

[BibT_eX]

[DOI]

Abhishek Gupta

Ram Rajagopal

Proceedings of the 53rd Annual Allerton Conference on Communication, 2015

2014

Coalitional Games for Transmitter Cooperation in MIMO Multiple Access Channels.

[BibT_eX]

[DOI]

IEEE Trans. Signal Process., 2014

Decentralized Learning for Multiplayer Multiarmed Bandits.

[BibT_eX]

[DOI]

IEEE Trans. Inf. Theory, 2014

Risk-Constrained Markov Decision Processes.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., 2014

Empirical Q-Value Iteration.

[BibT_eX]

[DOI]

CoRR, 2014

A Learning Scheme for Approachability in MDPs and Stackelberg Stochastic Games.

[BibT_eX]

[DOI]

CoRR, 2014

On Transitory Queueing.

[BibT_eX]

[DOI]

CoRR, 2014

Bertrand equilibria and efficiency in markets for congestible network services.

[BibT_eX]

[DOI]

Autom., 2014

Buying random yet correlated wind power.

[BibT_eX]

[DOI]

Proceedings of the 2014 IEEE International Conference on Smart Grid Communications, 2014

Stochastic dynamic pricing: Utilizing demand response in an adaptive manner.

[BibT_eX]

[DOI]

Ram Rajagopal

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Blackwell's approachability in stackelberg stochastic games: A learning version.

[BibT_eX]

[DOI]

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Mean field limits by population acceleration.

[BibT_eX]

[DOI]

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Empirical policy iteration for approximate dynamic programming.

[BibT_eX]

[DOI]

Proceedings of the 53rd IEEE Conference on Decision and Control, 2014

Optimal decentralized control in unidirectional one-step delayed sharing pattern with partial output feedback.

[BibT_eX]

[DOI]

Proceedings of the American Control Conference, 2014

Empirical Value Iteration for approximate dynamic programming.

[BibT_eX]

[DOI]

Proceedings of the American Control Conference, 2014

Dynamic economic dispatch among strategic generators with storage systems.

[BibT_eX]

[DOI]

Proceedings of the 52nd Annual Allerton Conference on Communication, 2014

2013

Spectrum Sharing through Contracts for Cognitive Radios.

[BibT_eX]

[DOI]

IEEE Trans. Mob. Comput., 2013

Stochastic Dominance-Constrained Markov Decision Processes.

[BibT_eX]

[DOI]

SIAM J. Control. Optim., 2013

Broadcast Channel Games: Equilibrium Characterization and a MIMO MAC-BC Game Duality

[BibT_eX]

[DOI]

CoRR, 2013

A Nash Equilibrium Need Not Exist in the Locational Marginal Pricing Mechanism.

[BibT_eX]

[DOI]

CoRR, 2013

Game-theoretic analysis of the nodal pricing mechanism for electricity markets.

[BibT_eX]

[DOI]

Proceedings of the 52nd IEEE Conference on Decision and Control, 2013

Optimal decentralized control in unidirectional one-step delayed sharing pattern.

[BibT_eX]

[DOI]

Proceedings of the 51st Annual Allerton Conference on Communication, 2013

Coalition formation for uplink device to device coordination with cooperation costs.

[BibT_eX]

[DOI]

Proceedings of the 2013 Asilomar Conference on Signals, 2013

2012

Combinatorial Network Optimization With Unknown Variables: Multi-Armed Bandits With Linear Rewards and Individual Observations.

[BibT_eX]

[DOI]

Yi Gai

Bhaskar Krishnamachari

IEEE/ACM Trans. Netw., 2012

Hierarchical Auction Mechanisms for Network Resource Allocation.

[BibT_eX]

[DOI]

IEEE J. Sel. Areas Commun., 2012

Coalitional Games for Transmitter Cooperation in Wireless Networks

[BibT_eX]

[DOI]

CoRR, 2012

Mechanism Designs for Stochastic Resources for Renewable Energy Integration

[BibT_eX]

[DOI]

CoRR, 2012

Δ(i)/GI/1: A New Queueing Model For Transitory Queueing Systems

[BibT_eX]

[DOI]

CoRR, 2012

Network market design part I: bandwidth markets.

[BibT_eX]

[DOI]

IEEE Commun. Mag., 2012

A new transitory queueing model and its process limits.

[BibT_eX]

[DOI]

Proceedings of the 6th International ICST Conference on Performance Evaluation Methodologies and Tools, 2012

A game theoretic model for the Gaussian broadcast channel.

[BibT_eX]

[DOI]

Proceedings of the 2012 IEEE International Symposium on Information Theory, 2012

Incentives for cooperative relaying in a simple information-theoretic model.

[BibT_eX]

[DOI]

Proceedings of the 2012 IEEE International Symposium on Information Theory, 2012

Dynamic pricing of power in Smart-Grid networks.

[BibT_eX]

[DOI]

Qingsi Wang

Mingyan Liu

Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Decentralized learning for multi-player multi-armed bandits.

[BibT_eX]

[DOI]

Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Dominance-constrained Markov decision processes.

[BibT_eX]

[DOI]

Proceedings of the 51th IEEE Conference on Decision and Control, 2012

Characterization of equilibria for the degraded Gaussian broadcast and sum power MAC channels.

[BibT_eX]

[DOI]

Proceedings of the 50th Annual Allerton Conference on Communication, 2012

Multi-player multi-armed bandits: Decentralized learning with IID rewards.

[BibT_eX]

[DOI]

Proceedings of the 50th Annual Allerton Conference on Communication, 2012

The A(i)/GI/l Queue: A new model of transitory queueing.

[BibT_eX]

[DOI]

Proceedings of the 50th Annual Allerton Conference on Communication, 2012

2011

The concert queueing game: to wait or to be late.

[BibT_eX]

[DOI]

Sandeep Juneja

Nahum Shimkin

Discret. Event Dyn. Syst., 2011

Coalition games for transmitter cooperation in wireless networks.

[BibT_eX]

[DOI]

Proceedings of the 2011 IEEE International Symposium on Information Theory Proceedings, 2011

Hierarchical Auctions for Network Resource Allocation.

[BibT_eX]

[DOI]

Proceedings of the Game Theory for Networks - 2nd International ICST Conference, 2011

Stochastic resource auctions for renewable energy integration.

[BibT_eX]

[DOI]

Proceedings of the 49th Annual Allerton Conference on Communication, 2011

2010

Combinatorial Network Optimization with Unknown Variables: Multi-Armed Bandits with Linear Rewards

[BibT_eX]

[DOI]

Yi Gai

Bhaskar Krishnamachari

CoRR, 2010

An efficient Nash-implementation mechanism for network resource allocation.

[BibT_eX]

[DOI]

Jean C. Walrand

Autom., 2010

Simulation-based optimization of Markov decision processes: An empirical process theory approach.

[BibT_eX]

[DOI]

Autom., 2010

A contracts-based approach for spectrum sharing among cognitive radios.

[BibT_eX]

[DOI]

Proceedings of the 8th International Symposium on Modeling and Optimization in Mobile, Ad-Hoc and Wireless Networks (WiOpt 2010), May 31, 2010

DiffServ pricing games in multi-class queueing network models.

[BibT_eX]

[DOI]

Proceedings of the 22nd International Teletraffic Congress, 2010

Communication games on the generalized Gaussian relay channel.

[BibT_eX]

[DOI]

Proceedings of the 48th Annual Allerton Conference on Communication, 2010

Strategic arrivals into queueing networks.

[BibT_eX]

[DOI]

Proceedings of the 48th Annual Allerton Conference on Communication, 2010

2009

The concert/cafeteria queueing problem: a game of arrivals.

[BibT_eX]

[DOI]

Sandeep Juneja

Proceedings of the 4th International Conference on Performance Evaluation Methodologies and Tools, 2009

Queueing game models for differentiated services.

[BibT_eX]

[DOI]

Proceedings of the 1st International Conference on Game Theory for Networks, 2009

Bertrand games between multi-class queues.

[BibT_eX]

[DOI]

Proceedings of the 48th IEEE Conference on Decision and Control, 2009

2008

N-player Bertrand-Cournot games in queues: Existence of equilibrium.

[BibT_eX]

[DOI]

Proceedings of the 46th Annual Allerton Conference on Communication, 2008

2007

Designing a strategic bipartite matching market.

[BibT_eX]

[DOI]

Proceedings of the 46th IEEE Conference on Decision and Control, 2007

2006

Simulation-based Uniform Value Function Estimates of Markov Decision Processes.

[BibT_eX]

[DOI]

SIAM J. Control. Optim., 2006

Mechanisms for Efficient Allocation in Divisible Capacity Networks.

[BibT_eX]

[DOI]

Antonis Dimakis

Jean C. Walrand

Proceedings of the 45th IEEE Conference on Decision and Control, 2006

2005

Efficient Market Mechanisms for Network Resource Allocation.

[BibT_eX]

[DOI]

Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

2004

Scalar estimation and control with noisy binary observations.

[BibT_eX]

[DOI]

Tunc Simsek

IEEE Trans. Autom. Control., 2004

PAC learning for Markov decision processes and dynamic games.

[BibT_eX]

[DOI]

Proceedings of the 2004 IEEE International Symposium on Information Theory, 2004

Simulation-based uniform value function estimates of discounted and average-reward MDPs.

[BibT_eX]

[DOI]

Proceedings of the 43rd IEEE Conference on Decision and Control, 2004

2003

Combination Exchange Mechanisms for Efficient Bandwidth Allocation.

[BibT_eX]

[DOI]

Commun. Inf. Syst., 2003

2002

Control under communication constraints.

[BibT_eX]

[DOI]

Tunc Simsek

Proceedings of the 41st IEEE Conference on Decision and Control, 2002

2001

Geographical routing using partial information for wireless ad hoc networks.

[BibT_eX]

[DOI]

Anuj Puri

Raja Sengupta

IEEE Wirel. Commun., 2001

1999

Towards Coarse-Grained Mobile QoS.

[BibT_eX]

[DOI]

Bahareh Sadeghi

Edward W. Knightly

Proceedings of Second ACM International Workshop on Wireless Mobile Multimedia, 1999

A Framework for Design & Evaluation of Admission Control Algorithms in Multi-Service Mobile Networks.

[BibT_eX]

[DOI]