Siva Theja Maguluri

SIGMETRICS Perform. Evaluation Rev., February, 2024

Exponential Tail Bounds on Queues: A Confluence of Non- Asymptotic Heavy Traffic and Large Deviations.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., February, 2024

A Lyapunov Theory for Finite-Sample Guarantees of Markovian Stochastic Approximation.

[BibT_eX]

[DOI]

Oper. Res., 2024

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem.

[BibT_eX]

[DOI]

Shaan Ul Haque

CoRR, 2024

Performance of NPG in Countable State-Space Average-Cost RL.

[BibT_eX]

[DOI]

CoRR, 2024

Convergence for Natural Policy Gradient on Infinite-State Average-Reward Markov Decision Processes.

[BibT_eX]

[DOI]

Isaac Grosof

CoRR, 2024

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise.

[BibT_eX]

[DOI]

Shaan Ul Haque

CoRR, 2024

Policy Evaluation for Variance in Average Reward Reinforcement Learning.

[BibT_eX]

[DOI]

Shubhada Agrawal

Prashanth L. A.

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Optimal Pricing in a Single Server System.

[BibT_eX]

[DOI]

ACM Trans. Model. Perform. Evaluation Comput. Syst., December, 2023

Target Network and Truncation Overcome the Deadly Triad in $\boldsymbol{Q}$-Learning.

[BibT_eX]

[DOI]

John-Paul Clarke

SIAM J. Math. Data Sci., December, 2023

Exponential Tail Bounds on Queues.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., September, 2023

Finite-Sample Analysis of Two-Time-Scale Natural Actor-Critic Algorithm.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., June, 2023

Heavy Traffic Queue Length Distribution without Resource Pooling in an Input-Queued Switch.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., April, 2023

Dynamic Pricing and Matching for Two-Sided Queues.

[BibT_eX]

[DOI]

Pornpawee Bumpensanti

He Wang

Oper. Res., January, 2023

Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise.

[BibT_eX]

[DOI]

Martin Zubeldia

CoRR, 2023

Power-of-d Choices Load Balancing in the Sub-Halfin Whitt Regime.

[BibT_eX]

[DOI]

Francisco Castro

Proceedings of the Abstract Proceedings of the 2023 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, 2023

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds for Exponentially Stable Systems.

[BibT_eX]

[DOI]

Hoang Nguyen

Proceedings of the 62nd IEEE Conference on Decision and Control, 2023

2022

Heavy-Traffic Insensitive Bounds for Weighted Proportionally Fair Bandwidth Sharing Policies.

[BibT_eX]

[DOI]

Math. Oper. Res., November, 2022

Heavy-Traffic Analysis of Queueing Systems with No Complete Resource Pooling.

[BibT_eX]

[DOI]

Math. Oper. Res., November, 2022

Low-Complexity Switch Scheduling Algorithms: Delay Optimality in Heavy Traffic.

[BibT_eX]

[DOI]

IEEE/ACM Trans. Netw., 2022

On Heavy-Traffic Optimal Scaling of c-Weighted MaxWeight Scheduling in Input-Queued Switches.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., 2022

A Heavy Traffic Theory of Two-Sided Queues.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2022

On linear and super-linear convergence of Natural Policy Gradient algorithm.

[BibT_eX]

[DOI]

Syst. Control. Lett., 2022

A load balancing system in the many-server heavy-traffic asymptotics.

[BibT_eX]

[DOI]

Queueing Syst. Theory Appl., 2022

Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization.

[BibT_eX]

[DOI]

Shancong Mou

Proc. ACM Meas. Anal. Comput. Syst., 2022

Optimal pricing in multi server systems.

[BibT_eX]

[DOI]

Perform. Evaluation, 2022

Logarithmic heavy traffic error bounds in generalized switch and load balancing systems.

[BibT_eX]

[DOI]

J. Appl. Probab., 2022

Finite-Sample Analysis of Off-Policy Natural Actor-Critic With Linear Function Approximation.

[BibT_eX]

[DOI]

IEEE Control. Syst. Lett., 2022

Backward Curriculum Reinforcement Learning.

[BibT_eX]

[DOI]

Kyungmin Ko

CoRR, 2022

Matching Queues with Abandonments in Quantum Switches: Stability and Throughput Analysis.

[BibT_eX]

[DOI]

Martin Zubeldia

CoRR, 2022

Target Network and Truncation Overcome The Deadly triad in Q-Learning.

[BibT_eX]

[DOI]

John-Paul Clarke

CoRR, 2022

Finite-sample analysis of nonlinear stochastic approximation with applications in reinforcement learning.

[BibT_eX]

[DOI]

Autom., 2022

Federated Reinforcement Learning: Linear Speedup Under Markovian Sampling.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2022

Sample Complexity of Policy-Based Methods under Off-Policy Sampling and Linear Function Approximation.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2022

2021

Throughput Optimal Routing in Blockchain-Based Payment Systems.

[BibT_eX]

[DOI]

IEEE Trans. Control. Netw. Syst., 2021

Convergence Rates of Distributed Gradient Methods Under Random Quantization: A Stochastic Approximation Approach.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., 2021

Fast Convergence Rates of Distributed Subgradient Methods With Adaptive Quantization.

[BibT_eX]

[DOI]

IEEE Trans. Autom. Control., 2021

Finite-Time Performance of Distributed Temporal-Difference Learning with Linear Function Approximation.

[BibT_eX]

[DOI]

SIAM J. Math. Data Sci., 2021

Heavy traffic queue length scaling in switches with reconfiguration delay.

[BibT_eX]

[DOI]

Chang-Heng Wang

Tara Javidi

Queueing Syst. Theory Appl., 2021

QPS-r: A cost-effective iterative switching algorithm for input-queued switches.

[BibT_eX]

[DOI]

Perform. Evaluation, 2021

Throughput and delay optimality of power-of-<i>d</i> choices in inhomogeneous load balancing systems.

[BibT_eX]

[DOI]

Oper. Res. Lett., 2021

Transportation Polytope and its Applications in Parallel Server Systems.

[BibT_eX]

[DOI]

CoRR, 2021

A Lyapunov Theory for Finite-Sample Guarantees of Asynchronous Q-Learning and TD-Learning Variants.

[BibT_eX]

[DOI]

CoRR, 2021

Dynamic Pricing and Matching for Two-Sided Markets with Strategic Servers.

[BibT_eX]

[DOI]

Francisco Castro

Proceedings of the SIGMETRICS '21: ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems, 2021

Finite Sample Analysis of Average-Reward TD Learning and $Q$-Learning.

[BibT_eX]

[DOI]

Sheng Zhang

Zhe Zhang

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Finite-Sample Analysis of Off-Policy TD-Learning via Generalized Bellman Operators.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Finite-Sample Analysis of Off-Policy Natural Actor-Critic Algorithm.

[BibT_eX]

[DOI]

Proceedings of the 38th International Conference on Machine Learning, 2021

On the Linear Convergence of Natural Policy Gradient Algorithm.

[BibT_eX]

[DOI]

Proceedings of the 2021 60th IEEE Conference on Decision and Control (CDC), 2021

2020

Finite-Sample Analysis of Stochastic Approximation Using Smooth Convex Envelopes.

[BibT_eX]

[DOI]

CoRR, 2020

Optimal Pricing in Finite Server Systems.

[BibT_eX]

[DOI]

Proceedings of the 18th International Symposium on Modeling and Optimization in Mobile, 2020

Finite-Sample Analysis of Contractive Stochastic Approximation Using Smooth Convex Envelopes.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

2019

Heavy-traffic Analysis of the Generalized Switch under Multidimensional State Space Collapse.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2019

Finite-Time Analysis of Q-Learning with Linear Function Approximation.

[BibT_eX]

[DOI]

CoRR, 2019

QPS-r: A Cost-Effective Crossbar Scheduling Algorithm and Its Stability and Delay Analysis.

[BibT_eX]

[DOI]

CoRR, 2019

Finite-Time Analysis of Distributed TD(0) with Linear Function Approximation on Multi-Agent Reinforcement Learning.

[BibT_eX]

[DOI]

Proceedings of the 36th International Conference on Machine Learning, 2019

2018

A Novel View of the Drift: Method for Heavy Traffic Limits of Queueing Systems.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2018

Optimal heavy-traffic queue length scaling in an incompletely saturated switch.

[BibT_eX]

[DOI]

Sai Kiran Burle

Queueing Syst. Theory Appl., 2018

Optimal Dynamic Control for Input-Queued Switches in Heavy Traffic.

[BibT_eX]

[DOI]

Proceedings of the 2018 Annual American Control Conference, 2018

On the Convergence of Distributed Subgradient Methods under Quantization.

[BibT_eX]

[DOI]

Proceedings of the 56th Annual Allerton Conference on Communication, 2018

2017

Heavy-Traffic Delay Insensitivity in Connection-Level Models of Data Transfer with Proportionally Fair Bandwidth Sharing.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2017

The Drift Method for Heavy Traffic Limits, with Applications in Data Centers and Networks.

[BibT_eX]

[DOI]

Weina Wang

SIGMETRICS Perform. Evaluation Rev., 2017

Optimal Energy Procurement for Geo-distributed Data Centers in Multi-timescale Electricity Markets.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2017

Heavy traffic queue length behavior in switches with reconfiguration delay.

[BibT_eX]

[DOI]

Chang-Heng Wang

Tara Javidi

Proceedings of the 2017 IEEE Conference on Computer Communications, 2017

On optimal portfolios of dynamic resource allocations.

[BibT_eX]

[DOI]

Proceedings of the 2017 American Control Conference, 2017

2016

Risk-Based Dynamic Allocation of Computing Resources.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2016

Delay-Optimal Scheduling for Some Input-Queued Switches.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2016

2015

Heavy-Traffic Behavior of the MaxWeight Algorithm in a Switch with Uniform Traffic.

[BibT_eX]

[DOI]

SIGMETRICS Perform. Evaluation Rev., 2015

2014

Optimal resource allocation algorithms for cloud computing

[BibT_eX]

[DOI]

PhD thesis, 2014

Scheduling Jobs With Unknown Duration in Clouds.

[BibT_eX]

[DOI]

IEEE/ACM Trans. Netw., 2014

The Stability of Longest-Queue-First Scheduling With Variable Packet Sizes.

[BibT_eX]

[DOI]

Bruce E. Hajek

IEEE Trans. Autom. Control., 2014

Heavy traffic optimal resource allocation algorithms for cloud computing clusters.

[BibT_eX]

[DOI]

Lei Ying

Perform. Evaluation, 2014

2012

Stochastic models of load balancing and scheduling in cloud computing clusters.

[BibT_eX]

[DOI]