Markov Decision Process

Sound Heuristic Search Value Iteration for Undiscounted POMDPs with Reachability Objectives UAI 2024 $O(T^{-1})$ Convergence of Optimistic-Follow-the-Regularized-Leader in Two-Player Zero-Sum Markov Games ICLR 2023 A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPs COLT 2023 Harnessing Mixed Offline Reinforcement Learning Datasets via Trajectory Weighting ICLR 2023 Logarithmic regret in communicating MDPs: Leveraging known dynamics with bandits ACML 2023 Performance Bounds for Model and Policy Transfer in Hidden-parameter MDPs ICLR 2023 Principled Data-Driven Decision Support for Cyber-Forensic Investigations AAAI 2023 Replay Memory as An Empirical MDP: Combining Conservative Estimation with Experience Replay ICLR 2023 The Role of Coverage in Online Reinforcement Learning ICLR 2023 Beyond No Regret: Instance-Dependent PAC Reinforcement Learning COLT 2022 Horizon-Free Reinforcement Learning in Polynomial Time: the Power of Stationary Policies COLT 2022 Online Target Q-learning with Reverse Experience Replay: Efficiently finding the Optimal Policy for Linear MDPs ICLR 2022 Optimal and instance-dependent guarantees for Markovian linear stochastic approximation COLT 2022 Policy Optimization for Stochastic Shortest Path COLT 2022 The Geometry of Memoryless Stochastic Policy Optimization in Infinite-Horizon POMDPs ICLR 2022 When Is Partially Observable Reinforcement Learning Not Scary? COLT 2022 Acting in Delayed Environments with Non-Stationary Markov Policies ICLR 2021 Fine-Grained Gap-Dependent Bounds for Tabular MDPs via Adaptive Multi-Step Bootstrap COLT 2021 Minimax Regret for Stochastic Shortest Path with Adversarial Costs and Known Transition COLT 2021 Online Markov Decision Processes with Aggregate Bandit Feedback COLT 2021 On Query-efficient Planning in MDPs under Linear Realizability of the Optimal State-value Function COLT 2021 Learning Zero-Sum Simultaneous-Move Markov Games Using Function Approximation and Correlated Equilibrium COLT 2020 Monte-Carlo Graph Search: the Value of Merging Similar States ACML 2020 Optimality and Approximation with Policy Gradient Methods in Markov Decision Processes COLT 2020 Partially Observable Markov Decision Process Modelling for Assessing Hierarchies ACML 2020