2016
NeurIPS
NeurIPS 2016
Refined Lower Bounds for Adversarial Bandits
Abstract
We provide new lower bounds on the regret that must be suffered by adversarial bandit algorithms. The new results show that recent upper bounds that either (a) hold with high-probability or (b) depend on the total loss of the best arm or (c) depend on the quadratic variation of the losses, are close to tight. Besides this we prove two impossibility results. First, the existence of a single arm that is optimal in every round cannot improve the regret in the worst case. Second, the regret cannot scale with the effective range of the losses. In contrast, both results are possible in the full-information setting.
🌉
Interdisciplinary Bridge
- Artificial Intelligence and Mathematics & Optimization
📈
Trend Setter
- Theory
🐣
Hot Topic Early Bird
- lower bound
Authors
Topics
Machine Learning > Learning Types > Adversarial Learning
Machine Learning > Optimization & Theory > Learning Theory
Mathematics & Optimization > Optimization > Online Algorithms
Machine Learning > Optimization & Theory > Online Algorithms
Machine Learning > Learning Types > Multi-Armed Bandits
Mathematics & Optimization > Optimization > Theory