Yaqi Duan
12 papers · 2019–2025 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
🐣 Hot Topic Early Bird 🌍 Conference Polyglot · Silver 🏃 Academic Marathon · Sprint 🌉 Interdisciplinary Bridge · Silver 🗺️ Taxonomy Completionist (27)
🏆
Keyword Champion
(3)
🗃️
Keyword Collector
(76)
💎
Century Club · Bronze
🔥
Unstoppable · Bronze
❓
The Questioner
Top co-authors
Research topics
Keywords
off-policy evaluation
(4)
markov decision process
(3)
markov process
(3)
offline reinforcement learning
(2)
linear function approximation
(2)
reinforcement learning
(2)
batch reinforcement learning
(2)
markov chain
(2)
fitted q-evaluation
(2)
fitted q-iteration
(2)
statistical inference
(1)
reward modeling
(1)
state abstraction
(1)
3d reconstruction
(1)
unsupervised learning
(1)
policy evaluation
(1)
representation learning
(1)
sequential decision making
(1)
convergence analysis
(1)
feature selection
(1)
Papers
PILAF: Optimal Human Preference Sampling for Reward Modeling
ICML 2025
Taming "data-hungry" reinforcement learning? Stability in continuous state-action spaces
NeurIPS 2024
A finite-sample analysis of multi-step temporal difference estimates
L4DC 2023
Invertible Residual Neural Networks with Conditional Injector and Interpolator for Point Cloud Upsampling
IJCAI 2023
Learning Good State and Action Representations for Markov Decision Process via Tensor Decomposition
JMLR 2023
Near-optimal Offline Reinforcement Learning with Linear Representation: Leveraging Variance Information with Pessimism
ICLR 2022
Bootstrapping Fitted Q-Evaluation for Off-Policy Inference
ICML 2021
Risk Bounds and Rademacher Complexity in Batch Reinforcement Learning
ICML 2021
Sparse Feature Selection Makes Batch Reinforcement Learning More Sample Efficient
ICML 2021
Minimax-Optimal Off-Policy Evaluation with Linear Function Approximation
ICML 2020
Learning low-dimensional state embeddings and metastable clusters from time series data
NeurIPS 2019
State Aggregation Learning from Markov Transition Data
NeurIPS 2019