Kaiyue Wen
13 papers · 2022–2025 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+3 more ↓ Show less ↑
🐣 Hot Topic Early Bird 🌍 Conference Polyglot · Silver 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (31) 🗃️ Keyword Collector (68)
💎
Century Club · Bronze
❓
The Questioner
(2)
⚡
Prolific Year · Productive
Top co-authors
Research topics
Machine Learning
(12)
Optimization & Theory
(7)
Artificial Intelligence
(6)
Core AI · Artificial Intelligence
(5)
Deep Learning
(4)
Core Methods
(4)
Learning Types · Machine Learning
(4)
Natural Language Processing
(3)
Resources & Methods
(3)
Architectures
(2)
Learning Types · Deep Learning
(2)
Computer Vision
(1)
Application Areas
(1)
Core AI · Computer Vision
(1)
Learning Paradigms
(1)
Keywords
gradient descent
(2)
large language model
(2)
prompt tuning
(2)
transfer learning
(2)
transformer model
(2)
sharpness-aware minimization
(1)
sample efficiency
(1)
learning theory
(1)
visual grounding
(1)
network pruning
(1)
model analysis
(1)
task generalization
(1)
zero-shot learning
(1)
neural network analysis
(1)
loss landscape
(1)
vision-language alignment
(1)
neural network optimization
(1)
compositional learning
(1)
neural network theory
(1)
deep learning
(1)
Papers
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
ACL 2025
From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency
ICLR 2025
Overtrained Language Models Are Harder to Fine-Tune
ICML 2025
RNNs are not Transformers (Yet): The Key Bottleneck on In-Context Retrieval
ICLR 2025
Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
ACL 2025
Task Generalization with Autoregressive Compositional Structure: Can Learning from D Tasks Generalize to D^T Tasks?
ICML 2025
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View
ICLR 2025
Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models
ICLR 2023
How Sharpness-Aware Minimization Minimizes Sharpness?
ICLR 2023
Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization
NeurIPS 2023
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars
NeurIPS 2023
Finding Skill Neurons in Pre-trained Transformer-based Language Models
EMNLP 2022
On Transferability of Prompt Tuning for Natural Language Processing
NAACL 2022