Weigao Sun
9 papers · 2020–2026 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Silver
🏃
Academic Marathon · Sprint
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(24)
Top co-authors
Research topics
Machine Learning
(7)
Deep Learning
(5)
Artificial Intelligence
(4)
Natural Language Processing
(4)
Application Areas
(4)
Core AI
(4)
Optimization & Theory · Machine Learning
(4)
Optimization & Theory · Deep Learning
(4)
Architectures
(3)
Generation
(2)
Techniques
(2)
Mathematics & Optimization
(1)
Applications
(1)
Learning Types · Deep Learning
(1)
Learning Types · Machine Learning
(1)
Keywords
linear attention
(4)
sequence modeling
(2)
stochastic gradient descent
(1)
attention mechanism
(1)
language modeling
(1)
efficient computing
(1)
gradient descent
(1)
language model
(1)
magnetic resonance imaging
(1)
distributed training
(1)
linear complexity
(1)
state space model
(1)
convergence rate
(1)
recurrent neural network
(1)
benchmark dataset
(1)
model parallelism
(1)
scaling law
(1)
pipeline parallelism
(1)
momentum method
(1)
non-convex optimization
(1)
Papers
Native Hybrid Attention for Efficient Sequence Modeling
ACL 2026
Nirvana: A Specialized Generalist Model With Task-Aware Memory Mechanism
ACL 2026
CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models
ACL 2025
Liger: Linearizing Large Language Models to Gated Recurrent Structures
ICML 2025
Sequence Accumulation and Beyond: Infinite Context Length on Single GPU and Large Clusters
AAAI 2025
CO2: Efficient Distributed Training with Full Communication-Computation Overlap
ICLR 2024
Scaling Laws for Linear Complexity Language Models
EMNLP 2024
Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention
ICML 2024
pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization
IJCAI 2020