Zhengyan Zhang
23 papers · 2017–2025 · 8 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (51) π Academic Marathon Β· Sprint π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Silver π£ Hot Topic Early Bird
π§¬
Topic Evolution
π€
Dynamic Duo
(22)
β‘
Prolific Year Β· Productive
π₯
Unstoppable Β· Bronze
π
Century Club Β· Bronze
ποΈ
Keyword Collector
(117)
Top co-authors
Research topics
Machine Learning
(16)
Deep Learning
(15)
Artificial Intelligence
(13)
Application Areas
(12)
Natural Language Processing
(11)
Core AI
(11)
Learning Types Β· Deep Learning
(7)
Learning Types Β· Machine Learning
(7)
Optimization & Theory
(7)
Resources & Methods
(6)
Applications
(5)
Techniques
(5)
Architectures
(4)
Core Methods
(3)
Knowledge & Reasoning
(2)
Keywords
model compression
(7)
pre-trained language model
(5)
large language model
(4)
mixture of expert
(3)
domain adaptation
(3)
knowledge injection
(2)
text classification
(2)
activation sparsity
(2)
inference efficiency
(2)
parameter efficiency
(2)
parameter efficient
(2)
model quantization
(2)
transfer learning
(2)
attention mechanism
(2)
knowledge distillation
(2)
parameter-efficient learning
(2)
prompt tuning
(2)
efficient computing
(2)
question answering
(2)
transformer model
(2)
Papers
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
ACL 2025
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models
COLING 2025
Exploring the Benefit of Activation Sparsity in Pre-training
ICML 2024
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
NeurIPS 2024
Robust and Scalable Model Editing for Large Language Models
COLING 2024
Emergent Modularity in Pre-trained Transformers
ACL 2023
Plug-and-Play Document Modules for Pre-trained Models
ACL 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models
ACL 2023
READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises
ACL 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
EMNLP 2023
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models
COLING 2022
BMCook: A Task-agnostic Compression Toolkit for Big Models
EMNLP 2022
BMInf: An Efficient Toolkit for Big Model Inference and Tuning
ACL 2022
Finding Skill Neurons in Pre-trained Transformer-based Language Models
EMNLP 2022
Knowledge Inheritance for Pre-trained Language Models
NAACL 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts
ACL 2022
Prompt Tuning for Discriminative Pre-trained Language Models
ACL 2022
Adversarial Language Games for Advanced Natural Language Intelligence
AAAI 2021
Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning
ACL 2021
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger
ACL 2021
Train No Evil: Selective Masking for Task-Guided Pre-Training
EMNLP 2020
ERNIE: Enhanced Language Representation with Informative Entities
ACL 2019
TransNet: Translation-Based Network Representation Learning for Social Relation Extraction
IJCAI 2017