Xiaozhe Ren
12 papers · 2021–2026 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+4 more ↓ Show less ↑
π£ Hot Topic Early Bird π Conference Polyglot Β· Silver π Academic Marathon Β· Sprint π Interdisciplinary Bridge Β· Bronze πΊοΈ Taxonomy Completionist (21)
π§¬
Topic Evolution
π
Century Club Β· Bronze
π₯
Unstoppable Β· Bronze
ποΈ
Keyword Collector
(53)
Top co-authors
Research topics
Machine Learning
(8)
Deep Learning
(7)
Artificial Intelligence
(6)
Core AI
(6)
Architectures
(5)
Optimization & Theory Β· Machine Learning
(5)
Application Areas
(3)
Learning Types
(3)
Natural Language Processing
(2)
Core Methods
(2)
Optimization & Theory Β· Deep Learning
(2)
Resources & Methods
(2)
Techniques
(2)
Computer Science
(1)
Applications
(1)
Keywords
attention mechanism
(4)
transformer architecture
(3)
neural network optimization
(2)
neural architecture search
(2)
large language model
(2)
self-attention mechanism
(2)
length extrapolation
(2)
model architecture
(1)
communication efficiency
(1)
language model training
(1)
distributed training
(1)
weight sharing
(1)
feature map
(1)
adaptive optimization
(1)
positional encoding
(1)
gradient estimation
(1)
gradient vanishing
(1)
edge computing
(1)
adaptive gradient method
(1)
memory efficiency
(1)
Papers
BitDP: Ultra-low-bit Communication for Data Parallelism in LLM Training
AAAI 2026
DAPE V2: Process Attention Score as Feature Map for Length Extrapolation
ACL 2025
Self-Adjust Softmax
EMNLP 2025
SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator
ICML 2025
DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
NeurIPS 2024
PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
ECCV 2024
A Study on Transformer Configuration and Training Objective
ICML 2023
CAME: Confidence-guided Adaptive Memory Efficient Optimization
ACL 2023
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline
NeurIPS 2023
AutoBERT-Zero: Evolving BERT Backbone from Scratch
AAAI 2022
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation
EMNLP 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention
ICML 2021