Zhiqi Bai
4 papers · 2024–2024 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (2) π Cross-Pollinator (13) πΊοΈ Taxonomy Completionist (16)
π£
Hot Topic Early Bird
Conferences
ACL (2)
NIPS (2)
Top co-authors
Keywords
large language model
(4)
domain adaptation
(2)
transfer learning
(1)
mathematical reasoning
(1)
knowledge distillation
(1)
efficient computing
(1)
foundation model
(1)
scaling law
(1)
context length
(1)
continual pre-training
(1)
length extrapolation
(1)
downstream performance
(1)
mixture ratio
(1)
cross-domain generalization
(1)
rotary position embedding
(1)
continual pretraining
(1)
bilingual benchmark
(1)
fine-grained evaluation
(1)
context length extension
(1)
concept-wise evaluation
(1)
Papers
D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
NIPS 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models
NIPS 2024
E2-LLM: Efficient and Extreme Length Extension of Large Language Models
ACL 2024
ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models
ACL 2024