Armen Aghajanyan
20 papers · 2019–2024 · 7 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
π Conference Polyglot (7) π Academic Marathon (5) π Interdisciplinary Bridge π§ Keyword Pioneer π Cross-Pollinator (8)
π
Renaissance Researcher
(5)
πΊοΈ
Taxonomy Completionist
(38)
π
Interdisciplinary Bridge
π
Triple Crown
π€
Dynamic Duo
(13)
β‘
Prolific Year
(5)
ποΈ
Keyword Collector
(70)
π₯
Unstoppable
(6)
π
Century Club
(20)
Conferences
EMNLP (4)
ICLR (4)
NIPS (4)
ACL (3)
ICML (2)
NAACL (2)
IJCNLP (1)
Top co-authors
Keywords
sequence-to-sequence model
(4)
zero-shot learning
(4)
language model
(3)
representation learning
(3)
semantic parsing
(2)
transfer learning
(2)
parameter efficiency
(2)
generalization bound
(2)
language model fine-tuning
(2)
multimodal learning
(2)
cross-lingual transfer
(1)
in-context learning
(1)
multilingual nlp
(1)
question answering
(1)
sample efficiency
(1)
self-supervised learning
(1)
text-to-image generation
(1)
embedding learning
(1)
contrastive learning
(1)
coreference resolution
(1)
Papers
Jointly Training Large Autoregressive Multimodal Models
ICLR 2024
D4: Improving LLM Pretraining via Document De-Duplication and Diversification
NIPS 2023
InCoder: A Generative Model for Code Infilling and Synthesis
ICLR 2023
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
NIPS 2023
Retrieval-Augmented Multimodal Language Modeling
ICML 2023
Scaling Laws for Generative Mixed-Modal Language Models
ICML 2023
CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training
NAACL 2022
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
NIPS 2022
RetroNLU: Retrieval Augmented Task-Oriented Semantic Parsing
ACL 2022
Improving Passage Retrieval with Zero-Shot Question Generation
EMNLP 2022
HTLM: Hyper-Text Pre-Training and Prompting of Language Models
ICLR 2022
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog
NAACL 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
IJCNLP 2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
EMNLP 2021
Better Fine-Tuning by Reducing Representational Collapse
ICLR 2021
Muppet: Massive Multi-task Representations with Pre-Finetuning
EMNLP 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
ACL 2021
Pre-training via Paraphrasing
NIPS 2020
Conversational Semantic Parsing
EMNLP 2020
Towards Language Agnostic Universal Representations
ACL 2019