Armen Aghajanyan
19 papers · 2019–2024 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+8 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (45) π Academic Marathon Β· Sprint π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π§¬
Topic Evolution
π
Triple Crown
π€
Dynamic Duo
(12)
β‘
Prolific Year Β· Productive
π₯
Unstoppable Β· Bronze
π
Century Club Β· Bronze
π
Trend Setter
ποΈ
Keyword Collector
(92)
Top co-authors
Research topics
Natural Language Processing
(12)
Deep Learning
(11)
Machine Learning
(10)
Artificial Intelligence
(8)
Learning Types Β· Deep Learning
(8)
Resources & Methods
(8)
Core AI
(6)
Learning Types Β· Machine Learning
(6)
Generation
(5)
Applications
(4)
Models
(4)
Architectures
(3)
Core Methods
(3)
Learning Paradigms
(3)
Optimization & Theory
(3)
Keywords
zero-shot learning
(4)
sequence-to-sequence model
(4)
language model
(3)
transfer learning
(2)
representation learning
(2)
generative model
(2)
semantic parsing
(2)
multimodal learning
(2)
large language model
(2)
multi-task learning
(1)
in-context learning
(1)
multilingual nlp
(1)
cross-lingual transfer
(1)
question answering
(1)
sample efficiency
(1)
sequence modeling
(1)
self-supervised learning
(1)
code generation
(1)
embedding learning
(1)
passage retrieval
(1)
Papers
Jointly Training Large Autoregressive Multimodal Models
ICLR 2024
D4: Improving LLM Pretraining via Document De-Duplication and Diversification
NeurIPS 2023
InCoder: A Generative Model for Code Infilling and Synthesis
ICLR 2023
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
NeurIPS 2023
Retrieval-Augmented Multimodal Language Modeling
ICML 2023
Scaling Laws for Generative Mixed-Modal Language Models
ICML 2023
CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training
NAACL 2022
HTLM: Hyper-Text Pre-Training and Prompting of Language Models
ICLR 2022
Improving Passage Retrieval with Zero-Shot Question Generation
EMNLP 2022
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
NeurIPS 2022
RetroNLU: Retrieval Augmented Task-Oriented Semantic Parsing
ACL 2022
Better Fine-Tuning by Reducing Representational Collapse
ICLR 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
ACL 2021
Muppet: Massive Multi-task Representations with Pre-Finetuning
EMNLP 2021
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog
NAACL 2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
EMNLP 2021
Conversational Semantic Parsing
EMNLP 2020
Pre-training via Paraphrasing
NeurIPS 2020
Towards Language Agnostic Universal Representations
ACL 2019