Dara Bahri
22 papers · 2018–2024 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (41) π Academic Marathon Β· Sprint π Conference Polyglot Β· Bronze π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π¬
Deep Specialist
(11)
π€
Dynamic Duo
(16)
π§¬
Topic Evolution
β‘
Prolific Year Β· Productive
π
Trend Setter
π₯
Unstoppable Β· Bronze
β
The Questioner
ποΈ
Keyword Collector
(99)
π
Century Club Β· Bronze
Venues
Top co-authors
Research topics
Deep Learning
(16)
Machine Learning
(14)
Architectures
(11)
Artificial Intelligence
(8)
Natural Language Processing
(7)
Core AI
(6)
Learning Types
(6)
Optimization & Theory Β· Deep Learning
(5)
Optimization & Theory Β· Machine Learning
(5)
Techniques
(5)
Core Methods
(4)
Application Areas
(3)
Applications
(3)
Models
(3)
Resources & Methods
(3)
Keywords
sharpness-aware minimization
(3)
transformer architecture
(3)
language model
(3)
neural network
(3)
large language model
(2)
few-shot learning
(2)
model architecture
(2)
multi-task learning
(2)
semi-supervised learning
(1)
transfer learning
(1)
sample efficiency
(1)
self-supervised learning
(1)
knowledge distillation
(1)
machine translation
(1)
benchmark suite
(1)
contrastive learning
(1)
dependency parsing
(1)
information retrieval
(1)
neural network training
(1)
text generation
(1)
Papers
A Universal Class of Sharpness-Aware Minimization Algorithms
ICML 2024
Sharpness-Aware Minimization Leads to Low-Rank Features
NeurIPS 2023
UL2: Unifying Language Learning Paradigms
ICLR 2023
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization
ICLR 2022
Churn Reduction via Distillation
ICLR 2022
Confident Adaptive Language Modeling
NeurIPS 2022
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference
ACL 2022
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
ICLR 2022
Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption
ICLR 2022
Sharpness-Aware Minimization Improves Language Model Generalization
ACL 2022
Transformer Memory as a Differentiable Search Index
NeurIPS 2022
Are Pretrained Convolutions Better than Pretrained Transformers?
ACL 2021
HyperGrid Transformers: Towards A Single Model for Multiple Tasks
ICLR 2021
Locally Adaptive Label Smoothing Improves Predictive Churn
ICML 2021
Long Range Arena : A Benchmark for Efficient Transformers
ICLR 2021
OmniNet: Omnidirectional Representations from Transformers
ICML 2021
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling
ACL 2021
Synthesizer: Rethinking Self-Attention for Transformer Models
ICML 2021
Deep k-NN for Noisy Labels
ICML 2020
Reverse Engineering Configurations of Neural Text Generation Models
ACL 2020
Sparse Sinkhorn Attention
ICML 2020
Diminishing Returns Shape Constraints for Interpretability and Regularization
NeurIPS 2018