Ashish Vaswani
29 papers · 2010–2022 · 9 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (27) π Academic Marathon Β· Half π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π§
Keyword Pioneer
ποΈ
Keyword Collector
(72)
π
Trend Setter
π
Century Club Β· Bronze
π₯
Unstoppable Β· Silver
β‘
Prolific Year Β· Productive
Top co-authors
Research topics
Deep Learning
(13)
Architectures
(9)
Machine Learning
(8)
Computer Vision
(5)
Natural Language Processing
(4)
Analysis
(4)
Applications
(4)
Learning Types
(4)
Techniques
(4)
Application Areas
(3)
Core Methods
(3)
Optimization & Theory Β· Machine Learning
(3)
Optimization & Theory Β· Deep Learning
(3)
Artificial Intelligence
(2)
Core AI
(2)
Keywords
transformer architecture
(4)
image classification
(4)
object detection
(4)
convolutional neural network
(3)
neural machine translation
(2)
machine translation
(2)
sequence model
(2)
parameter efficiency
(2)
neural network
(2)
instance segmentation
(2)
autoregressive model
(2)
transformer model
(2)
visual navigation
(1)
passage retrieval
(1)
vision-language navigation
(1)
self-attention mechanism
(1)
attention mechanism
(1)
model parallelism
(1)
image generation
(1)
deep learning
(1)
Papers
Scale Efficiently: Insights from Pretraining and Finetuning Transformers
ICLR 2022
The Efficiency Misnomer
ICLR 2022
Bottleneck Transformers for Visual Recognition
CVPR 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones
CVPR 2021
Simple and Efficient ways to Improve REALM
EMNLP 2021
Attention Augmented Convolutional Networks
ICCV 2019
Music Transformer: Generating Music with Long-Term Structure
ICLR 2019
Stand-Alone Self-Attention in Vision Models
NeurIPS 2019
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
ACL 2019
Fast Decoding in Sequence Models Using Discrete Latent Variables
ICML 2018
Image Transformer
ICML 2018
Mesh-TensorFlow: Deep Learning for Supercomputers
NeurIPS 2018
Self-Attention with Relative Position Representations
NAACL 2018
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation
ACL 2018
Attention is All you Need
NeurIPS 2017
Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning
NAACL 2016
Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies
NAACL 2016
Supertagging With LSTMs
NAACL 2016
Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data
NAACL 2015
Unifying Bayesian Inference and Vector Space Models for Improved Decipherment
ACL 2015
Aligning context-based statistical models of language with brain activity during reading
EMNLP 2014
Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation
EMNLP 2014
Decoding with Large-Scale Neural Language Models Improves Translation
EMNLP 2013
Learning Whom to Trust with MACE
NAACL 2013
Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm
ACL 2012
Models and Training for Unsupervised Preposition Sense Disambiguation
ACL 2011
Rule Markov Models for Fast Tree-to-String Translation
ACL 2011
Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging
ACL 2010
Fast, Greedy Model Minimization for Unsupervised Tagging
COLING 2010