ICLR 2020

687 papers

Geometric Analysis of Nonconvex Optimization Landscapes for Overcomplete Learning

Qing Qu, Yuexiang Zhai, Xiao Li, Yuqian Zhang, Zhihui Zhu

Unsupervised Clustering using Pseudo-semi-supervised Learning

Divam Gupta, Ramachandran Ramjee, Nipun Kwatra, Muthian Sivathanu

Simple and Effective Regularization Methods for Training on Noisily Labeled Data with Generalization Guarantee

Wei Hu, Zhiyuan Li, Dingli Yu

Emergent Tool Use From Multi-Agent Autocurricula

Bowen Baker, Ingmar Kanitscheider, Todor Markov, Yi Wu, Glenn Powell

Controlling generative models with continuous factors of variations

Antoine Plumerault, Herve Le Borgne, Celine Hudelot

NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search

Xuanyi Dong, Yi Yang

Strategies for Pre-training Graph Neural Networks

Weihua Hu*, Bowen Liu*, Joseph Gomes, Marinka Zitnik, Percy Liang

Behaviour Suite for Reinforcement Learning

Ian Osband, Yotam Doron, Matteo Hessel, John Aslanides, Eren Sezener

FreeLB: Enhanced Adversarial Training for Natural Language Understanding

Chen Zhu, Yu Cheng, Zhe Gan, Siqi Sun, Tom Goldstein

Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control

Yaofeng Desmond Zhong, Biswadip dey, Amit Chakraborty

Understanding l4-based Dictionary Learning: Interpretation, Stability, and Robustness

Yuexiang Zhai, Hermish Mehta, Zhengyuan Zhou, Yi Ma

Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds

Jordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford, Alekh Agarwal

Quantum Algorithms for Deep Convolutional Neural Networks

Iordanis Kerenidis, Jonas Landman, Anupam Prakash

Self-Supervised Learning of Appliance Usage

Chen-Yu Hsu, Abbas Zeitoun, Guang-He Lee, Dina Katabi, Tommi Jaakkola

Deep Graph Matching Consensus

Matthias Fey, Jan E. Lenssen, Christopher Morris, Jonathan Masci, Nils M. Kriege

Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks

Yu Bai, Jason D. Lee

Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers

Junjie Liu, Zhe Xu, Runbin SHI, Ray C. C. Cheung, Hayden K.H. So

Triple Wins: Boosting Accuracy, Robustness and Efficiency Together by Enabling Input-Adaptive Inference

Ting-Kuei Hu, Tianlong Chen, Haotao Wang, Zhangyang Wang

Neural Policy Gradient Methods: Global Optimality and Rates of Convergence

Lingxiao Wang, Qi Cai, Zhuoran Yang, Zhaoran Wang

Double Neural Counterfactual Regret Minimization

Hui Li, Kailiang Hu, Shaohua Zhang, Yuan Qi, Le Song

GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation

Chence Shi*, Minkai Xu*, Zhaocheng Zhu, Weinan Zhang, Ming Zhang

The Gambler's Problem and Beyond

Baoxiang Wang, Shuai Li, JIAJIN LI, Siu On Chan

Multilingual Alignment of Contextual Word Representations

Steven Cao, Nikita Kitaev, Dan Klein

The Curious Case of Neural Text Degeneration

Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Yejin Choi

Kernelized Wasserstein Natural Gradient

M Arbel, A Gretton, W Li, G Montufar

Graph Convolutional Reinforcement Learning

Jiechuan Jiang, Chen Dun, Tiejun Huang, Zongqing Lu

Meta-Learning Deep Energy-Based Memory Models

Sergey Bartunov, Jack Rae, Simon Osindero, Timothy Lillicrap

Exploratory Not Explanatory: Counterfactual Analysis of Saliency Maps for Deep Reinforcement Learning

Akanksha Atrey, Kaleigh Clary, David Jensen

Fast Neural Network Adaptation via Parameter Remapping and Architecture Search

Jiemin Fang*, Yuzhu Sun*, Kangjian Peng*, Qian Zhang, Yuan Li

Guiding Program Synthesis by Learning to Generate Examples

Larissa Laich, Pavol Bielik, Martin Vechev

SNODE: Spectral Discretization of Neural ODEs for System Identification

Alessio Quaglino, Marco Gallieri, Jonathan Masci, Jan Koutnik

Generalized Convolutional Forest Networks for Domain Generalization and Visual Recognition

Jongbin Ryu, Gitaek Kwon, Ming-Hsuan Yang, Jongwoo Lim

Once-for-All: Train One Network and Specialize it for Efficient Deployment

Han Cai, Chuang Gan, Tianzhe Wang, Zhekai Zhang, Song Han

Multi-Agent Interactions Modeling with Correlated Policies

Minghuan Liu, Ming Zhou, Weinan Zhang, Yuzheng Zhuang, Jun Wang

PCMC-Net: Feature-based Pairwise Choice Markov Chains

Alix LHERITIER

Implementing Inductive bias for different navigation tasks through diverse RNN attrractors

Tie Xu, Omri Barak

Query2box: Reasoning over Knowledge Graphs in Vector Space Using Box Embeddings

Hongyu Ren*, Weihua Hu*, Jure Leskovec

Rethinking the Hyperparameters for Fine-tuning

Hao Li, Pratik Chaudhari, Hao Yang, Michael Lam, Avinash Ravichandran

Understanding and Robustifying Differentiable Architecture Search

Arber Zela, Thomas Elsken, Tonmoy Saikia, Yassine Marrakchi, Thomas Brox

Plug and Play Language Models: A Simple Approach to Controlled Text Generation

Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank

A Closer Look at Deep Policy Gradients

Andrew Ilyas, Logan Engstrom, Shibani Santurkar, Dimitris Tsipras, Firdaus Janoos

Implementation Matters in Deep RL: A Case Study on PPO and TRPO

Logan Engstrom, Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras, Firdaus Janoos

Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks

Wei Hu, Lechao Xiao, Jeffrey Pennington

RGBD-GAN: Unsupervised 3D Representation Learning From Natural Image Datasets via RGBD Image Synthesis

Atsuhiro Noguchi, Tatsuya Harada

And the Bit Goes Down: Revisiting the Quantization of Neural Networks

Pierre Stock, Armand Joulin, Remi Gribonval, Benjamin Graham, Herve Jegou

Towards Verified Robustness under Text Deletion Interventions

Johannes Welbl, Po-Sen Huang, Robert Stanforth, Sven Gowal, Krishnamurthy (Dj) Dvijotham

Jacobian Adversarially Regularized Networks for Robustness

Alvin Chan, Yi Tay, Yew Soon Ong, Jie Fu

Thinking While Moving: Deep Reinforcement Learning with Concurrent Control

Ted Xiao, Eric Jang, Dmitry Kalashnikov, Sergey Levine, Julian Ibarz

Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement Learning

Qian Long*, Zihan Zhou*, Abhinav Gupta, Fei Fang, Yi Wu†

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

Environmental drivers of systematicity and generalization in a situated agent

Felix Hill, Andrew Lampinen, Rosalia Schneider, Stephen Clark, Matthew Botvinick

Abstract Diagrammatic Reasoning with Multiplex Graph Networks

Duo Wang, Mateja Jamnik, Pietro Lió

A Baseline for Few-Shot Image Classification

Guneet Singh Dhillon, Pratik Chaudhari, Avinash Ravichandran, Stefano Soatto

Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering

Akari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, Richard Socher, Caiming Xiong

Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks

Alejandro Molina, Patrick Schramowski, Kristian Kersting

A FRAMEWORK FOR ROBUSTNESS CERTIFICATION OF SMOOTHED CLASSIFIERS USING F-DIVERGENCES

Krishnamurthy (Dj) Dvijotham, Jamie Hayes, Borja Balle, Zico Kolter, Chongli Qin

Contrastive Representation Distillation

Yonglong Tian, Dilip Krishnan, Phillip Isola

Certified Defenses for Adversarial Patches

Ping-yeh Chiang*, Renkun Ni*, Ahmed Abdelkader, Chen Zhu, Christoph Studor

Fast Task Inference with Variational Intrinsic Successor Features

Steven Hansen, Will Dabney, Andre Barreto, David Warde-Farley, Tom Van de Wiele

Sample Efficient Policy Gradient Methods with Recursive Variance Reduction

Pan Xu, Felicia Gao, Quanquan Gu

Deep Symbolic Superoptimization Without Human Knowledge

Hui Shi, Yang Zhang, Xinyun Chen, Yuandong Tian, Jishen Zhao

Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks

Hae Beom Lee, Hayeon Lee, Donghyun Na, Saehoon Kim, Minseop Park

Explain Your Move: Understanding Agent Actions Using Specific and Relevant Feature Attribution

Nikaash Puri, Sukriti Verma, Piyush Gupta, Dhruv Kayastha, Shripad Deshmukh

Universal Approximation with Certified Networks

Maximilian Baader, Matthew Mirman, Martin Vechev

A Latent Morphology Model for Open-Vocabulary Neural Machine Translation

Duygu Ataman, Wilker Aziz, Alexandra Birch

Measuring and Improving the Use of Graph Information in Graph Neural Networks

Yifan Hou, Jian Zhang, James Cheng, Kaili Ma, Richard T. B. Ma

State-only Imitation with Transition Dynamics Mismatch

Tanmay Gangwani, Jian Peng

Understanding Why Neural Networks Generalize Well Through GSNR of Parameters

Jinlong Liu, Yunzhi Bai, Guoqing Jiang, Ting Chen, Huayan Wang

Adversarial AutoAugment

Xinyu Zhang, Qiang Wang, Jian Zhang, Zhao Zhong

Meta Dropout: Learning to Perturb Latent Features for Generalization

Hae Beom Lee, Taewook Nam, Eunho Yang, Sung Ju Hwang

Rényi Fair Inference

Sina Baharlouei, Maher Nouiehed, Ahmad Beirami, Meisam Razaviyayn

Learning transport cost from subset correspondence

Ruishan Liu, Akshay Balsubramani, James Zou

RNA Secondary Structure Prediction By Learning Unrolled Algorithms

Xinshi Chen, Yu Li, Ramzan Umarov, Xin Gao, Le Song

BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget

Jack Turner, Elliot J. Crowley, Michael O'Boyle, Amos Storkey, Gavin Gray

Variance Reduction With Sparse Gradients

Melih Elibol, Lihua Lei, Michael I. Jordan

Abductive Commonsense Reasoning

Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman

Discrepancy Ratio: Evaluating Model Performance When Even Experts Disagree on the Truth

Igor Lovchinsky, Alon Daks, Israel Malkin, Pouya Samangouei, Ardavan Saeedi

Weakly Supervised Disentanglement with Guarantees

Rui Shu, Yining Chen, Abhishek Kumar, Stefano Ermon, Ben Poole

Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attacks

Jiadong Lin, Chuanbiao Song, Kun He, Liwei Wang, John E. Hopcroft

Fantastic Generalization Measures and Where to Find Them

Yiding Jiang*, Behnam Neyshabur*, Hossein Mobahi, Dilip Krishnan, Samy Bengio

Robustness Verification for Transformers

Zhouxing Shi, Huan Zhang, Kai-Wei Chang, Minlie Huang, Cho-jui Hsieh

Network Randomization: A Simple Technique for Generalization in Deep Reinforcement Learning

Kimin Lee, Kibok Lee, Jinwoo Shin, Honglak Lee

Tensor Decompositions for Temporal Knowledge Base Completion

Timothee Lacroix, Guillaume Obozinski, Nicolas Usunier

On Universal Equivariant Set Networks

Nimrod Segol, Yaron Lipman

Model Based Reinforcement Learning for Atari

Łukasz Kaiser, Mohammad Babaeizadeh, Piotr Miłoś, Błażej Osiński, Roy H Campbell

Provable robustness against all adversarial l_p-perturbations for p≥ 1

Francesco Croce, Matthias Hein

Don't Use Large Mini-batches, Use Local SGD

Tao LIN, Sebastian U. Stich, Kumar Kshitij Patel, Martin Jaggi

Kernel of CycleGAN as a principal homogeneous space

Nikita Moriakov, Jonas Adler, Jonas Teuwen

Distributionally Robust Neural Networks

Shiori Sagawa*, Pang Wei Koh*, Tatsunori B. Hashimoto, Percy Liang

On Solving Minimax Optimization Locally: A Follow-the-Ridge Approach

Yuanhao Wang*, Guodong Zhang*, Jimmy Ba

A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning

Soochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee Kim

Hyper-SAGNN: a self-attention based graph neural network for hypergraphs

Ruochi Zhang, Yuesong Zou, Jian Ma

Neural Epitome Search for Architecture-Agnostic Network Compression

Daquan Zhou, Xiaojie Jin, Qibin Hou, KAIXIN WANG, Jianchao Yang

Disagreement-Regularized Imitation Learning

Kianté Brantley, Wen Sun, Mikael Henaff

On the Equivalence between Positional Node Embeddings and Structural Graph Representations

Balasubramaniam Srinivasan, Bruno Ribeiro

Watch the Unobserved: A Simple Approach to Parallelizing Monte Carlo Tree Search

Anji Liu, Jianshu Chen, Mingze Yu, Yu Zhai, Xuewen Zhou

Target-Embedding Autoencoders for Supervised Representation Learning

Daniel Jarrett, Mihaela van der Schaar

Reformer: The Efficient Transformer

Nikita Kitaev, LUKASZ KAISER, Anselm Levskaya

Probability Calibration for Knowledge Graph Embedding Models

Pedro Tabacof, Luca Costabello

Why Not to Use Zero Imputation? Correcting Sparsity Bias in Training Neural Networks

Joonyoung Yi, Juhyuk Lee, Kwang Joon Kim, Sung Ju Hwang, Eunho Yang