NeurIPS 2021

2,334 papers

Efficient and Local Parallel Random Walks

Michael Kapralov, Silvio Lattanzi, Navid Nouri, Jakab Tardos

Mini-Batch Consistent Slot Set Encoder for Scalable Set Encoding

Andreis Bruno, Jeffrey Willette, Juho Lee, Sung Ju Hwang

A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs

Gadi Naveh, Zohar Ringel

Multi-Objective Meta Learning

Feiyang YE, Baijiong Lin, Zhixiong Yue, Pengxin Guo, Qiao Xiao

Neural Flows: Efficient Alternative to Neural ODEs

Marin Biloš, Johanna Sommer, Syama Sundar Rangapuram, Tim Januschowski, Stephan Günnemann

Task-Adaptive Neural Network Search with Meta-Contrastive Learning

Wonyong Jeong, Hayeon Lee, Geon Park, Eunyoung Hyung, Jinheon Baek

SOFT: Softmax-free Transformer with Linear Complexity

Jiachen Lu, Jinghan Yao, Junge Zhang, Xiatian Zhu, Hang Xu

Disrupting Deep Uncertainty Estimation Without Harming Accuracy

Ido Galil, Ran El-Yaniv

Robust Learning of Optimal Auctions

Wenshuo Guo, Michael I. Jordan, Emmanouil Zampetakis

PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition

Cheng-I Jeff Lai, Yang Zhang, Alexander H. Liu, Shiyu Chang, Yi-Lun Liao

Heavy Ball Momentum for Conditional Gradient

Bingcong Li, Alireza Sadeghi, Georgios Giannakis

Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer

Junya Chen, Zidi Xiu, Benjamin Goldstein, Ricardo Henao, Lawrence Carin

Generalization Guarantee of SGD for Pairwise Learning

Yunwen Lei, Mingrui Liu, Yiming Ying

Optimal Order Simple Regret for Gaussian Process Bandits

Sattar Vakili, Nacime Bouziani, Sepehr Jalali, Alberto Bernacchia, Da-shan Shiu

Exploiting Domain-Specific Features to Enhance Domain Generalization

Manh-Ha Bui, Toan Tran, Anh Tran, Dinh Phung

Predicting Deep Neural Network Generalization with Perturbation Response Curves

Yair Schiff, Brian Quanz, Payel Das, Pin-Yu Chen

Provably Efficient Causal Reinforcement Learning with Confounded Observational Data

Lingxiao Wang, Zhuoran Yang, Zhaoran Wang

DeepReduce: A Sparse-tensor Communication Framework for Federated Deep Learning

Hang Xu, Kelly Kostopoulou, Aritra Dutta, Xin Li, Alexandros Ntoulas

The Effect of the Intrinsic Dimension on the Generalization of Quadratic Classifiers

Fabian Latorre, Leello Tadesse Dadi, Paul Rolland, Volkan Cevher

Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers

Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu

Learning and Generalization in RNNs

Abhishek Panigrahi, Navin Goyal

Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks

Itay Hubara, Brian Chmiel, Moshe Island, Ron Banner, Joseph Naor

Improved Coresets and Sublinear Algorithms for Power Means in Euclidean Spaces

Vincent Cohen-Addad, David Saulpic, Chris Schwiegelshohn

Duplex Sequence-to-Sequence Learning for Reversible Machine Translation

Zaixiang Zheng, Hao Zhou, Shujian Huang, Jiajun Chen, Jingjing Xu

Deep Residual Learning in Spiking Neural Networks

Wei Fang, Zhaofei Yu, Yanqi Chen, Tiejun Huang, Timothée Masquelier

Accelerating Quadratic Optimization with Reinforcement Learning

Jeffrey Ichnowski, Paras Jain, Bartolomeo Stellato, Goran Banjac, Michael Luo

Variational Multi-Task Learning with Gumbel-Softmax Priors

Jiayi Shen, Xiantong Zhen, Marcel Worring, Ling Shao

Deconvolutional Networks on Graph Data

Jia Li, JIAJIN LI, Yang Liu, Jianwei Yu, Yueting Li

Perturbation Theory for the Information Bottleneck

Vudtiwat Ngampruetikorn, David J Schwab

Efficient Online Estimation of Causal Effects by Deciding What to Observe

Shantanu Gupta, Zachary Lipton, David Childers

Learning Graph Cellular Automata

Daniele Grattarola, Lorenzo Livi, Cesare Alippi

TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation

Haoang Chi, Feng Liu, Wenjing Yang, Long Lan, Tongliang Liu

When Are Solutions Connected in Deep Networks?

Quynh N Nguyen, Pierre Bréchet, Marco Mondelli

Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective

Tianlong Chen, Yu Cheng, Zhe Gan, Jingjing Liu, Zhangyang Wang

Explanation-based Data Augmentation for Image Classification

Sandareka Wickramanayake, Wynne Hsu, Mong Li Lee

Catch-A-Waveform: Learning to Generate Audio from a Single Short Example

Gal Greshler, Tamar Shaham, Tomer Michaeli

Reinforcement Learning based Disease Progression Model for Alzheimer’s Disease

Krishnakant Saboo, Anirudh Choudhary, Yurui Cao, Gregory Worrell, David Jones

Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

Derek Lim, Felix Hohne, Xiuyu Li, Sijia Linda Huang, Vaishnavi Gupta

TestRank: Bringing Order into Unlabeled Test Instances for Deep Learning Tasks

Yu Li, Min Li, Qiuxia LAI, Yannan Liu, Qiang Xu

RED : Looking for Redundancies for Data-FreeStructured Compression of Deep Neural Networks

Edouard YVINEC, Arnaud Dapogny, Matthieu Cord, Kevin Bailly

Precise characterization of the prior predictive distribution of deep ReLU networks

Lorenzo Noci, Gregor Bachmann, Kevin Roth, Sebastian Nowozin, Thomas Hofmann

MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge

Geng Yuan, Xiaolong Ma, Wei Niu, Zhengang Li, Zhenglun Kong

Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks

Frank Schneider, Felix Dangel, Philipp Hennig

Gaussian Kernel Mixture Network for Single Image Defocus Deblurring

Yuhui Quan, Zicong Wu, Hui Ji

The balancing principle for parameter choice in distance-regularized domain adaptation

Werner Zellinger, Natalia Shepeleva, Marius-Constantin Dinu, Hamid Eghbal-zadeh, Hoan Duc Nguyen

Exponential Separation between Two Learning Models and Adversarial Robustness

Grzegorz Gluch, Ruediger Urbanke

Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal Memory

Takashi Matsubara, Yuto Miyatake, Takaharu Yaguchi

Safe Policy Optimization with Local Generalized Linear Function Approximations

Akifumi Wachi, Yunyue Wei, Yanan Sui

Object DGCNN: 3D Object Detection using Dynamic Graphs

Yue Wang, Justin M Solomon

Techniques for Symbol Grounding with SATNet

Sever Topan, David Rolnick, Xujie Si

DominoSearch: Find layer-wise fine-grained N:M sparse schemes from dense neural networks

Wei Sun, Aojun Zhou, Sander Stuijk, Rob Wijnhoven, Andrew Oakleigh Nelson

Local policy search with Bayesian optimization

Sarah Müller, Alexander von Rohr, Sebastian Trimpe

Relaxed Marginal Consistency for Differentially Private Query Answering

Ryan McKenna, Siddhant Pradhan, Daniel R. Sheldon, Gerome Miklau

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

Xudong XU, Xingang Pan, Dahua Lin, Bo Dai

Adaptive wavelet distillation from neural networks through interpretations

Wooseok Ha, Chandan Singh, Francois Lanusse, Srigokul Upadhyayula, Bin Yu

Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds and Benign Overfitting

Frederic Koehler, Lijia Zhou, Danica J. Sutherland, Nathan Srebro

Meta Internal Learning

Raphael Bensadoun, Shir Gur, Tomer Galanti, Lior Wolf

Dueling Bandits with Team Comparisons

Lee Cohen, Ulrike Schmidt-Kraepelin, Yishay Mansour

Auditing Black-Box Prediction Models for Data Minimization Compliance

Bashir Rastegarpanah, Krishna Gummadi, Mark Crovella

BNS: Building Network Structures Dynamically for Continual Learning

Qi Qin, Wenpeng Hu, Han Peng, Dongyan Zhao, Bing Liu

Deep Learning on a Data Diet: Finding Important Examples Early in Training

Mansheej Paul, Surya Ganguli, Gintare Karolina Dziugaite

Skipping the Frame-Level: Event-Based Piano Transcription With Neural Semi-CRFs

Yujia Yan, Frank Cwitkowitz, Zhiyao Duan

STORM+: Fully Adaptive SGD with Recursive Momentum for Nonconvex Optimization

Kfir Levy, Ali Kavis, Volkan Cevher

Implicit Regularization in Matrix Sensing via Mirror Descent

Fan Wu, Patrick Rebeschini

Variational Inference for Continuous-Time Switching Dynamical Systems

Lukas Köhs, Bastian Alt, Heinz Koeppl

SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement

Heyang Qin, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang

Interesting Object, Curious Agent: Learning Task-Agnostic Exploration

Simone Parisi, Victoria Dean, Deepak Pathak, Abhinav Gupta

Private learning implies quantum stability

Yihui Quek, Srinivasan Arunachalam, John A Smolin

The best of both worlds: stochastic and adversarial episodic MDPs with unknown transition

Tiancheng Jin, Longbo Huang, Haipeng Luo

Generic Neural Architecture Search via Regression

Yuhong Li, Cong Hao, Pan Li, Jinjun Xiong, Deming Chen

On Large-Cohort Training for Federated Learning

Zachary Charles, Zachary Garrett, Zhouyuan Huo, Sergei Shmulyian, Virginia Smith

On sensitivity of meta-learning to support data

Mayank Agarwal, Mikhail Yurochkin, Yuekai Sun

Exponential Bellman Equation and Improved Regret Bounds for Risk-Sensitive Reinforcement Learning

Yingjie Fei, Zhuoran Yang, Yudong Chen, Zhaoran Wang

Nested Variational Inference

Heiko Zimmermann, Hao Wu, Babak Esmaeili, Jan-Willem van de Meent

BCORLE(λ): An Offline Reinforcement Learning and Evaluation Framework for Coupons Allocation in E-commerce Market

Yang Zhang, Bo Tang, Qingyu Yang, Dou An, Hongyin Tang

Differentiable rendering with perturbed optimizers

Quentin Le Lidec, Ivan Laptev, Cordelia Schmid, Justin Carpentier

A Convergence Analysis of Gradient Descent on Graph Neural Networks

Pranjal Awasthi, Abhimanyu Das, Sreenivas Gollapudi

Excess Capacity and Backdoor Poisoning

Naren Manoj, Avrim Blum

Across-animal odor decoding by probabilistic manifold alignment

Pedro Herrero-Vidal, Dmitry Rinberg, Cristina Savin

Human-Adversarial Visual Question Answering

Sasha Sheng, Amanpreet Singh, Vedanuj Goswami, Jose Magana, Tristan Thrush

Parallel and Efficient Hierarchical k-Median Clustering

Vincent Cohen-Addad, Silvio Lattanzi, Ashkan Norouzi-Fard, Christian Sohler, Ola Svensson

Node Dependent Local Smoothing for Scalable Graph Learning

Wentao Zhang, Mingyu Yang, Zeang Sheng, Yang Li, Wen Ouyang

Reliable Causal Discovery with Improved Exact Search and Weaker Assumptions

Ignavier Ng, Yujia Zheng, Jiji Zhang, Kun Zhang

Estimating the Unique Information of Continuous Variables

Ari Pakman, Amin Nejatbakhsh, Dar Gilboa, Abdullah Makkeh, Luca Mazzucato

Rate-Optimal Subspace Estimation on Random Graphs

Zhixin Zhou, Fan Zhou, Ping Li, Cun-hui Zhang

Differentiable Spline Approximations

Minsu Cho, Aditya Balu, Ameya Joshi, Anjana Deva Prasad, Biswajit Khara

On the Provable Generalization of Recurrent Neural Networks

Lifu Wang, Bo Shen, Bo Hu, Xing Cao

Practical Large-Scale Linear Programming using Primal-Dual Hybrid Gradient

David Applegate, Mateo Diaz, Oliver Hinder, Haihao Lu, Miles Lubin

α-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression

JIABO HE, Sarah Erfani, Xingjun Ma, James Bailey, Ying Chi

Model-Based Domain Generalization

Alexander Robey, George J. Pappas, Hamed Hassani

Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs

Raul Astudillo, Daniel Jiang, Maximilian Balandat, Eytan Bakshy, Peter Frazier

Asynchronous Decentralized Online Learning

Jiyan Jiang, Wenpeng Zhang, Jinjie GU, Wenwu Zhu

User-Level Differentially Private Learning via Correlated Sampling

Badih Ghazi, Ravi Kumar, Pasin Manurangsi

Simple Stochastic and Online Gradient Descent Algorithms for Pairwise Learning

ZHENHUAN YANG, Yunwen Lei, Puyu Wang, Tianbao Yang, Yiming Ying

SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition

Rishabh Kabra, Daniel Zoran, Goker Erdogan, Loic Matthey, Antonia Creswell

A Minimalist Approach to Offline Reinforcement Learning

Scott Fujimoto, Shixiang (Shane) Gu

Explicable Reward Design for Reinforcement Learning Agents

Rati Devidze, Goran Radanovic, Parameswaran Kamalaruban, Adish Singla

Hessian Eigenspectra of More Realistic Nonlinear Models

Zhenyu Liao, Michael W. Mahoney

Laplace Redux - Effortless Bayesian Deep Learning

Erik Daxberger, Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen, Matthias Bauer

Directed Probabilistic Watershed

Enrique Fita Sanmartin, Sebastian Damrich, Fred A. Hamprecht