NeurIPS 2021

2,334 papers

Spectrum-to-Kernel Translation for Accurate Blind Image Super-Resolution

Guangpin Tao, Xiaozhong Ji, Wenzhuo Wang, Shuo Chen, Chuming Lin

Sparse Flows: Pruning Continuous-depth Models

Lucas Liebenwein, Ramin Hasani, Alexander Amini, Daniela Rus

Revisiting ResNets: Improved Training and Scaling Strategies

Irwan Bello, William Fedus, Xianzhi Du, Ekin Dogus Cubuk, Aravind Srinivas

Analysis of Sensing Spectral for Signal Recovery under a Generalized Linear Model

Junjie Ma, Ji Xu, Arian Maleki

Fast Extra Gradient Methods for Smooth Structured Nonconvex-Nonconcave Minimax Problems

Sucheol Lee, Donghwan Kim

The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learning

Yujin Tang, David Ha

Learning Disentangled Behavior Embeddings

Changhao Shi, Sivan Schwartz, Shahar Levy, Shay Achvat, Maisan Abboud

Observation-Free Attacks on Stochastic Bandits

Yinglun Xu, Bhuvesh Kumar, Jacob D. Abernethy

NAS-Bench-x11 and the Power of Learning Curves

Shen Yan, Colin White, Yash Savani, Frank Hutter

Reinforcement Learning Enhanced Explainer for Graph Neural Networks

Caihua Shan, Yifei Shen, Yao Zhang, Xiang Li, Dongsheng Li

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

Xiaolin Hu, Kai Li, Weiyi Zhang, Yi Luo, Jean-Marie Lemercier

Contextual Recommendations and Low-Regret Cutting-Plane Algorithms

Sreenivas Gollapudi, Guru Guruganesh, Kostas Kollias, Pasin Manurangsi, Renato Leme

Geometry Processing with Neural Fields

Guandao Yang, Serge Belongie, Bharath Hariharan, Vladlen Koltun

Combiner: Full Attention Transformer with Sparse Computation Cost

Hongyu Ren, Hanjun Dai, Zihang Dai, Mengjiao Yang, Jure Leskovec

Bandits with many optimal arms

Rianne de Heide, James Cheshire, Pierre Menard, Alexandra Carpentier

Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning

Zixuan Ke, Bing Liu, Nianzu Ma, Hu Xu, Lei Shu

Predicting Event Memorability from Contextual Visual Semantics

Qianli Xu, Fen Fang, Ana Molino, Vigneshwaran Subbaraju, Joo-Hwee Lim

Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting

Haixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng Long

SWAD: Domain Generalization by Seeking Flat Minima

Junbum Cha, Sanghyuk Chun, Kyungjae Lee, Han-Cheol Cho, Seunghyun Park

Heterogeneous Multi-player Multi-armed Bandits: Closing the Gap and Generalization

Chengshuai Shi, Wei Xiong, Cong Shen, Jing Yang

AFEC: Active Forgetting of Negative Transfer in Continual Learning

Liyuan Wang, Mingtian Zhang, Zhongfan Jia, Qian Li, Chenglong Bao

NORESQA: A Framework for Speech Quality Assessment using Non-Matching References

Pranay Manocha, Buye Xu, Anurag Kumar

Pseudo-Spherical Contrastive Divergence

Lantao Yu, Jiaming Song, Yang Song, Stefano Ermon

Testing Probabilistic Circuits

Yash Pralhad Pote, Kuldeep S Meel

Lower Bounds and Optimal Algorithms for Smooth and Strongly Convex Decentralized Optimization Over Time-Varying Networks

Dmitry Kovalev, Elnur Gasanov, Alexander Gasnikov, Peter Richtarik

Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibration

Shengjia Zhao, Michael Kim, Roshni Sahoo, Tengyu Ma, Stefano Ermon

Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration

Yan Sun, Wenjun Xiong, Faming Liang

Nearly Minimax Optimal Reinforcement Learning for Discounted MDPs

Jiafan He, Dongruo Zhou, Quanquan Gu

Online Sign Identification: Minimization of the Number of Errors in Thresholding Bandits

Reda Ouhamma, Rémy Degenne, Pierre Gaillard, Vianney Perchet

Twice regularized MDPs and the equivalence between robustness and regularization

Esther Derman, Matthieu Geist, Shie Mannor

Miklos Racz, Anirudh Sridhar

Biological learning in key-value memory networks

Danil Tyulmankov, Ching Fang, Annapurna Vadaparty, Guangyu Robert Yang

EvoGrad: Efficient Gradient-Based Meta-Learning and Hyperparameter Optimization

Ondrej Bohdal, Yongxin Yang, Timothy Hospedales

DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networks

Boris van Breugel, Trent Kyono, Jeroen Berrevoets, Mihaela van der Schaar

Two steps to risk sensitivity

Christopher Gagne, Peter Dayan

Latent Execution for Neural Program Synthesis Beyond Domain-Specific Languages

Xinyun Chen, Dawn Song, Yuandong Tian

Understanding How Encoder-Decoder Architectures Attend

Kyle Aitken, Vinay Ramasesh, Yuan Cao, Niru Maheswaranathan

Reinforcement Learning with Latent Flow

Wenling Shang, Xiaofei Wang, Aravind Srinivas, Aravind Rajeswaran, Yang Gao

Comprehensive Knowledge Distillation with Causal Intervention

Xiang Deng, Zhongfei Zhang

Reinforcement Learning in Newcomblike Environments

James Bell, Linda Linsefors, Caspar Oesterheld, Joar Skalse

Averaging on the Bures-Wasserstein manifold: dimension-free convergence of gradient descent

Jason Altschuler, Sinho Chewi, Patrik R Gerber, Austin Stromme

On the Bias-Variance-Cost Tradeoff of Stochastic Optimization

Yifan Hu, Xin Chen, Niao He

Semi-Supervised Semantic Segmentation via Adaptive Equalization Learning

Hanzhe Hu, Fangyun Wei, Han Hu, Qiwei Ye, Jinshi Cui

Three-dimensional spike localization and improved motion correction for Neuropixels recordings

Julien Boussard, Erdem Varol, Hyun Dong Lee, Nishchal Dethe, Liam Paninski

Risk Bounds and Calibration for a Smart Predict-then-Optimize Method

Heyuan Liu, Paul Grigas

NeuroMLR: Robust & Reliable Route Recommendation on Road Networks

Jayant Jain, Vrittika Bagadia, Sahil Manchanda, Sayan Ranu

Ultrahyperbolic Neural Networks

Marc Law

Unifying lower bounds on prediction dimension of convex surrogates

Jessica Finocchiaro, Rafael M. Frongillo, Bo Waggoner

Fair Exploration via Axiomatic Bargaining

Jackie Baek, Vivek Farias

Searching Parameterized AP Loss for Object Detection

Tao Chenxin, Zizhang Li, Xizhou Zhu, Gao Huang, Yong Liu

Photonic Differential Privacy with Direct Feedback Alignment

Ruben Ohana, Hamlet Medina, Julien Launay, Alessandro Cappelli, Iacopo Poli

DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networks

Pál András Papp, Karolis Martinkus, Lukas Faber, Roger Wattenhofer

Few-Shot Segmentation via Cycle-Consistent Transformer

Gengwei Zhang, Guoliang Kang, Yi Yang, Yunchao Wei

Learning rule influences recurrent network representations but not attractor structure in decision-making tasks

Brandon McMahan, Michael Kleinman, Jonathan Kao

Asymptotically Best Causal Effect Identification with Multi-Armed Bandits

Alan Malek, Silvia Chiappa

On Robust Optimal Transport: Computational Complexity and Barycenter Computation

Khang Le, Huy Nguyen, Quang M Nguyen, Tung Pham, Hung Bui

A Comprehensively Tight Analysis of Gradient Descent for PCA

Zhiqiang Xu, Ping Li

Best-case lower bounds in online learning

Cristóbal Guzmán, Nishant Mehta, Ali Mortazavi

Extending Lagrangian and Hamiltonian Neural Networks with Differentiable Contact Models

Yaofeng Desmond Zhong, Biswadip dey, Amit Chakraborty

SOLQ: Segmenting Objects by Learning Queries

Bin Dong, Fangao Zeng, Tiancai Wang, Xiangyu Zhang, Yichen Wei

Widening the Pipeline in Human-Guided Reinforcement Learning with Explanation and Context-Aware Data Augmentation

Lin Guan, Mudit Verma, Suna (Sihang) Guo, Ruohan Zhang, Subbarao Kambhampati

Disentangled Contrastive Learning on Graphs

Haoyang Li, Xin Wang, Ziwei Zhang, Zehuan Yuan, Hang Li

Boosted CVaR Classification

Runtian Zhai, Chen Dan, Arun Suggala, J. Zico Kolter, Pradeep K Ravikumar

Accelerating Robotic Reinforcement Learning via Parameterized Action Primitives

Murtaza Dalal, Deepak Pathak, Ruslan Salakhutdinov

Dirichlet Energy Constrained Learning for Deep Graph Neural Networks

Kaixiong Zhou, Xiao Huang, Daochen Zha, Rui Chen, Li Li

Double Machine Learning Density Estimation for Local Treatment Effects with Instruments

Yonghan Jung, Jin Tian, Elias Bareinboim

TTT++: When Does Self-Supervised Test-Time Training Fail or Thrive?

Yuejiang Liu, Parth Kothari, Bastien van Delft, Baptiste Bellot-Gurlet, Taylor Mordan

Functional Variational Inference based on Stochastic Process Generators

Chao Ma, José Miguel Hernández-Lobato

Beyond the Signs: Nonparametric Tensor Completion via Sign Series

Chanwoo Lee, Miaoyan Wang

Stateful ODE-Nets using Basis Function Expansions

Alejandro Queiruga, N. Benjamin Erichson, Liam Hodgkinson, Michael W. Mahoney

SNIPS: Solving Noisy Inverse Problems Stochastically

Bahjat Kawar, Gregory Vaksman, Michael Elad

Fair Scheduling for Time-dependent Resources

Bo Li, Minming Li, Ruilong Zhang

Hierarchical Reinforcement Learning with Timed Subgoals

Nico Gürtler, Dieter Büchler, Georg Martius

Integrated Latent Heterogeneity and Invariance Learning in Kernel Space

Jiashuo Liu, Zheyuan Hu, Peng Cui, Bo Li, Zheyan Shen

FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition

Yichong Leng, Xu Tan, Linchen Zhu, Jin Xu, Renqian Luo

Variational Diffusion Models

Diederik Kingma, Tim Salimans, Ben Poole, Jonathan Ho

Iterative Teaching by Label Synthesis

Weiyang Liu, Zhen Liu, Hanchen Wang, Liam Paull, Bernhard Schölkopf

CoFrNets: Interpretable Neural Architecture Inspired by Continued Fractions

Isha Puri, Amit Dhurandhar, Tejaswini Pedapati, Karthikeyan Shanmugam, Dennis Wei

Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Data

Liming Jiang, Bo Dai, Wayne Wu, Chen Change Loy

PiRank: Scalable Learning To Rank via Differentiable Sorting

Robin Swezey, Aditya Grover, Bruno Charron, Stefano Ermon

Perceptual Score: What Data Modalities Does Your Model Perceive?

Itai Gat, Idan Schwartz, Alex Schwing

Rethinking Graph Transformers with Spectral Attention

Devin Kreuzer, Dominique Beaini, Will Hamilton, Vincent Létourneau, Prudencio Tossou

Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model

Antoine Bodin, Nicolas Macris

Generative vs. Discriminative: Rethinking The Meta-Continual Learning

Mohammadamin Banayeeanzade, Rasoul Mirzaiezadeh, Hosein Hasani, Mahdieh Soleymani

Last iterate convergence of SGD for Least-Squares in the Interpolation regime.

Aditya Vardhan Varre, Loucas Pillaud-Vivien, Nicolas Flammarion

Surrogate Regret Bounds for Polyhedral Losses

Rafael M. Frongillo, Bo Waggoner

NeRV: Neural Representations for Videos

Hao Chen, Bo He, Hanyu Wang, Yixuan Ren, Ser Nam Lim

On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay

Ekaterina Lobacheva, Maxim Kodryan, Nadezhda Chirkova, Andrey Malinin, Dmitry P Vetrov

Learning to Predict Trustworthiness with Steep Slope Loss

Yan Luo, Yongkang Wong, Mohan S Kankanhalli, Qi Zhao

A Surrogate Objective Framework for Prediction+Programming with Soft Constraints

Kai Yan, Jie Yan, Chuan Luo, Liting Chen, Qingwei Lin

SILG: The Multi-domain Symbolic Interactive Language Grounding Benchmark

Victor Zhong, Austin W. Hanjie, Sida Wang, Karthik Narasimhan, Luke Zettlemoyer

Learning Transferable Features for Point Cloud Detection via 3D Contrastive Co-training

Zeng Yihan, Chunwei Wang, Yunbo Wang, Hang Xu, Chaoqiang Ye

When does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?

Lijie Fan, Sijia Liu, Pin-Yu Chen, Gaoyuan Zhang, Chuang Gan

Improved Learning Rates of a Functional Lasso-type SVM with Sparse Multi-Kernel Representation

shaogao lv, Junhui Wang, Jiankun Liu, Yong Liu

A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphs

Runzhong Wang, Zhigang Hua, Gan Liu, Jiayi Zhang, Junchi Yan

Finite-Sample Analysis of Off-Policy TD-Learning via Generalized Bellman Operators

Zaiwei Chen, Siva Theja Maguluri, Sanjay Shakkottai, Karthikeyan Shanmugam

An online passive-aggressive algorithm for difference-of-squares classification

Lawrence K. Saul

End-to-end reconstruction meets data-driven regularization for inverse problems

Subhadip Mukherjee, Marcello Carioni, Ozan Öktem, Carola-Bibiane Schönlieb

Online Matching in Sparse Random Graphs: Non-Asymptotic Performances of Greedy Algorithm

Nathan Noiry, Vianney Perchet, Flore Sentenac

Amortized Variational Inference for Simple Hierarchical Models

Abhinav Agrawal, Justin Domke