ICLR 2023

1,573 papers

Guiding Safe Exploration with Weakest Preconditions

Greg Anderson, Swarat Chaudhuri, Isil Dillig

Weighted Ensemble Self-Supervised Learning

Yangjun Ruan, Saurabh Singh, Warren Richard Morningstar, Alexander A Alemi, Sergey Ioffe

simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracing

Zitao Liu, Qiongqiong Liu, Jiahao Chen, Shuyan Huang, Weiqi Luo

Partial Label Unsupervised Domain Adaptation with Class-Prototype Alignment

Yan Yan, Yuhong Guo

Mutual Partial Label Learning with Competitive Label Noise

Yan Yan, Yuhong Guo

Faster federated optimization under second-order similarity

Ahmed Khaled, Chi Jin

DCI-ES: An Extended Disentanglement Framework with Connections to Identifiability

Cian Eastwood, Andrei Liviu Nicolicioiu, Julius von Kügelgen, Armin Kekić, Frederik Träuble

Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic

Zijun Wu, Zi Xuan Zhang, Atharva Naik, Zhijian Mei, Mauajama Firdaus

Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions

Jeremy Ocampo, Matthew Alexander Price, Jason McEwen

Diffusion Models for Causal Discovery via Topological Ordering

Pedro Sanchez, Xiao Liu, Alison Q O'Neil, Sotirios A. Tsaftaris

Deconstructing Distributions: A Pointwise Framework of Learning

Gal Kaplun, Nikhil Ghosh, Saurabh Garg, Boaz Barak, Preetum Nakkiran

Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning

Zehao Niu, Mihai Anitescu, Jie Chen

Meta Temporal Point Processes

Wonho Bae, Mohamed Osama Ahmed, Frederick Tung, Gabriel L. Oliveira

Neural DAG Scheduling via One-Shot Priority Sampling

Wonseok Jeon, Mukul Gagrani, Burak Bartan, Weiliang Will Zeng, Harris Teague

Direct Embedding of Temporal Network Edges via Time-Decayed Line Graphs

Sudhanshu Chanpuriya, Ryan A. Rossi, Sungchul Kim, Tong Yu, Jane Hoffswell

Provably Auditing Ordinary Least Squares in Low Dimensions

Ankur Moitra, Dhruv Rohatgi

Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions

Daniel D. Johnson, Ayoub El Hanchi, Chris J. Maddison

A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity

Hongkang Li, Meng Wang, Sijia Liu, Pin-Yu Chen

Distributed Differential Privacy in Multi-Armed Bandits

Sayak Ray Chowdhury, Xingyu Zhou

Link Prediction with Non-Contrastive Learning

William Shiao, Zhichun Guo, Tong Zhao, Evangelos E. Papalexakis, Yozen Liu

Provably Efficient Lifelong Reinforcement Learning with Linear Representation

Sanae Amani, Lin Yang, Ching-An Cheng

Re-Imagen: Retrieval-Augmented Text-to-Image Generator

Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen

Improved Sample Complexity for Reward-free Reinforcement Learning under Low-rank MDPs

Yuan Cheng, Ruiquan Huang, Yingbin Liang, Jing Yang

Sequential Attention for Feature Selection

Taisuke Yasuda, Mohammadhossein Bateni, Lin Chen, Matthew Fahrbach, Gang Fu

Disentangling the Mechanisms Behind Implicit Regularization in SGD

Zachary Novack, Simran Kaur, Tanya Marwah, Saurabh Garg, Zachary Chase Lipton

Certifiably Robust Policy Learning against Adversarial Multi-Agent Communication

Yanchao Sun, Ruijie Zheng, Parisa Hassanzadeh, Yongyuan Liang, Soheil Feizi

SoftMatch: Addressing the Quantity-Quality Tradeoff in Semi-supervised Learning

Hao Chen, Ran Tao, Yue Fan, Yidong Wang, Jindong Wang

On Accelerated Perceptrons and Beyond

Guanghui Wang, Rafael Hanashiro, Etash Kumar Guha, Jacob Abernethy

Spectral Decomposition Representation for Reinforcement Learning

Tongzheng Ren, Tianjun Zhang, Lisa Lee, Joseph E. Gonzalez, Dale Schuurmans

Confidence Estimation Using Unlabeled Data

Chen Li, Xiaoling Hu, Chao Chen

FreeMatch: Self-adaptive Thresholding for Semi-supervised Learning

Yidong Wang, Hao Chen, Qiang Heng, Wenxin Hou, Yue Fan

Words are all you need? Language as an approximation for human similarity judgments

Raja Marjieh, Pol van Rijn, Ilia Sucholutsky, Theodore Sumers, Harin Lee

ROCO: A General Framework for Evaluating Robustness of Combinatorial Optimization Solvers on Graphs

Han Lu, Zenan Li, Runzhong Wang, Qibing Ren, Xijun Li

Latent Variable Representation for Reinforcement Learning

Tongzheng Ren, Chenjun Xiao, Tianjun Zhang, Na Li, Zhaoran Wang

Federated Nearest Neighbor Machine Translation

Yichao Du, Zhirui Zhang, Bingzhe Wu, Lemao Liu, Tong Xu

Moderate Coreset: A Universal Method of Data Selection for Real-world Data-efficient Deep Learning

Xiaobo Xia, Jiale Liu, Jun Yu, Xu Shen, Bo Han

Machine Unlearning of Federated Clusters

Chao Pan, Jin Sima, Saurav Prakash, Vishal Rana, Olgica Milenkovic

An efficient encoder-decoder architecture with top-down attention for speech separation

Kai Li, Runxuan Yang, Xiaolin Hu

Automatic Chain of Thought Prompting in Large Language Models

Zhuosheng Zhang, Aston Zhang, Mu Li, Alex Smola

LipsFormer: Introducing Lipschitz Continuity to Vision Transformers

Xianbiao Qi, Jianan Wang, Yihao Chen, Yukai Shi, Lei Zhang

Graph Signal Sampling for Inductive One-Bit Matrix Completion: a Closed-form Solution

Chao Chen, Haoyu Geng, Gang Zeng, Zhaobing Han, Hua Chai

Learning Kernelized Contextual Bandits in a Distributed and Asynchronous Environment

Chuanhao Li, Huazheng Wang, Mengdi Wang, Hongning Wang

Towards Better Selective Classification

Leo Feng, Mohamed Osama Ahmed, Hossein Hajimirsadeghi, Amir H. Abdi

Represent to Control Partially Observed Systems: Representation Learning with Provable Sample Efficiency

Lingxiao Wang, Qi Cai, Zhuoran Yang, Zhaoran Wang

Latent Bottlenecked Attentive Neural Processes

Leo Feng, Hossein Hajimirsadeghi, Yoshua Bengio, Mohamed Osama Ahmed

Language Models Can Teach Themselves to Program Better

Patrick Haluptzok, Matthew Bowers, Adam Tauman Kalai

Fairness and Accuracy under Domain Generalization

Thai-Hoang Pham, Xueru Zhang, Ping Zhang

An Adaptive Policy to Employ Sharpness-Aware Minimization

Weisen Jiang, Hansi Yang, Yu Zhang, James Kwok

On the Soft-Subnetwork for Few-Shot Class Incremental Learning

Haeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid, Sung Ju Hwang, Chang D. Yoo

CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos

Hao-Wen Dong, Naoya Takahashi, Yuki Mitsufuji, Julian McAuley, Taylor Berg-Kirkpatrick

Offline RL for Natural Language Generation with Implicit Language Q Learning

Charlie Victor Snell, Ilya Kostrikov, Yi Su, Sherry Yang, Sergey Levine

Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning

Chongjian GE, Jiangliu Wang, Zhan Tong, Shoufa Chen, Yibing Song

Explaining Temporal Graph Models through an Explorer-Navigator Framework

Wenwen Xia, Mincai Lai, Caihua Shan, Yao Zhang, Xinnan Dai

Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learning

Hyunwoo Ryu, Hong-in Lee, Jeong-Hoon Lee, Jongeun Choi

Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 Small

Kevin Ro Wang, Alexandre Variengien, Arthur Conmy, Buck Shlegeris, Jacob Steinhardt

3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation

Ho Hin Lee, Shunxing Bao, Yuankai Huo, Bennett A. Landman

M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation

Junjie Yang, Xuxi Chen, Tianlong Chen, Zhangyang Wang, Yingbin Liang

Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning

Yuandong Tian

PD-MORL: Preference-Driven Multi-Objective Reinforcement Learning Algorithm

Toygun Basaklar, Suat Gumussoy, Umit Ogras

MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrations

Nicklas Hansen, Yixin Lin, Hao Su, Xiaolong Wang, Vikash Kumar

Causal Estimation for Text Data with (Apparent) Overlap Violations

Lin Gui, Victor Veitch

GLM-130B: An Open Bilingual Pre-trained Model

Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai

Multi-level Protein Structure Pre-training via Prompt Learning

Zeyuan Wang, Qiang Zhang, Shuang-Wei HU, Haoran Yu, Xurui Jin

Label-free Concept Bottleneck Models

Tuomas Oikarinen, Subhro Das, Lam M. Nguyen, Tsui-Wei Weng

Learning to Extrapolate: A Transductive Approach

Aviv Netanyahu, Abhishek Gupta, Max Simchowitz, Kaiqing Zhang, Pulkit Agrawal

Spacetime Representation Learning

Marc T. Law, James Lucas

Memorization-Dilation: Modeling Neural Collapse Under Noise

Duc Anh Nguyen, Ron Levie, Julian Lienen, Eyke Hüllermeier, Gitta Kutyniok

Calibration Matters: Tackling Maximization Bias in Large-scale Advertising Recommendation Systems

Yewen Fan, Nian Si, Kun Zhang

Understanding Embodied Reference with Touch-Line Transformer

Yang Li, Xiaoxue Chen, Hao Zhao, Jiangtao Gong, Guyue Zhou

Scaling Forward Gradient With Local Losses

Mengye Ren, Simon Kornblith, Renjie Liao, Geoffrey Hinton

Free Lunch for Domain Adversarial Training: Environment Label Smoothing

Yifan Zhang, xue wang, Jian Liang, Zhang Zhang, Liang Wang

On Compositional Uncertainty Quantification for Seq2seq Graph Parsing

Zi Lin, Du Phan, Panupong Pasupat, Jeremiah Zhe Liu, Jingbo Shang

Imbalanced Semi-supervised Learning with Bias Adaptive Classifier

Renzhen Wang, Xixi Jia, Quanziang Wang, Yichen WU, Deyu Meng

Equivariant Shape-Conditioned Generation of 3D Molecules for Ligand-Based Drug Design

Keir Adams, Connor W. Coley

Any-scale Balanced Samplers for Discrete Space

Haoran Sun, Bo Dai, Charles Sutton, Dale Schuurmans, Hanjun Dai

Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networks

Bowen Jin, Yu Zhang, Yu Meng, Jiawei Han

More Centralized Training, Still Decentralized Execution: Multi-Agent Conditional Policy Factorization

Jiangxing Wang, Deheng Ye, Zongqing Lu

Preference Transformer: Modeling Human Preferences using Transformers for RL

Changyeon Kim, Jongjin Park, Jinwoo Shin, Honglak Lee, Pieter Abbeel

Winning Both the Accuracy of Floating Point Activation and the Simplicity of Integer Arithmetic

Yulhwa Kim, Jaeyong Jang, Jehun Lee, Jihoon Park, Jeonghoon Kim

Task Ambiguity in Humans and Language Models

Alex Tamkin, Kunal Handa, Avash Shrestha, Noah Goodman

Long-Tailed Partial Label Learning via Dynamic Rebalancing

Feng Hong, Jiangchao Yao, Zhihan Zhou, Ya Zhang, Yanfeng Wang

The hidden uniform cluster prior in self-supervised learning

Mido Assran, Randall Balestriero, Quentin Duval, Florian Bordes, Ishan Misra

An Equal-Size Hard EM Algorithm for Diverse Dialogue Generation

Yuqiao Wen, Yongchang Hao, Yanshuai Cao, Lili Mou

Near-Optimal Deployment Efficiency in Reward-Free Reinforcement Learning with Linear Function Approximation

Dan Qiao, Yu-Xiang Wang

Asymptotic Instance-Optimal Algorithms for Interactive Decision Making

Kefan Dong, Tengyu Ma

Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence

Margalit Glasgow, Colin Wei, Mary Wootters, Tengyu Ma

Pushing the Accuracy-Group Robustness Frontier with Introspective Self-play

Jeremiah Zhe Liu, Krishnamurthy Dj Dvijotham, Jihyeon Lee, Quan Yuan, Balaji Lakshminarayanan

Squeeze Training for Adversarial Robustness

Qizhang Li, Yiwen Guo, Wangmeng Zuo, Hao Chen

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

Pengcheng He, Jianfeng Gao, Weizhu Chen

On The Relative Error of Random Fourier Features for Preserving Kernel Distance

Kuan Cheng, Shaofeng H.-C. Jiang, Luojian Wei, Zhide Wei

Population-size-Aware Policy Optimization for Mean-Field Games

Pengdeng Li, Xinrun Wang, Shuxin Li, Hau Chan, Bo An

What Do Self-Supervised Vision Transformers Learn?

Namuk Park, Wonjae Kim, Byeongho Heo, Taekyung Kim, Sangdoo Yun

Mind's Eye: Grounded Language Model Reasoning through Simulation

Ruibo Liu, Jason Wei, Shixiang Shane Gu, Te-Yen Wu, Soroush Vosoughi

Budgeted Training for Vision Transformer

Zhuofan Xia, Xuran Pan, Xuan Jin, Yuan He, Hui Xue'

When Data Geometry Meets Deep Function: Generalizing Offline Reinforcement Learning

Jianxiong Li, Xianyuan Zhan, Haoran Xu, Xiangyu Zhu, Jingjing Liu

Incremental Learning of Structured Memory via Closed-Loop Transcription

Shengbang Tong, xili dai, Ziyang Wu, Mingyang Li, Brent Yi

Visually-Augmented Language Modeling

Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu

Unsupervised 3D Object Learning through Neuron Activity aware Plasticity

Beomseok Kang, Biswadeep Chakraborty, Saibal Mukhopadhyay

Complexity-Based Prompting for Multi-step Reasoning

Yao Fu, Hao Peng, Ashish Sabharwal, Peter Clark, Tushar Khot

Valid P-Value for Deep Learning-driven Salient Region

Miwa Daiki, Vo Nguyen Le Duy, Ichiro Takeuchi