NeurIPS 2024

4,493 papers

Deterministic Policies for Constrained Reinforcement Learning in Polynomial Time

Jeremy McMahan

AuctionNet: A Novel Benchmark for Decision-Making in Large-Scale Games

Kefan Su, Yusen Huo, Zhilin Zhang, Shuai Dou, Chuan Yu

GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI

Pengcheng Chen, Jin Ye, Guoan Wang, Yanjun Li, Zhongying Deng

Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers

Junhan Kim, Chungman Lee, Eulrang Cho, Kyungphil Park, Joonyoung Kim

Optimal and Approximate Adaptive Stochastic Quantization

Yaniv Ben-Itzhak, Michael Mitzenmacher, Shay Vargaftik, Ran Ben-Basat, Ran Ben Basat

Derandomizing Multi-Distribution Learning

Kasper Green Larsen, Omar Montasser, Nikita Zhivotovskiy

OxonFair: A Flexible Toolkit for Algorithmic Fairness

Eoin Delaney, Zihao Fu, Sandra Wachter, Brent Mittelstadt, Chris Russell

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes

Dan Qiao, Kaiqi Zhang, Esha Singh, Daniel Soudry, Yu-Xiang Wang

Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization

Ruichen Jiang, Ali Kavis, Qiujiang Jin, Sujay Sanghavi, Aryan Mokhtari

Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers

Markus Hiller, Krista A. Ehinger, Tom Drummond

Multi-Head Mixture-of-Experts

Xun Wu, Shaohan Huang, Wenhui Wang, Shuming Ma, Li Dong

Learning Frequency-Adapted Vision Foundation Model for Domain Generalized Semantic Segmentation

Qi Bi, Jingjun Yi, Hao Zheng, Haolan Zhan, Yawen Huang

Learning from Highly Sparse Spatio-temporal Data

Leyan Deng, Defu Lian, Chenwang Wu, Enhong Chen

Sequential Signal Mixing Aggregation for Message Passing Graph Neural Networks

Mitchell Keren Taraday, Almog David, Chaim Baskin

Unsupervised Modality Adaptation with Text-to-Image Diffusion Models for Semantic Segmentation

Ruihao Xia, Yu Liang, Hao Zhang, Bo Li, Yang Tang

NeuroGauss4D-PCI: 4D Neural Fields and Gaussian Deformation Fields for Point Cloud Interpolation

Chaokang Jiang, Dalong Du, Jiuming Liu, Siting Zhu, Zhenqiang Liu

Light Unbalanced Optimal Transport

Milena Gazdieva, Arip Asadulaev, Evgeny Burnaev, Alexander Korotin

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent

Liu Ziyin, Mingze Wang, Hongchao Li, Lei Wu

Constrained Diffusion with Trust Sampling

William Huang, Yifeng Jiang, Tom Van Wouwe, C. Karen Liu

MonkeySee: Space-time-resolved reconstructions of natural images from macaque multi-unit activity

Lynn Le, Paolo Papale, Katja Seeliger, Antonio Lozano, Thirza Dado

Accelerating Matroid Optimization through Fast Imprecise Oracles

Franziska Eberle, Felix Hommelsheim, Alexander Lindermayr, Zhenwei Liu, Nicole Megow

LiT: Unifying LiDAR "Languages" with LiDAR Translator

Yixing Lao, Tao Tang, Xiaoyang Wu, Peng Chen, Kaicheng Yu

Identifying Spatio-Temporal Drivers of Extreme Events

Mohamad Hakam Shams Eddin, Juergen Gall

SSA-Seg: Semantic and Spatial Adaptive Pixel-level Classifier for Semantic Segmentation

Xiaowen Ma, Zhenliang Ni, Xinghao Chen

Neural Collapse Inspired Feature Alignment for Out-of-Distribution Generalization

Zhikang Chen, Min Zhang, Sen Cui, Haoxuan Li, Gang Niu

Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers

Alberto Alfarano, Francois Charton, Amaury Hayat

Dynamic Conditional Optimal Transport through Simulation-Free Flows

Gavin Kerrigan, Giosue Migliorini, Padhraic Smyth

Offline Reinforcement Learning with OOD State Correction and OOD Action Suppression

Yixiu Mao, Qi Wang, Chen Chen, Yun Qu, Xiangyang Ji

Unifying Homophily and Heterophily for Spectral Graph Neural Networks via Triple Filter Ensembles

Rui Duan, Mingjian Guang, Junli Wang, Chungang Yan, Hongda Qi

Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers

Gavia Gray, Aman Tiwari, Shane Bergsma, Joel Hestness

Learning to Handle Complex Constraints for Vehicle Routing Problems

Jieyi Bi, Yining Ma, Jianan Zhou, Wen Song, Zhiguang Cao

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study

Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip H.S. Torr

Contrastive losses as generalized models of global epistasis

David H. Brookes, Jakub Otwinowski, Sam Sinai

Piecewise deterministic generative models

Andrea Bertazzi, Dario Shariatian, Umut Simsekli, Eric Moulines, Alain Durmus

Identifiable Object-Centric Representation Learning via Probabilistic Slot Attention

Avinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca Toni, Ben Glocker

When Your AIs Deceive You: Challenges of Partial Observability in Reinforcement Learning from Human Feedback

Leon Lang, Davis Foote, Stuart Russell, Anca Dragan, Erik Jenner

Boosting Weakly Supervised Referring Image Segmentation via Progressive Comprehension

Zaiquan Yang, Yuhao Liu, Jiaying Lin, Gerhard Hancke, Rynson W.H. Lau

SLowcalSGD : Slow Query Points Improve Local-SGD for Stochastic Convex Optimization

Tehila Dahan, Kfir Y. Levy

Batched Energy-Entropy acquisition for Bayesian Optimization

Felix Teufel, Carsten Stahlhut, Jesper Ferkinghoff-Borg

Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methods

Yihan Zhang, Marco Mondelli

Designing Cell-Type-Specific Promoter Sequences Using Conservative Model-Based Optimization

Aniketh Janardhan Reddy, XINYANG GENG, Michael H. Herschl, Sathvik Kolli, Aviral Kumar

Homology Consistency Constrained Efficient Tuning for Vision-Language Models

Huatian Zhang, Lei Zhang, Yongdong Zhang, Zhendong Mao

CALVIN: Improved Contextual Video Captioning via Instruction Tuning

Gowthami Somepalli, Arkabandhu Chowdhury, Ronen Basri, Jonas Geiping, Tom Goldstein

Understanding Model Selection for Learning in Strategic Environments

Tinashe Handina, Eric Mazumdar

InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniques

Rohan Gupta, Iván Arcuschin, Thomas Kwa, Adrià Garriga-Alonso

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models

Yuchen Ren, Zhiyuan Chen, Lifeng Qiao, Hongtai Jing, Yuchen Cai

Learning Equilibria in Adversarial Team Markov Games: A Nonconvex-Hidden-Concave Min-Max Optimization Problem

Fivos Kalogiannis, Jingming Yan, Ioannis Panageas

Improved Regret of Linear Ensemble Sampling

Harin Lee, Min-hwan Oh

CausalChaos! Dataset for Comprehensive Causal Action Question Answering Over Longer Causal Chains Grounded in Dynamic Visual Scenes

Paritosh Parmar, Eric Peh, Ruirui Chen, Ting En Lam, Yuhan Chen

Collaborative Refining for Learning from Inaccurate Labels

Bin Han, Yi-Xuan Sun, Ya-Lin Zhang, Libang Zhang, Haoran Hu

When Is Inductive Inference Possible?

Zhou Lu

Rethinking the Membrane Dynamics and Optimization Objectives of Spiking Neural Networks

Hangchi Shen, Qian Zheng, Huamin Wang, Gang Pan

In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness

Liam Collins, Advait Parulekar, Aryan Mokhtari, Sujay Sanghavi, Sanjay Shakkottai

Reasoning Multi-Agent Behavioral Topology for Interactive Autonomous Driving

Haochen Liu, Li Chen, Yu Qiao, Chen Lv, Hongyang Li

DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization

Haowei Zhu, Dehua Tang, Ji Liu, Mingjie Lu, Jintu Zheng

MECD: Unlocking Multi-Event Causal Discovery in Video Reasoning

Tieyuan Chen, Huabin Liu, Tianyao He, Yihang Chen, Chaofan Gan

One-Step Effective Diffusion Network for Real-World Image Super-Resolution

Rongyuan Wu, Lingchen Sun, Zhiyuan Ma, Lei Zhang

GeSS: Benchmarking Geometric Deep Learning under Scientific Applications with Distribution Shifts

Deyu Zou, Shikun Liu, Siqi Miao, Victor Fung, Shiyu Chang

Spectral-Risk Safe Reinforcement Learning with Convergence Guarantees

Dohyeong Kim, Taehyun Cho, Seungyub Han, Hojun Chung, Kyungjae Lee

ConStat: Performance-Based Contamination Detection in Large Language Models

Jasper Dekoninck, Mark Niklas Müller, Martin Vechev

QGym: Scalable Simulation and Benchmarking of Queuing Network Controllers

Haozhe Chen, Ang Li, Ethan Che, Tianyi Peng, Jing Dong

Infinite-Dimensional Feature Interaction

Chenhui Xu, Fuxun Yu, Maoliang Li, Zihao Zheng, Zirui Xu

Optimized Feature Generation for Tabular Data via LLMs with Decision Tree Reasoning

Jaehyun Nam, Kyuyoung Kim, Seunghyuk Oh, Jihoon Tack, Jaehyung Kim

Unraveling the Gradient Descent Dynamics of Transformers

Bingqing Song, Boran Han, SHUAI ZHANG, Jie Ding, Mingyi Hong

Intrinsic Self-Supervision for Data Quality Audits

Fabian Gröger, Simone Lionetti, Philippe Gottfrois, Alvaro Gonzalez-Jimenez, Ludovic Amruthalingam

Abstracted Shapes as Tokens - A Generalizable and Interpretable Model for Time-series Classification

Yunshi Wen, Tengfei Ma, Tsui-Wei Weng, Lam M. Nguyen, Anak Agung Julius

QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation

Zhuo Chen, Rumen Dangovski, Charlotte Loh, Owen Dugan, Di Luo

OccFusion: Rendering Occluded Humans with Generative Diffusion Priors

Adam Sun, Tiange Xiang, Scott Delp, Li Fei-fei, Ehsan Adeli

Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning

Pouya M. Ghari, Yanning Shen

On the Effects of Data Scale on UI Control Agents

Wei Li, William Bishop, Alice Li, Chris Rawles, Folawiyo Campbell-Ajala

Second-order forward-mode optimization of recurrent neural networks for neuroscience

Youjing Yu, Rui Xia, Qingxi Ma, Máté Lengyel, Guillaume Hennequin

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration

Zhuofan Wen, Shangtong Gui, Yang Feng

Recovering Complete Actions for Cross-dataset Skeleton Action Recognition

Hanchao Liu, Yujiang Li, Tai-Jiang Mu, Shi-min Hu

Physics-Constrained Comprehensive Optical Neural Networks

Yanbing Liu, Jianwei Qin, Yan Liu, Xi Yue, Xun Liu

Mitigating Object Hallucination via Concentric Causal Attention

Yun Xing, Yiheng Li, Ivan Laptev, Shijian Lu

Variance estimation in compound decision theory under boundedness

Subhodh Kotekal

COSMIC: Compress Satellite Image Efficiently via Diffusion Compensation

Ziyuan Zhang, Han Qiu, Maosen Zhang, Jun Liu, Bin Chen

FEEL-SNN: Robust Spiking Neural Networks with Frequency Encoding and Evolutionary Leak Factor

Mengting Xu, De Ma, Huajin Tang, Qian Zheng, Gang Pan

Improved Analysis for Bandit Learning in Matching Markets

Fang Kong, Zilong Wang, Shuai Li

Extending Multi-modal Contrastive Representations

Ziang Zhang, Zehan Wang, Luping Liu, Rongjie Huang, Xize Cheng

A Kernel Perspective on Distillation-based Collaborative Learning

Sejun Park, Kihun Hong, Ganguk Hwang

Multi-scale Consistency for Robust 3D Registration via Hierarchical Sinkhorn Tree

Chengwei Ren, Yifan Feng, Weixiang Zhang, Xiao-Ping Zhang, Yue Gao

Markov Equivalence and Consistency in Differentiable Structure Learning

Chang Deng, Kevin Bello, Pradeep Ravikumar, Bryon Aragam

Noisy Dual Mirror Descent: A Near Optimal Algorithm for Jointly-DP Convex Resource Allocation

Du Chen, Geoffrey A. Chua

Efficient Contextual LLM Cascades through Budget-Constrained Policy Learning

Xuechen Zhang, Zijian Huang, Ege Onur Taga, Carlee Joe-Wong, Samet Oymak

BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text

Siyan Wang, Bradford Levy

Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale

Tianyue Ou, Frank F. Xu, Aman Madaan, Jiarui Liu, Robert Lo

Your contrastive learning problem is secretly a distribution alignment problem

Zihao Chen, Chi-Heng Lin, Ran Liu, Jingyun Xiao, Eva L. Dyer

Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability

Shenyuan Gao, Jiazhi Yang, Li Chen, Kashyap Chitta, Yihang Qiu

DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis

Shangshang Yang, Mingyang Chen, Ziwen Wang, Xiaoshan Yu, Panpan Zhang

Universal Exact Compression of Differentially Private Mechanisms

Yanxiao Liu, Wei-Ning Chen, Ayfer Ozgur, Cheuk Ting Li

Post-Hoc Reversal: Are We Selecting Models Prematurely?

Rishabh Ranjan, Saurabh Garg, Mrigank Raman, Carlos Guestrin, Zachary Lipton

Multilingual Diversity Improves Vision-Language Representations

Thao Nguyen, Matthew Wallingford, Sebastin Santy, Wei-Chiu Ma, Sewoong Oh

DTGB: A Comprehensive Benchmark for Dynamic Text-Attributed Graphs

Jiasheng Zhang, Jialin Chen, Menglin Yang, Aosong Feng, Shuang Liang

NN4SysBench: Characterizing Neural Network Verification for Computer Systems

Shuyi Lin, Haoyu He, Tianhao Wei, Kaidi Xu, Huan Zhang

emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography

Viswanath Sivakumar, Jeffrey Seely, Alan Du, Sean R Bittner, Adam Berenzweig

How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective

Qiaozhe Zhang, Ruijie Zhang, Jun Sun, Yingzhuang Liu

How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks

Etai Littwin, Omid Saremi, Madhu Advani, Vimal Thilak, Preetum Nakkiran

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore

Rulin Shao, Jacqueline He, Akari Asai, Weijia Shi, Tim Dettmers

Learning Structured Representations with Hyperbolic Embeddings

Aditya Sinha, Siqi Zeng, Makoto Yamada, Han Zhao