NeurIPS 2024

4,493 papers

B-ary Tree Push-Pull Method is Provably Efficient for Distributed Learning on Heterogeneous Data

Runze You, Shi Pu

Harmonizing Visual Text Comprehension and Generation

Zhen Zhao, Jingqun Tang, Binghong Wu, Chunhui Lin, Shu Wei

Learn more, but bother less: parameter efficient continual learning

Fuli Qiao, Mehrdad Mahdavi

GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modeling

Bowen Zhang, Yiji Cheng, Jiaolong Yang, CHUNYU WANG, Feng Zhao

Divide-and-Conquer Posterior Sampling for Denoising Diffusion priors

Yazid Janati, Badr MOUFAD, Alain Durmus, Eric Moulines, Jimmy Olsson

Evaluating language models as risk scores

André F. Cruz, Moritz Hardt, Celestine Mendler-Dünner

MC-DiT: Contextual Enhancement via Clean-to-Clean Reconstruction for Masked Diffusion Models

Guanghao Zheng, Yuchen Liu, Wenrui Dai, Chenglin Li, Junni Zou

Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesis

Rui Peng, Wangze Xu, Luyang Tang, Liwei Liao, Jianbo Jiao

Mini-Sequence Transformers: Optimizing Intermediate Memory for Long Sequences Training

Cheng Luo, Jiawei Zhao, Zhuoming Chen, Beidi Chen, Anima Anandkumar

Noisy Label Learning with Instance-Dependent Outliers: Identifiability via Crowd Wisdom

Tri Nguyen, Shahana Ibrahim, Xiao Fu

Unravelling in Collaborative Learning

Aymeric Capitaine, Etienne Boursier, Antoine Scheid, Eric Moulines, Michael I. Jordan

Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning

Qi Wang, Junming Yang, Yunbo Wang, Xin Jin, Wenjun Zeng

SfPUEL: Shape from Polarization under Unknown Environment Light

Youwei Lyu, Heng Guo, Kailong Zhang, Si Li, Boxin Shi

ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling

Francesca Babiloni, Alexandros Lattas, Jiankang Deng, Stefanos Zafeiriou

MeshXL: Neural Coordinate Field for Generative 3D Foundation Models

Sijin Chen, Xin Chen, Anqi Pang, Xianfang Zeng, Wei Cheng

A Simple yet Scalable Granger Causal Structural Learning Approach for Topological Event Sequences

Mingjia Li, Shuo Liu, Hong Qian, Aimin Zhou

Approximately Equivariant Neural Processes

Matthew Ashman, Cristiana Diaconu, Adrian Weller, Wessel Bruinsma, Richard E Turner

Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans

Jen-tse Huang, Man Ho Lam, Eric John Li, Shujie Ren, Wenxuan Wang

Rethinking Deep Thinking: Stable Learning of Algorithms using Lipschitz Constraints

Jay Bear, Adam Prugel-Bennett, Jonathon Hare

RectifID: Personalizing Rectified Flow with Anchored Classifier Guidance

Zhicheng Sun, Zhenhao Yang, Yang Jin, Haozhe Chi, Kun Xu

RealCompo: Balancing Realism and Compositionality Improves Text-to-Image Diffusion Models

Xinchen Zhang, Ling Yang, Yaqi Cai, Zhaochen Yu, Kai-Ni Wang

NeuralPlane: An Efficiently Parallelizable Platform for Fixed-wing Aircraft Control with Reinforcement Learning

Chuanyi Xue, Qihan Liu, Xiaoteng Ma, Yang Qi, Xinyao Qin

SHDocs: A dataset, benchmark, and method to efficiently generate high-quality, real-world specular highlight data with near-perfect alignment

Jovin Leong, Ming Di Koa, Benjamin Cham, Shaun Heng

Trading Place for Space: Increasing Location Resolution Reduces Contextual Capacity in Hippocampal Codes

Spencer Rooke, Zhaoze Wang, Ronald W. Di Tullio, Vijay Balasubramanian

Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models

Daniela de Albuquerque, John Pearson

StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving

Chang Gao, Haiyun Jiang, Deng Cai, Shuming Shi, Wai Lam

Latent Intrinsics Emerge from Training to Relight

Xiao Zhang, William Gao, Seemandhar Jain, Michael Maire, D.A. Forsyth

The Power of Hard Attention Transformers on Data Sequences: A formal language theoretic perspective

Pascal Bergsträßer, Chris Köcher, Anthony Widjaja Lin, Georg Zetzsche

Lightweight Frequency Masker for Cross-Domain Few-Shot Semantic Segmentation

Jintao Tong, Yixiong Zou, Yuhua Li, Ruixuan Li

Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods

Felix Dangel

Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?

Haoang Chi, He Li, Wenjing Yang, Feng Liu, Long Lan

FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing

Jitesh Joshi, Sos S. Agaian, Youngjun Cho

Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks

Dmitry Kovalev, Ekaterina Borodich, Alexander Gasnikov, Dmitrii Feoktistov

COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing

Jiangshan Wang, Yue Ma, Jiayi Guo, Yicheng Xiao, Gao Huang

Brain Treebank: Large-scale intracranial recordings from naturalistic language stimuli

Christopher Wang, Adam Yaari, Aaditya K Singh, Vighnesh Subramaniam, Dana Rosenfarb

Classification Done Right for Vision-Language Pre-Training

Zilong Huang, Qinghao Ye, Bingyi Kang, Jiashi Feng, haoqi fan

LucidAction: A Hierarchical and Multi-model Dataset for Comprehensive Action Quality Assessment

Linfeng Dong, Wei Wang, Yu Qiao, Xiao Sun

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren

Text-Guided Attention is All You Need for Zero-Shot Robustness in Vision-Language Models

Lu Yu, Haiyang Zhang, Changsheng Xu

UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models

Yihua Zhang, Chongyu Fan, Yimeng Zhang, Yuguang Yao, Jinghan Jia

Improved Generation of Adversarial Examples Against Safety-aligned LLMs

Qizhang Li, Yiwen Guo, Wangmeng Zuo, Hao Chen

Data-Driven Discovery of Dynamical Systems in Pharmacology using Large Language Models

Samuel Holt, Zhaozhi Qian, Tennison Liu, James Weatherall, Mihaela van der Schaar

Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks

Victor Boutin, Rishav Mukherji, Aditya Agrawal, Sabine Muzellec, Thomas FEL

Nearly Minimax Optimal Submodular Maximization with Bandit Feedback

Artin Tajdini, Lalit Jain, Kevin Jamieson

PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understanding

Jincen Jiang, Qianyu Zhou, Yuhang Li, Xinkui Zhao, Meili Wang

A distributional simplicity bias in the learning dynamics of transformers

Riccardo Rende, Federica Gerace, Alessandro Laio, Sebastian Goldt

DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videos

Wen-Hsuan Chu, Lei Ke, Katerina Fragkiadaki

Fast Encoder-Based 3D from Casual Videos via Point Track Processing

Yoni Kasten, Wuyue Lu, Haggai Maron

ImageNet3D: Towards General-Purpose Object-Level 3D Understanding

Wufei Ma, Guofeng Zhang, Qihao Liu, Guanning Zeng, Adam Kortylewski

Identify Then Recommend: Towards Unsupervised Group Recommendation

Yue Liu, Shihao Zhu, Tianyuan Yang, Jian Ma, Wenliang Zhong

Faster Algorithms for User-Level Private Stochastic Convex Optimization

Andrew Lowy, Daogao Liu, Hilal Asi

Contrastive-Equivariant Self-Supervised Learning Improves Alignment with Primate Visual Area IT

Thomas Yerxa, Jenelle Feather, Eero P. Simoncelli, SueYeon Chung

Achieving Linear Convergence with Parameter-Free Algorithms in Decentralized Optimization

Ilya Kuruzov, Gesualdo Scutari, Alexander Gasnikov

MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations

Yubo Ma, Yuhang Zang, Liangyu Chen, Meiqi Chen, Yizhu Jiao

Rethinking Reconstruction-based Graph-Level Anomaly Detection: Limitations and a Simple Remedy

Sunwoo Kim, Soo Yong Lee, Fanchen Bu, Shinhwan Kang, Kyungho Kim

A Data-Centric Perspective on Evaluating Machine Learning Models for Tabular Data

Andrej Tschalzev, Sascha Marton, Stefan Lüdtke, Christian Bartelt, Heiner Stuckenschmidt

Improving Neural ODE Training with Temporal Adaptive Batch Normalization

Su Zheng, Zhengqi Gao, Fan-Keng Sun, Duane S. Boning, Bei Yu

Randomized algorithms and PAC bounds for inverse reinforcement learning in continuous spaces

Angeliki Kamoutsi, Peter Schmitt-Förster, Tobias Sutter, Volkan Cevher, John Lygeros

MultiOrg: A Multi-rater Organoid-detection Dataset

Christina Bukas, Harshavardhan Subramanian, Fenja See, Carina Steinchen, Ivan Ezhov

ContextCite: Attributing Model Generation to Context

Benjamin Cohen-Wang, Harshay Shah, Kristian Georgiev, Aleksander Madry

Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices

Zhihao Shu, Xiaowei Yu, Zihao Wu, Wenqi Jia, Yinchen Shi

FinBen: A Holistic Financial Benchmark for Large Language Models

Qianqian Xie, Weiguang Han, Zhengyu Chen, Ruoyu Xiang, Xiao Zhang

Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models

Sheng Yun Peng, Pin-Yu Chen, Matthew Hull, Duen Horng Chau

Graph neural networks and non-commuting operators

Mauricio Velasco, Kaiying O'Hare, Bernardo Rychtenberg, Soledad Villar

Optimistic Verifiable Training by Controlling Hardware Nondeterminism

Megha Srivastava, Simran Arora, Dan Boneh

Shape analysis for time series

Thibaut Germain, Samuel Gruffaz, Charles Truong, Laurent Oudre, Alain Durmus

Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization

Junlin He, Jinxiao Du, Wei Ma

Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inference

Xunpeng Huang, Difan Zou, Hanze Dong, Yi Zhang, Yian Ma

Computerized Adaptive Testing via Collaborative Ranking

Zirui Liu, Yan Zhuang, Qi Liu, Jiatong Li, Yuren Zhang

Diffusion-Reward Adversarial Imitation Learning

Chun-Mao Lai, Hsiang-Chun Wang, Ping-Chun Hsieh, Yu-Chiang Frank Wang, Min-Hung Chen

On the Use of Anchoring for Training Vision Models

Vivek Narayanaswamy, Kowshik Thopalli, Rushil Anirudh, Yamen Mubarka, Wesam Sakla

ProG: A Graph Prompt Learning Benchmark

Chenyi Zi, Haihong Zhao, Xiangguo Sun, Yiqing Lin, Hong Cheng

Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads

Avelina Asada Hadji-Kyriacou, Ognjen Arandjelovic

Nonstationary Sparse Spectral Permanental Process

Zicheng Sun, YIXUAN ZHANG, Zenan Ling, Xuhui Fan, Feng Zhou

Safe Time-Varying Optimization based on Gaussian Processes with Spatio-Temporal Kernel

Jialin Li, Marta Zagorowska, Giulia De Pasquale, Alisa Rupenyan, John Lygeros

Effective Exploration Based on the Structural Information Principles

Xianghua Zeng, Hao Peng, Angsheng Li

MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra

Grokking of Implicit Reasoning in Transformers: A Mechanistic Journey to the Edge of Generalization

Boshi Wang, Xiang Yue, Yu Su, Huan Sun

SyncTweedies: A General Generative Framework Based on Synchronized Diffusions

Jaihoon Kim, Juil Koo, Kyeongmin Yeo, Minhyuk Sung

AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising

Zigeng Chen, Xinyin Ma, Gongfan Fang, Zhenxiong Tan, Xinchao Wang

Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset

Ke Wang, Junting Pan, Weikang Shi, Zimu Lu, Houxing Ren

Excluding the Irrelevant: Focusing Reinforcement Learning through Continuous Action Masking

Roland Stolz, Hanna Krasowski, Jakob Thumm, Michael Eichelbeck, Philipp Gassert

A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints

Liuyuan Jiang, Quan Xiao, Victor M. Tenorio, Fernando Real-Rojas, Antonio G. Marques

RandNet-Parareal: a time-parallel PDE solver using Random Neural Networks

Guglielmo Gattiglio, Lyudmila Grigoryeva, Massimiliano Tamborrino

From Chaos to Clarity: 3DGS in the Dark

Zhihao Li, Yufei Wang, Alex Kot, Bihan Wen

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

Alliot Nagle, Adway Girish, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva

Adam with model exponential moving average is effective for nonconvex optimization

Kwangjun Ahn, Ashok Cutkosky

SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation

Zeyao Ma, Bohan Zhang, Jing Zhang, Jifan Yu, Xiaokang Zhang

Stepping Forward on the Last Mile

Chen Feng, Shaojie Zhuo, XIAOPENG ZHANG, Ramchalam Kinattinkara Ramakrishnan, Zhaocong Yuan

Online Composite Optimization Between Stochastic and Adversarial Environments

Yibo Wang, Sijia Chen, Wei Jiang, Wenhao Yang, Yuanyu Wan

Soft-Label Integration for Robust Toxicity Classification

Zelei Cheng, Xian Wu, Jiahao Yu, Shuo Han, Xin-Qiang Cai

Is Cross-validation the Gold Standard to Estimate Out-of-sample Model Performance?

Garud Iyengar, Henry Lam, Tianyu Wang

A Nearly Optimal and Low-Switching Algorithm for Reinforcement Learning with General Function Approximation

Heyang Zhao, Jiafan He, Quanquan Gu

Pre-training Differentially Private Models with Limited Public Data

Zhiqi Bu, Xinwei Zhang, Sheng Zha, Mingyi Hong, George Karypis

Accelerating Augmentation Invariance Pretraining

Jinhong Lin, Cheng-En Wu, Yibing Wei, Pedro Morgado

Test-time Adaptation in Non-stationary Environments via Adaptive Representation Alignment

Zhiyu Xie, Huaxiu Yao, Masashi Sugiyama, Zhenyu Zhang, Zhen-Yu Zhang

Temporal Graph Neural Tangent Kernel with Graphon-Guaranteed

Katherine Tieu, Dongqi Fu, Yada Zhu, Hendrik Hamann, Jingrui He

Hypothesis Testing the Circuit Hypothesis in LLMs

Claudia Shi, Nicolas Beltran-Velez, Achille Nazaret, Carolina Zheng, Adrià Garriga-Alonso

Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting

Qingxiang Liu, Xu Liu, Chenghao Liu, Qingsong Wen, Yuxuan Liang

Improving Subgroup Robustness via Data Selection

Saachi Jain, Kimia Hamidieh, Kristian Georgiev, Andrew Ilyas, Marzyeh Ghassemi