NeurIPS 2024

4,493 papers

A Label is Worth A Thousand Images in Dataset Distillation

Tian Qin, Zhiwei Deng, David Alvarez-Melis

Neglected Hessian component explains mysteries in sharpness regularization

Yann N. Dauphin, Atish Agarwala, Hossein Mobahi

Energy-based Hopfield Boosting for Out-of-Distribution Detection

Claus Hofmann, Simon Schmid, Bernhard Lehner, Daniel Klotz, Sepp Hochreiter

Using Noise to Infer Aspects of Simplicity Without Learning

Zachery Boner, Harry Chen, Lesia Semenova, Ronald Parr, Cynthia Rudin

Why Transformers Need Adam: A Hessian Perspective

Yushun Zhang, Congliang Chen, Tian Ding, Ziniu Li, Ruoyu Sun

Nonparametric Instrumental Variable Regression through Stochastic Approximate Gradients

Yuri R. Fonseca, Caio F. L. Peixoto, Yuri F. Saporito

Sharpness-Aware Minimization Activates the Interactive Teaching's Understanding and Optimization

Mingwei Xu, Xiaofeng Cao, Ivor W. Tsang

Learning Bregman Divergences with Application to Robustness

Mohamed-Hicham Leghettas, Markus Püschel

PhyloGen: Language Model-Enhanced Phylogenetic Inference via Graph Structure Generation

Chenrui Duan, Zelin Zang, Siyuan Li, Yongjie Xu, Stan Z. Li

Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generation

Jiwoong Park, Yang Shen

Compositional 3D-aware Video Generation with LLM Director

Hanxin Zhu, Tianyu He, Anni Tang, Junliang Guo, Zhibo Chen

Rethinking No-reference Image Exposure Assessment from Holism to Pixel: Models, Datasets and Benchmarks

Shuai He, Shuntian Zheng, Anlong Ming, Banyu Wu, Huadong Ma

Unveiling LoRA Intrinsic Ranks via Salience Analysis

Wenjun Ke, Jiahao Wang, Peng Wang, Jiajun Liu, Dong Nie

LLMDFA: Analyzing Dataflow in Code with Large Language Models

Chengpeng Wang, Wuqi Zhang, Zian Su, Xiangzhe Xu, Xiaoheng Xie

Beyond the Doors of Perception: Vision Transformers Represent Relations Between Objects

Michael A. Lepori, Alexa R. Tartaglini, Wai Keen Vong, Thomas Serre, Ellie Pavlick

Nearly Tight Black-Box Auditing of Differentially Private Machine Learning

Meenatchi Sundaram Muthu Selva Annamalai, Emiliano De Cristofaro

Inference of Neural Dynamics Using Switching Recurrent Neural Networks

Yongxu Zhang, Shreya Saxena

FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention

Yu Lu, Yuanzhi Liang, Linchao Zhu, Yi Yang

Parallelizing Model-based Reinforcement Learning Over the Sequence Length

Zirui Wang, Yue Deng, Junfeng Long, Yin Zhang

Enhancing Large Vision Language Models with Self-Training on Image Comprehension

Yihe Deng, Pan Lu, Fan Yin, Ziniu Hu, Sheng Shen

BackTime: Backdoor Attacks on Multivariate Time Series Forecasting

Xiao Lin, Zhining Liu, Dongqi Fu, Ruizhong Qiu, Hanghang Tong

Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfels

Yikai Wang, Xinzhou Wang, Zilong Chen, Zhengyi Wang, Fuchun Sun

Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT

Le Zhuo, Ruoyi Du, Han Xiao, Yangguang Li, Dongyang Liu

Wormhole Loss for Partial Shape Matching

Amit Bracha, Thomas Dagès, Ron Kimmel

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

Jiachen Li, Xinyao Wang, Sijie Zhu, Chia-Wen Kuo, Lu Xu

GREATS: Online Selection of High-Quality Data for LLM Training in Every Iteration

Jiachen T. Wang, Tong Wu, Dawn Song, Prateek Mittal, Ruoxi Jia

PROSPECT PTMs: Rich Labeled Tandem Mass Spectrometry Dataset of Modified Peptides for Machine Learning in Proteomics

Wassim Gabriel, Omar Shouman, Ayla Schroeder, Florian Boessl, Mathias Wilhelm

Bayesian Online Natural Gradient (BONG)

Matt Jones, Peter Chang, Kevin Murphy

Paralinguistics-Aware Speech-Empowered Large Language Models for Natural Conversation

Heeseung Kim, Soonshin Seo, Kyeongseok Jeong, Ohsung Kwon, Soyoon Kim

VLM4Bio: A Benchmark Dataset to Evaluate Pretrained Vision-Language Models for Trait Discovery from Biological Images

M. Maruf, Arka Daw, Kazi Sajeed Mehrab, Harish Babu Manogaran, Abhilash Neog

AutoMix: Automatically Mixing Language Models

Pranjal Aggarwal, Aman Madaan, Ankit Anand, Srividya Pranavi Potharaju, Swaroop Mishra

Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-Guidance

Jiwan Hur, Dong-Jae Lee, Gyojin Han, Jaehyun Choi, Yunho Jeon

Expecting The Unexpected: Towards Broad Out-Of-Distribution Detection

Charles Guille-Escuret, Pierre-André Noël, Ioannis Mitliagkas, David Vázquez, Joao Monteiro

On Causal Discovery in the Presence of Deterministic Relations

Loka Li, Haoyue Dai, Hanin Al Ghothani, Biwei Huang, Jiji Zhang

CONTRAST: Continual Multi-source Adaptation to Dynamic Distributions

Sk Miraj Ahmed, Fahim Faisal Niloy, Xiangyu Chang, Dripta S. Raychaudhuri, Samet Oymak

Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

Mustafa Shukor, Matthieu Cord

Spectral Adapter: Fine-Tuning in Spectral Space

Fangzhao Zhang, Mert Pilanci

VastTrack: Vast Category Visual Object Tracking

Liang Peng, Junyuan Gao, Xinran Liu, Weihong Li, Shaohua Dong

Average gradient outer product as a mechanism for deep neural collapse

Daniel Beaglehole, Peter Súkeník, Marco Mondelli, Mikhail Belkin

MoGenTS: Motion Generation based on Spatial-Temporal Joint Modeling

Weihao Yuan, Yisheng He, Weichao Shen, Yuan Dong, Xiaodong Gu

Achieving Constant Regret in Linear Markov Decision Processes

Weitong ZHANG, Zhiyuan Fan, Jiafan He, Quanquan Gu

Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise

Zhenning Shi, Haoshuai Zheng, Chen Xu, Changsheng Dong, Bin Pan

Jialin Chen, Jan Eric Lenssen, Aosong Feng, Weihua Hu, Matthias Fey

Minimizing UCB: a Better Local Search Strategy in Local Bayesian Optimization

Zheyi Fan, Wenyu Wang, Szu Hui Ng, Qingpei Hu

Self-Guiding Exploration for Combinatorial Problems

Zangir Iklassov, Yali Du, Farkhad Akimov, Martin Takac

EpiCare: A Reinforcement Learning Benchmark for Dynamic Treatment Regimes

Mason Hargrave, Alex Spaeth, Logan Grosenick

Transductive Learning is Compact

Julian Asilis, Siddartha Devic, Shaddin Dughmi, Vatsal Sharan, Shang-Hua Teng

RTify: Aligning Deep Neural Networks with Human Behavioral Decisions

Yu-Ang Cheng, Ivan Felipe Rodriguez, Sixuan Chen, Kohitij Kar, Takeo Watanabe

Online Posterior Sampling with a Diffusion Prior

Branislav Kveton, Boris N. Oreshkin, Youngsuk Park, Aniket Deshmukh, Rui Song

B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

Luca Zancato, Arjun Seshadri, Yonatan Dukler, Aditya Golatkar, Yantao Shen

Probing the Decision Boundaries of In-context Learning in Large Language Models

Siyan Zhao, Tung Nguyen, Aditya Grover

Activation Map Compression through Tensor Decomposition for Deep Learning

Le-Trung Nguyen, Aël Quélennec, Enzo Tartaglione, Samuel Tardieu, Van-Tam Nguyen

Addressing Hidden Confounding with Heterogeneous Observational Datasets for Recommendation

Yanghao Xiao, Haoxuan Li, Yongqiang Tang, Wensheng Zhang

shapiq: Shapley Interactions for Machine Learning

Maximilian Muschalik, Hubert Baniecki, Fabian Fumagalli, Patrick Kolpaczki, Barbara Hammer

DiffusionPDE: Generative PDE-Solving under Partial Observation

Jiahe Huang, Guandao Yang, Zichen Wang, Jeong Joon Park

Ultrafast classical phylogenetic method beats large protein language models on variant effect prediction

Sebastian Prillo, Wilson Wu, Yun S. Song

Improved learning rates in multi-unit uniform price auctions

Marius Potfer, Dorian Baudry, Hugo Richard, Vianney Perchet, Cheng Wan

Information Re-Organization Improves Reasoning in Large Language Models

Xiaoxia Cheng, Zeqi Tan, Wei Xue, Weiming Lu

AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases

Zhaorun Chen, Zhen Xiang, Chaowei Xiao, Dawn Song, Bo Li

Simple and Effective Masked Diffusion Language Models

Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin

Online Adaptation of Language Models with a Memory of Amortized Contexts

Jihoon Tack, Jaehyung Kim, Eric Mitchell, Jinwoo Shin, Yee Whye Teh

An Efficient Memory Module for Graph Few-Shot Class-Incremental Learning

Dong Li, Aijia Zhang, Junqi Gao, Biqing Qi

How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?

Jiahua Dong, Wenqi Liang, Hongliu Li, Duzhen Zhang, Meng Cao

A Huber Loss Minimization Approach to Mean Estimation under User-level Differential Privacy

Puning Zhao, Lifeng LAI, Li Shen, Qingming Li, Jiafei Wu

Block Sparse Bayesian Learning: A Diversified Scheme

Yanhao Zhang, Zhihan Zhu, Yong Xia

On-Road Object Importance Estimation: A New Dataset and A Model with Multi-Fold Top-Down Guidance

Zhixiong Nan, Yilong Chen, Tianfei Zhou, Tao Xiang

β-DPO: Direct Preference Optimization with Dynamic β

Junkang Wu, Yuexiang Xie, Zhengyi Yang, Jiancan Wu, Jinyang Gao

Safe and Sparse Newton Method for Entropic-Regularized Optimal Transport

Zihao Tang, Yixuan Qiu

A Functional Extension of Semi-Structured Networks

David Rügamer, Bernard X.W. Liew, Zainab Altai, Almond Stöcker

Regularized Q-Learning

Han-Dong Lim, Donghwan Lee

Fast yet Safe: Early-Exiting with Risk Control

Metod Jazbec, Alexander Timans, Tin Hadži Veljković, Kaspar Sakmann, Dan Zhang

Semi-Random Matrix Completion via Flow-Based Adaptive Reweighting

Jonathan A. Kelner, Jerry Li, Allen Liu, Aaron Sidford, Kevin Tian

Geometry-aware training of factorized layers in tensor Tucker format

Emanuele Zangrando, Steffen Schotthöfer, Gianluca Ceruti, Jonas Kusch, Francesco Tudisco

Many-shot Jailbreaking

Cem Anil, Esin Durmus, Nina Panickssery, Mrinank Sharma, Joe Benton

SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain

Pierre Colombo, Telmo Pires, Malik Boudiaf, Rui Melo, Dominic Culver

Towards Multi-dimensional Explanation Alignment for Medical Classification

Lijie Hu, Songning Lai, Wenshuo Chen, Hongru Xiao, Hongbin Lin

Bandit-Feedback Online Multiclass Classification: Variants and Tradeoffs

Yuval Filmus, Steve Hanneke, Idan Mehalel, Shay Moran

MAC Advice for facility location mechanism design

Zohar Barak, Anupam Gupta, Inbal Talgam-Cohen

Sequoia: Scalable and Robust Speculative Decoding

Zhuoming Chen, Avner May, Ruslan Svirschevski, Yuhsun Huang, Max Ryabinin

GSDF: 3DGS Meets SDF for Improved Neural Rendering and Reconstruction

Mulin Yu, Tao Lu, Linning Xu, Lihan Jiang, Yuanbo Xiangli

Bifr\"ost: 3D-Aware Image Compositing with Language Instructions

Lingxiao Li, Kaixiong Gong, Weihong Li, xili dai, Tao Chen

Controlling Counterfactual Harm in Decision Support Systems Based on Prediction Sets

Eleni Straitouri, Suhas Thejaswi, Manuel Gomez Rodriguez

Foundation Inference Models for Markov Jump Processes

David Berghaus, Kostadin Cvejoski, Patrick Seifner, César Ojeda, Ramsés J. Sánchez

Autobidder's Dilemma: Why More Sophisticated Autobidders Lead to Worse Auction Efficiency

Yuan Deng, Jieming Mao, Vahab Mirrokni, Hanrui Zhang, Song Zuo

REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASR

Liang-Hsuan Tseng, En-Pei Hu, Cheng-Han Chiang, Yuan Tseng, Hung-yi Lee

Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking

Xi Chen, Chuan Qin, Chuyu Fang, Chao Wang, Chen Zhu

Learning Cortico-Muscular Dependence through Orthonormal Decomposition of Density Ratios

Shihan Ma, Bo Hu, Tianyu Jia, Alexander Kenneth Clarke, Blanka Zicher

Sequential Harmful Shift Detection Without Labels

Salim I. Amoukou, Tom Bewley, Saumitra Mishra, Freddy Lecue, Daniele Magazzeni

MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities

Hao Dong, Yue Zhao, Eleni Chatzi, Olga Fink

Toward Real Ultra Image Segmentation: Leveraging Surrounding Context to Cultivate General Segmentation Model

Sai Wang, Yutian Lin, Yu Wu, Bo Du

4D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization

Mijeong Kim, Jongwoo Lim, Bohyung Han

Automated Multi-Task Learning for Joint Disease Prediction on Electronic Health Records

Suhan Cui, Prasenjit Mitra

CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Models

Saurav Jha, Dong Gong, Lina Yao

Towards General Loop Invariant Generation: A Benchmark of Programs with Memory Manipulation

Chang Liu, Xiwei Wu, Yuan Feng, Qinxiang Cao, Junchi Yan

Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRI

Guanxiong Luo, Shoujin Huang, Martin Uecker

Frustratingly Easy Test-Time Adaptation of Vision-Language Models

Matteo Farina, Gianni Franchi, Giovanni Iacca, Massimiliano Mancini, Elisa Ricci

TSGM: A Flexible Framework for Generative Modeling of Synthetic Time Series

Alexander Nikitin, Letizia Iannucci, Samuel Kaski

Almost Minimax Optimal Best Arm Identification in Piecewise Stationary Linear Bandits

Yunlong Hou, Vincent Y. F. Tan, Zixin Zhong

An Image is Worth 32 Tokens for Reconstruction and Generation

Qihang Yu, Mark Weber, Xueqing Deng, Xiaohui Shen, Daniel Cremers

Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance

Kuan Heng Lin, Sicheng Mo, Ben Klingher, Fangzhou Mu, Bolei Zhou