NeurIPS 2024

4,493 papers

ChatQA: Surpassing GPT-4 on Conversational QA and RAG

Zihan Liu, Wei Ping, Rajarshi Roy, Peng Xu, Chankyu Lee

No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations

Walter Simoncini, Spyros Gidaris, Andrei Bursuc, Yuki M. Asano

Benchmarking LLMs via Uncertainty Quantification

Fanghua Ye, Mingming Yang, Jianhui Pang, Longyue Wang, Derek F. Wong

Improving Deep Reinforcement Learning by Reducing the Chain Effect of Value and Policy Churn

Hongyao Tang, Glen Berseth

How do Large Language Models Handle Multilingualism?

Yiran Zhao, Wenxuan Zhang, Guizhen Chen, Kenji Kawaguchi, Lidong Bing

4Diffusion: Multi-view Video Diffusion Model for 4D Generation

Haiyu Zhang, Xinyuan Chen, Yaohui Wang, Xihui Liu, Yunhong Wang

Improving self-training under distribution shifts via anchored confidence with theoretical guarantees

Taejong Joo, Diego Klabjan

Lower Bounds of Uniform Stability in Gradient-Based Bilevel Algorithms for Hyperparameter Optimization

Rongzhen Wang, Chenyu Zheng, Guoqiang Wu, Xu Min, Xiaolu Zhang

Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?

Pedro R. A. S. Bassi, Wenxuan Li, Yucheng Tang, Fabian Isensee, Zifu Wang

Learning to Mitigate Externalities: the Coase Theorem with Hindsight Rationality

Antoine Scheid, Aymeric Capitaine, Etienne Boursier, Eric Moulines, Michael I. Jordan

How Diffusion Models Learn to Factorize and Compose

Qiyao Liang, Ziming Liu, Mitchell Ostrow, Ila Fiete

Entity Alignment with Noisy Annotations from Large Language Models

Shengyuan Chen, Qinggang Zhang, Junnan Dong, Wen Hua, Qing Li

ReLIZO: Sample Reusable Linear Interpolation-based Zeroth-order Optimization

Xiaoxing Wang, Xiaohan Qin, Xiaokang Yang, Junchi Yan

CLIPLoss and Norm-Based Data Selection Methods for Multimodal Contrastive Learning

Yiping Wang, Yifang Chen, Wendan Yan, Alex Fang, Wenjing Zhou

BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference

Changwoo Lee, Soo Min Kwon, Qing Qu, Hun-Seok Kim

Natural Counterfactuals With Necessary Backtracking

Guang-Yuan Hao, Jiji Zhang, Biwei Huang, Hao Wang, Kun Zhang

Towards Universal Mesh Movement Networks

Mingrui Zhang, Chunyang Wang, Stephan Kramer, Siyi Li, Jiancheng Liu

MemVLT: Vision-Language Tracking with Adaptive Memory-based Prompts

Xiaokun Feng, Xuchen Li, Shiyu Hu, Dailing Zhang, Meiqi Wu

The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing

Yang Xu, Yihong Gu, Cong Fang

OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking

Haiji Liang, Ruize Han

Directional Smoothness and Gradient Methods: Convergence and Adaptivity

Aaron Mishkin, Ahmed Khaled, Yuanhao Wang, Aaron Defazio, Robert M. Gower

On the Role of Attention Masks and LayerNorm in Transformers

Xinyi Wu, Amir Ajorlou, Yifei Wang, Stefanie Jegelka, Ali Jadbabaie

G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training

Che Liu, Cheng Ouyang, Sibo Cheng, Anand Shah, Wenjia Bai

Unconditional stability of a recurrent neural circuit implementing divisive normalization

Shivang Rawat, David J. Heeger, Stefano Martiniani

Language Models as Hierarchy Encoders

Yuan He, Zhangdie Yuan, Jiaoyan Chen, Ian Horrocks

Data-Efficient Learning with Neural Programs

Alaia Solko-Breslin, Seewon Choi, Ziyang Li, Neelay Velingker, Rajeev Alur

Segmenting Watermarked Texts From Language Models

Xingchi Li, Guanxun Li, Xianyang Zhang

Catastrophic Goodhart: regularizing RLHF with KL divergence does not mitigate heavy-tailed reward misspecification

Thomas Kwa, Drake Thomas, Adrià Garriga-Alonso

ProgressGym: Alignment with a Millennium of Moral Progress

Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji

Optimal Parallelization of Boosting

Arthur da Cunha, Mikael Møller Høgsgaard, Kasper Green Larsen

TreeVI: Reparameterizable Tree-structured Variational Inference for Instance-level Correlation Capturing

Junxi Xiao, Qinliang Su

Interaction-Force Transport Gradient Flows

Egor Gladin, Pavel Dvurechensky, Alexander Mielke, Jiajie Zhu, Jia-Jie Zhu

Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources

Jiamu Bai, Daoyuan Chen, Bingchen Qian, Liuyi Yao, Yaliang Li

Image Copy Detection for Diffusion Models

Wenhao Wang, Yifan Sun, Zhentao Tan, Yi Yang

Recurrent Reinforcement Learning with Memoroids

Steven Morad, Chris Lu, Ryan Kortvelesy, Stephan Liwicki, Jakob Foerster

Boundary Decomposition for Nadir Objective Vector Estimation

Ruihao Zheng, Zhenkun Wang

Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

Alex Jinpeng Wang, Linjie Li, Yiqi Lin, Min Li, Lijuan Wang

Pretrained Optimization Model for Zero-Shot Black Box Optimization

Xiaobin Li, Kai WU, Yujian Betterrest Li, Xiaoyu Zhang, Handing Wang

DataComp-LM: In search of the next generation of training sets for language models

Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan

IF-Font: Ideographic Description Sequence-Following Font Generation

Xinping Chen, Xiao Ke, Wenzhong Guo

Learning-Augmented Dynamic Submodular Maximization

Arpit Agarwal, Eric Balkanski

Learning Interaction-aware 3D Gaussian Splatting for One-shot Hand Avatars

Xuan Huang, Hanhui Li, Wanquan Liu, Xiaodan Liang, Yiqiang Yan

Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing

Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu

Emergence of heavy tails in homogenized stochastic gradient descent

Zhe Jiao, Martin Keller-Ressel

Functional Bilevel Optimization for Machine Learning

Ieva Petrulionyte, Julien Mairal, Michael Arbel

Sequential Probability Assignment with Contexts: Minimax Regret, Contextual Shtarkov Sums, and Contextual Normalized Maximum Likelihood

Ziyi Liu, Idan Attias, Daniel M. Roy

SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning

Paul Mangold, Sergey Samsonov, Safwan Labbi, Ilya Levin, Reda Alami

FSP-Laplace: Function-Space Priors for the Laplace Approximation in Bayesian Deep Learning

Tristan Cinquin, Marvin Pförtner, Vincent Fortuin, Philipp Hennig, Robert Bamler

Alignment at Pre-training! Towards Native Alignment for Arabic LLMs

Juhao Liang, Zhenyang Cai, Jianqing Zhu, Huang Huang, Kewei Zong

Video Token Merging for Long Video Understanding

Seon-Ho Lee, Jue Wang, Zhikang Zhang, David Fan, Xinyu Li

Expected Probabilistic Hierarchies

Marcel Kollovieh, Bertrand Charpentier, Daniel Zügner, Stephan Günnemann

Pseudo-Siamese Blind-spot Transformers for Self-Supervised Real-World Denoising

Yuhui Quan, Tianxiang Zheng, Hui Ji

High-Resolution Image Harmonization with Adaptive-Interval Color Transformation

Quanling Meng, Qinglin Liu, Zonglin Li, Xiangyuan Lan, Shengping Zhang

Pretraining with Random Noise for Fast and Robust Learning without Weight Transport

Jeonghwan Cheon, Sang Wan Lee, Se-Bum Paik

Beyond Aesthetics: Cultural Competence in Text-to-Image Models

Nithish Kannen, Arif Ahmad, Marco Andreetto, Vinodkumar Prabhakaran, Utsav Prabhu

Sparse High Rank Adapters

Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Viswanath Ganapathy, Shreya Kadambi

Fast and Memory-Efficient Video Diffusion Using Streamlined Inference

Zheng Zhan, Yushu Wu, Yifan Gong, Zichong Meng, Zhenglun Kong

$SE(3)$ Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation

Yinshuang Xu, Dian Chen, Katherine Liu, Sergey Zakharov, Rares Ambrus

LION: Linear Group RNN for 3D Object Detection in Point Clouds

Zhe Liu, Jinghua Hou, Xinyu Wang, Xiaoqing Ye, Jingdong Wang

BitDelta: Your Fine-Tune May Only Be Worth One Bit

James Liu, Guangxuan Xiao, Kai Li, Jason D. Lee, Song Han

DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut

Paul Couairon, Mustafa Shukor, Jean-Emmanuel Haugeard, Matthieu Cord, Nicolas Thome

Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts

Hang Guo, Tao Dai, Yuanchao Bai, Bin Chen, Xudong Ren

AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fields

Louis Serrano, Thomas X Wang, Etienne Le Naour, Jean-Noël Vittaut, Patrick Gallinari

eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modeling

Matthew Dowling, Yuan Zhao, Il Memming Park

Learning Cooperative Trajectory Representations for Motion Forecasting

Hongzhi Ruan, Haibao Yu, Wenxian Yang, Siqi Fan, Zaiqing Nie

MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step

Takeshi Noda, Chao Chen, Weiqi Zhang, Xinhai Liu, Yu-Shen Liu

A Full-duplex Speech Dialogue Scheme Based On Large Language Model

Peng Wang, Songshuo Lu, Yaohua Tang, Sijie Yan, Wei Xia

Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild

Xinyu Zhao, Guoheng Sun, Ruisi Cai, Yukun Zhou, Pingzhi Li

On improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models

Tariq Berrada, Pietro Astolfi, Melissa Hall, Reyhane Askari-Hemmat, Yohann Benchetrit

Towards Comprehensive Detection of Chinese Harmful Memes

Junyu Lu, Bo Xu, Xiaokun Zhang, Hongbo Wang, Haohao Zhu

Zero-Shot Event-Intensity Asymmetric Stereo via Visual Prompting from Image Domain

Hanyue Lou, Jinxiu Liang, Minggui Teng, Bin Fan, Yong Xu

Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks

Tianyu He, Darshil Doshi, Aritra Das, Andrey Gromov

BLURD: Benchmarking and Learning using a Unified Rendering and Diffusion Model

Boris Repasky, Anthony Dick, Ehsan Abbasnejad

Honor Among Bandits: No-Regret Learning for Online Fair Division

Benjamin Schiffer, Shirley Zhang, Ariel D Procaccia, Ariel D. Procaccia

Fundamental Convergence Analysis of Sharpness-Aware Minimization

Pham Duy Khanh, Hoang-Chau Luong, Boris S. Mordukhovich, Dat Ba Tran

Policy-shaped prediction: avoiding distractions in model-based reinforcement learning

Miles Hutson, Isaac Kauvar, Nick Haber

DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices

Yongzhe Jia, Xuyun Zhang, Hongsheng Hu, Kim-Kwang Raymond Choo, Lianyong Qi

QKFormer: Hierarchical Spiking Transformer using Q-K Attention

Chenlin Zhou, Han Zhang, Zhaokun Zhou, Liutao Yu, Liwei Huang

Peri-midFormer: Periodic Pyramid Transformer for Time Series Analysis

Qiang Wu, Gechang Yao, Zhixi Feng, Shuyuan Yang

DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model

Yuqi Wang, Ke Cheng, Jiawei He, Qitai Wang, Hengchen Dai

Navigating the Effect of Parametrization for Dimensionality Reduction

Haiyang Huang, Yingfan Wang, Cynthia Rudin

Regret Minimization in Stackelberg Games with Side Information

Keegan Harris, Zhiwei Steven Wu, Maria-Florina Balcan

Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation

Sobihan Surendran, Adeline Fermanian, Antoine Godichon-Baggioni, Sylvain Le Corff

Historical Test-time Prompt Tuning for Vision Foundation Models

Jingyi Zhang, Jiaxing Huang, Xiaoqin Zhang, Ling Shao, Shijian Lu

CV-VAE: A Compatible Video VAE for Latent Generative Video Models

Sijie Zhao, Yong Zhang, Xiaodong Cun, Shaoshu Yang, Muyao Niu

Generalization Bound and Learning Methods for Data-Driven Projections in Linear Programming

Shinsaku Sakaue, Taihei Oki

ROIDICE: Offline Return on Investment Maximization for Efficient Decision Making

Woosung Kim, Hayeong Lee, Jongmin Lee, Byung-Jun Lee

Handling Learnwares from Heterogeneous Feature Spaces with Explicit Label Exploitation

Peng Tan, Hai-Tian Liu, Zhi-Hao Tan, Zhi-Hua Zhou

Variational Distillation of Diffusion Policies into Mixture of Experts

Hongyi Zhou, Denis Blessing, Ge Li, Onur Celik, Xiaogang Jia

Towards Safe Concept Transfer of Multi-Modal Diffusion via Causal Representation Editing

Peiran Dong, Bingjie WANG, Song Guo, Junxiao Wang, Jie Zhang

Towards Calibrated Robust Fine-Tuning of Vision-Language Models

Changdae Oh, Hyesu Lim, Mijoo Kim, Dongyoon Han, Sangdoo Yun

Representation Noising: A Defence Mechanism Against Harmful Finetuning

Domenic Rosati, Jan Wehner, Kai Williams, Łukasz Bartoszcze, David Atanasov

Scaling the Codebook Size of VQ-GAN to 100,000 with a Utilization Rate of 99%

LEI ZHU, Fangyun Wei, Yanye Lu, Dong Chen

Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference

Jiabao Ji, Yujian Liu, Yang Zhang, Gaowen Liu, Ramana Rao Kompella

Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithms

Miao Lu, Han Zhong, Tong Zhang, Jose Blanchet

Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps

Nikita Starodubcev, Mikhail Khoroshikh, Artem Babenko, Dmitry Baranchuk

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Hao Bai, Yifei Zhou, Mert Cemri, Jiayi Pan, Alane Suhr

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning

Sergey Samsonov, Eric Moulines, Qi-Man Shao, Zhuo-Song Zhang, Alexey Naumov

The Power of Resets in Online Reinforcement Learning

Zakaria Mhammedi, Alexander Rakhlin, Dylan J Foster, Dylan J. Foster

What makes unlearning hard and what to do about it

Kairan Zhao, Meghdad Kurmanji, George-Octavian Barbulescu, Eleni Triantafillou, Peter Triantafillou