NeurIPS 2024

4,493 papers

Prediction-Powered Ranking of Large Language Models

Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez Rodriguez

Customizing Language Models with Instance-wise LoRA for Sequential Recommendation

Xiaoyu Kong, Jiancan Wu, An Zhang, Leheng Sheng, Hui Lin

Bigger, Regularized, Optimistic: scaling for compute and sample efficient continuous control

Michal Nauman, Mateusz Ostaszewski, Krzysztof Jankowski, Piotr Miłoś, Marek Cygan

Matching the Statistical Query Lower Bound for k-Sparse Parity Problems with Sign Stochastic Gradient Descent

Yiwen Kou, Zixiang Chen, Quanquan Gu, Sham M. Kakade

Efficient and Sharp Off-Policy Evaluation in Robust Markov Decision Processes

Andrew Bennett, Nathan Kallus, Miruna Oprescu, Wen Sun, Kaiwen Wang

T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition

Chen Yeh, You-Ming Chang, Wei-Chen Chiu, Ning Yu

Double-Ended Synthesis Planning with Goal-Constrained Bidirectional Search

Kevin Yu, Jihye Roh, Ziang Li, Wenhao Gao, Runzhong Wang

Symmetry Discovery Beyond Affine Transformations

Ben Shaw, Abram Magner, Kevin R. Moon

Fractal Patterns May Illuminate the Success of Next-Token Prediction

Ibrahim Alabdulmohsin, Vinh Q. Tran, Mostafa Dehghani

Compositional Generalization Across Distributional Shifts with Sparse Tree Operations

Paul Soulos, Henry Conklin, Mattia Opper, Paul Smolensky, Jianfeng Gao

Federated Black-Box Adaptation for Semantic Segmentation

Jay N. Paranjape, Shameema Sikder, S. Swaroop Vedula, Vishal M. Patel

Federated Behavioural Planes: Explaining the Evolution of Client Behaviour in Federated Learning

Dario Fenoglio, Gabriele Dominici, Pietro Barbiero, Alberto Tonda, Martin Gjoreski

On the Robustness of Spectral Algorithms for Semirandom Stochastic Block Models

Aditya Bhaskara, Agastya Vibhuti Jha, Michael Kapralov, Naren Sarayu Manoj, Davide Mazzali

NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

Tianyi Zhang, Jonah Yi, Bowen Yao, Zhaozhuo Xu, Anshumali Shrivastava

RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions

Ziyao Zeng, Yangchao Wu, Hyoungseob Park, Daniel Wang, Fengyu Yang

Causal Dependence Plots

Joshua R. Loftus, Lucius E. J. Bynum, Sakina Hansen

Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases

Zian Su, Xiangzhe Xu, Ziyang Huang, Kaiyuan Zhang, Xiangyu Zhang

AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detection

Yujin Wang, Tianyi Xu, Fan Zhang, Tianfan Xue, Jinwei Gu

Learning Segmentation from Point Trajectories

Laurynas Karazija, Iro Laina, Christian Rupprecht, Andrea Vedaldi

3D Focusing-and-Matching Network for Multi-Instance Point Cloud Registration

Liyuan Zhang, Le Hui, Qi Liu, Bo Li, Yuchao Dai

Context-Aware Testing: A New Paradigm for Model Testing with Large Language Models

Paulius Rauba, Nabeel Seedat, Max Ruiz Luyten, Mihaela van der Schaar

Stochastic Optimal Control Matching

Carles Domingo-Enrich, Jiequn Han, Brandon Amos, Joan Bruna, Ricky T. Q. Chen

When LLMs Meet Cunning Texts: A Fallacy Understanding Benchmark for Large Language Models

Yinghui Li, Qingyu Zhou, Yuanzhen Luo, Shirong Ma, Yangning Li

SRFUND: A Multi-Granularity Hierarchical Structure Reconstruction Benchmark in Form Understanding

Jiefeng Ma, Yan Wang, Chenyu Liu, Jun Du, YU HU

Prediction with Action: Visual Policy Learning via Joint Denoising Process

Yanjiang Guo, Yucheng Hu, Jianke Zhang, Yen-Jen Wang, Xiaoyu Chen

Functional Gradient Flows for Constrained Sampling

Shiyue Zhang, Longlin Yu, Ziheng Cheng, Cheng Zhang

The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More

Ouail Kitouni, Niklas Nolte, Diane Bouchacourt, Adina Williams, Mike Rabbat

ComBack: A Versatile Dataset for Enhancing Compiler Backend Development Efficiency

Ming Zhong, Fang Lyu, Lulin Wang, Hongna Geng, Lei Qiu

DisC-GS: Discontinuity-aware Gaussian Splatting

Haoxuan Qu, Zhuoling Li, Hossein Rahmani, Yujun Cai, Jun Liu

DECO-Bench: Unified Benchmark for Decoupled Task-Agnostic Synthetic Data Release

Farzaneh Askari, Lingjuan Lyu, Vivek Sharma

FreqMark: Invisible Image Watermarking via Frequency Based Optimization in Latent Space

Yiyang Guo, Ruizhe Li, Mude Hui, Hanzhong Guo, Chen Zhang

Evidential Mixture Machines: Deciphering Multi-Label Correlations for Active Learning Sensitivity

Dayou Yu, Minghao Li, Weishi Shi, Qi Yu

Adversarial Moment-Matching Distillation of Large Language Models

Chen Jia

Private Online Learning via Lazy Algorithms

Hilal Asi, Tomer Koren, Daogao Liu, Kunal Talwar

Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang

Efficient Combinatorial Optimization via Heat Diffusion

Hengyuan Ma, Wenlian Lu, Jianfeng Feng

Rethinking the Diffusion Models for Missing Data Imputation: A Gradient Flow Perspective

Zhichao Chen, Haoxuan Li, Fangyikang Wang, Odin Zhang, Hu Xu

Robust Sleep Staging over Incomplete Multimodal Physiological Signals via Contrastive Imagination

Qi Shen, Junchang Xin, Bing Tian Dai, Shudi Zhang, Zhiqiong Wang

SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agents

Ethan Rathbun, Christopher Amato, Alina Oprea

Meta-Learning Universal Priors Using Non-Injective Change of Variables

Yilang Zhang, Alireza Sadeghi, Georgios B. Giannakis

Coded Computing for Resilient Distributed Computing: A Learning-Theoretic Framework

Parsa Moradi, Behrooz Tahmasebi, Mohammad Ali Maddah-Ali

Sparse-view Pose Estimation and Reconstruction via Analysis by Generative Synthesis

Qitao Zhao, Shubham Tulsiani

Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs

Yuxuan Qiao, Haodong Duan, Xinyu Fang, Junming Yang, Lin Chen

N-agent Ad Hoc Teamwork

Caroline Wang, Arrasy Rahman, Ishan Durugkar, Elad Liebman, Peter Stone

PrivCirNet: Efficient Private Inference via Block Circulant Transformation

Tianshi Xu, Lemeng Wu, Runsheng Wang, Meng Li

Why Warmup the Learning Rate? Underlying Mechanisms and Improvements

Dayal Singh Kalra, Maissam Barkeshli

Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents

Giorgio Piatti, Zhijing Jin, Max Kleiman-Weiner, Bernhard Schölkopf, Mrinmaya Sachan

SCaR: Refining Skill Chaining for Long-Horizon Robotic Manipulation via Dual Regularization

Zixuan Chen, Ze Ji, Jing Huo, Yang Gao

Bayesian Strategic Classification

Lee Cohen, Saeed Sharifi-Malvajerdi, Kevin Stang1, Ali Vakilian, Juba Ziani

Linear Causal Representation Learning from Unknown Multi-node Interventions

Burak Varıcı, Emre Acartürk, Karthikeyan Shanmugam, Ali Tajer

Online Control in Population Dynamics

Noah Golowich, Elad Hazan, Zhou Lu, Dhruv Rohatgi, Y. Jennifer Sun

WizardArena: Post-training Large Language Models via Simulated Offline Chatbot Arena

Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Qingwei Lin

Team-Fictitious Play for Reaching Team-Nash Equilibrium in Multi-team Games

Ahmed Said Donmez, Yuksel Arslantas, Muhammed O. Sayin

Stratified Prediction-Powered Inference for Effective Hybrid Evaluation of Language Models

Adam Fisch, Joshua Maynez, R. Alex Hofer, Bhuwan Dhingra, Amir Globerson

Non-Euclidean Mixture Model for Social Network Embedding

Roshni G. Iyer, Yewen Wang, Wei Wang, Yizhou Sun

Operator World Models for Reinforcement Learning

Pietro Novelli, Marco Pratticò, Massimiliano Pontil, Carlo Ciliberto

Toward a Stable, Fair, and Comprehensive Evaluation of Object Hallucination in Large Vision-Language Models

Hongliang Wei, Xingtao Wang, Xianqi Zhang, Xiaopeng Fan, Debin Zhao

GO4Align: Group Optimization for Multi-Task Alignment

Jiayi Shen, Qi (Cheems) Wang, Zehao Xiao, Nanne Van Noord, Marcel Worring

Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation

Nayeon Kim, Hongje Seong, Daehyun Ji, Sujin Jang

FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models

ruinan Jin, Zikang Xu, Yuan Zhong, Qingsong Yao, Qi Dou

Proportional Fairness in Clustering: A Social Choice Perspective

Leon Kellerhals, Jannik Peters

Random Function Descent

Felix Benning, Leif Döring

DiffSF: Diffusion Models for Scene Flow Estimation

Yushan Zhang, Bastian Wandt, Maria Magnusson, Michael Felsberg

Enhancing Semi-Supervised Learning via Representative and Diverse Sample Selection

Qian Shao, Jiangrui Kang, Qiyuan Chen, Zepeng Li, Hongxia Xu

FlexCap: Describe Anything in Images in Controllable Detail

Debidatta Dwibedi, Vidhi Jain, Jonathan Tompson, Andrew Zisserman, Yusuf Aytar

UltraPixel: Advancing Ultra High-Resolution Image Synthesis to New Peaks

Jingjing Ren, Wenbo Li, Haoyu Chen, Renjing Pei, Bin Shao

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

Rui Ye, Rui Ge, Xinyu Zhu, Jingyi Chai, Yaxin Du

Reranking Laws for Language Generation: A Communication-Theoretic Perspective

António Farinhas, Haau-Sing Li, André F.T. Martins, André F. T. Martins

Hierarchical Selective Classification

Shani Goren, Ido Galil, Ran El-Yaniv

Motion Graph Unleashed: A Novel Approach to Video Prediction

Yiqi Zhong, Luming Liang, Bohan Tang, Ilya Zharkov, Ulrich Neumann

Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation

Yuanhao Zhai, Kevin Lin, Zhengyuan Yang, Linjie Li, Jianfeng Wang

RG-SAN: Rule-Guided Spatial Awareness Network for End-to-End 3D Referring Expression Segmentation

Changli Wu, Qi Chen, Jiayi Ji, Haowei Wang, Yiwei Ma

Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning

Yuexiang Zhai, Hao Bai, Zipeng Lin, Jiayi Pan, Shengbang Tong

e-COP : Episodic Constrained Optimization of Policies

Akhil Agnihotri, Rahul Jain, Deepak Ramachandran, Sahil Singla

Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers

Sukjun Hwang, Aakash Lahoti, Ratish Puduppully, Tri Dao, Albert Gu

Diffusion4D: Fast Spatial-temporal Consistent 4D generation via Video Diffusion Models

Hanwen Liang, Yuyang Yin, Dejia Xu, hanxue liang, Zhangyang Wang

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Zebang Cheng, Zhi-Qi Cheng, Jun-Yan He, Jingdong Sun, Kai Wang

PowerGraph: A power grid benchmark dataset for graph neural networks

Anna Varbella, Kenza Amara, Blazhe Gjorgiev, Mennatallah El-Assady, Giovanni Sansavini

SegVol: Universal and Interactive Volumetric Medical Image Segmentation

Yuxin Du, Fan Bai, Tiejun Huang, Bo Zhao

GAVEL: Generating Games via Evolution and Language Models

Graham Todd, Alexander G. Padula, Matthew Stephenson, Éric Piette, Dennis J.N.J. Soemers

Aligning Model Properties via Conformal Risk Control

William Overman, Jacqueline Jil Vallon, Mohsen Bayati

How Molecules Impact Cells: Unlocking Contrastive PhenoMolecular Retrieval

Philip Fradkin, Puria Azadi, Karush Suri, Frederik Wenkel, Ali Bashashati

RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models

Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Sixiang Chen

Tri-Level Navigator: LLM-Empowered Tri-Level Learning for Time Series OOD Generalization

Chengtao Jian, Kai Yang, Yang Jiao

Skill-aware Mutual Information Optimisation for Zero-shot Generalisation in Reinforcement Learning

Xuehui Yu, Mhairi Dunion, Xin Li, Stefano V. Albrecht

NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theory

Navami Kairanda, Marc Habermann, Christian Theobalt, Vladislav Golyanik

RoPINN: Region Optimized Physics-Informed Neural Networks

Haixu Wu, Huakun Luo, Yuezhou Ma, Jianmin Wang, Mingsheng Long

Hamiltonian Score Matching and Generative Flows

Peter Holderrieth, Yilun Xu, Tommi Jaakkola

Generating Origin-Destination Matrices in Neural Spatial Interaction Models

Ioannis Zachos, Mark Girolami, Theodoros Damoulas

Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splatting

Junha Hyung, Susung Hong, Sungwon Hwang, Jaeseong Lee, Jaegul Choo

Trajectory Diffusion for ObjectGoal Navigation

Xinyao Yu, Sixian Zhang, Xinhang Song, Xiaorong Qin, Shuqiang Jiang

The motion planning neural circuit in goal-directed navigation as Lie group operator search

Junfeng Zuo, Ying Nian Wu, Si Wu, Wenhao Zhang, Wen-Hao Zhang

Reward Machines for Deep RL in Noisy and Uncertain Environments

Andrew C. Li, Zizhao Chen, Toryn Q. Klassen, Pashootan Vaezipoor, Rodrigo Toro Icarte

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

Yupeng Zhou, Daquan Zhou, Ming-Ming Cheng, Jiashi Feng, Qibin Hou

Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration

Kaihang Pan, Zhaoyu Fan, Juncheng Li, Qifan Yu, Hao Fei

Scaling laws for learning with real and surrogate data

Ayush Jain, Andrea Montanari, Eren Sasoglu

Knowledge Graph Completion by Intermediate Variables Regularization

Changyi Xiao, Yixin Cao

3D Structure Prediction of Atomic Systems with Flow-based Direct Preference Optimization

Rui Jiao, Xiangzhe Kong, Wenbing Huang, Yang Liu

Semantics and Spatiality of Emergent Communication

Rotem Ben Zion, Boaz Carmeli, Orr Paradise, Yonatan Belinkov

Bias and Volatility: A Statistical Framework for Evaluating Large Language Model's Stereotypes and the Associated Generation Inconsistency

Yiran Liu, Ke Yang, Zehan Qi, Xiao Liu, Yang Yu