NeurIPS 2024

4,493 papers

On the Power of Decision Trees in Auto-Regressive Language Modeling

Yulu Gan, Tomer Galanti, Tomaso Poggio, Eran Malach

The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks

Lénaïc Chizat, Praneeth Netrapalli

DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Features

Letian Wang, Seung Wook Kim, Jiawei Yang, Cunjun Yu, Boris Ivanovic

OSLO: One-Shot Label-Only Membership Inference Attacks

Yuefeng Peng, Jaechul Roh, Subhransu Maji, Amir Houmansadr

Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs

Rui Yang, Ruomeng Ding, Yong Lin, Huan Zhang, Tong Zhang

Nature-Inspired Local Propagation

Alessandro Betti, Marco Gori

Boosting Vision-Language Models with Transduction

Maxime Zanella, Benoît Gérin, Ismail Ben Ayed

Vivid-ZOO: Multi-View Video Generation with Diffusion Model

Bing Li, Cheng Zheng, Wenxuan Zhu, Jinjie Mai, Biao Zhang

Make Your LLM Fully Utilize the Context

Shengnan An, Zexiong Ma, Zeqi Lin, Nanning Zheng, Jian-Guang Lou

Periodic agent-state based Q-learning for POMDPs

Amit Sinha, Matthieu Geist, Aditya Mahajan

Facilitating Multimodal Classification via Dynamically Learning Modality Gap

Yang Yang, Fengqiang Wan, Qing-Yuan Jiang, Yi Xu

Rethinking The Training And Evaluation of Rich-Context Layout-to-Image Generation

Jiaxin Cheng, Zixu Zhao, Tong He, Tianjun Xiao, Zheng Zhang

MAN TruckScenes: A multimodal dataset for autonomous trucking in diverse conditions

Felix Fent, Fabian Kuttenreich, Florian Ruch, Farija Rizwin, Stefan Juergens

DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA

Aman Patel, Arpita Singhal, Austin Wang, Anusri Pampari, Maya Kasowski

Template-free Articulated Gaussian Splatting for Real-time Reposable Dynamic View Synthesis

Diwen Wan, Ruijie Lu, Gang Zeng, Yu-Xiang Wang, Yuxiang Wang

Unifying Generation and Prediction on Graphs with Latent Graph Diffusion

Cai Zhou, Xiyuan Wang, Muhan Zhang

BOLD: Boolean Logic Deep Learning

Van Minh Nguyen, Cristian Ocampo, Aymen Askri, Louis Leconte, Ba-Hien Tran

4M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalities

Roman Bachmann, Oğuzhan Fatih Kar, David Mizrahi, Ali Garjani, Mingfei Gao

Understanding Bias in Large-Scale Visual Datasets

Boya Zeng, Yida Yin, Zhuang Liu

Gradient Rewiring for Editable Graph Neural Network Training

Zhimeng Jiang, Zirui Liu, Xiaotian Han, Qizhang Feng, Hongye Jin

On the Minimax Regret for Contextual Linear Bandits and Multi-Armed Bandits with Expert Advice

Shinji Ito

No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance

Vishaal Udandarao, Ameya Prabhu, Adhiraj Ghosh, Yash Sharma, Philip H.S. Torr

Robust Gaussian Processes via Relevance Pursuit

Sebastian Ament, Elizabeth Santorella, David Eriksson, Ben Letham, Maximilian Balandat

Detecting and Measuring Confounding Using Causal Mechanism Shifts

Abbavaram Gowtham Reddy, Vineeth N Balasubramanian

TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes

Yanping Fu, Wenbin Liao, Xinyuan Liu, Hang Xu, Yike Ma

S-SOS: Stochastic Sum-Of-Squares for Parametric Polynomial Optimization

Richard L. Zhu, Mathias Oster, Yuehaw Khoo

On Sampling Strategies for Spectral Model Sharding

Denis Korzhenkov, Christos Louizos

Opponent Modeling with In-context Search

Yuheng Jing, Bingyun Liu, Kai Li, Yifan Zang, Haobo Fu

Fairness without Harm: An Influence-Guided Active Sampling Approach

Jinlong Pang, Jialu Wang, Zhaowei Zhu, Yuanshun Yao, Chen Qian

Worst-Case Offline Reinforcement Learning with Arbitrary Data Support

Kohei Miyaguchi

Learning Cut Generating Functions for Integer Programming

Hongyu Cheng, Amitabh Basu

The Fine-Grained Complexity of Gradient Computation for Training Large Language Models

Josh Alman, Zhao Song

Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models

Jack Merullo, Carsten Eickhoff, Ellie Pavlick

Self-Supervised Alignment with Mutual Information: Learning to Follow Principles without Preference Labels

Jan-Philipp Fränken, Eric Zelikman, Rafael Rafailov, Kanishk Gandhi, Tobias Gerstenberg

Unsupervised Homography Estimation on Multimodal Image Pair via Alternating Optimization

Sanghyeob Song, Jaihyun Lew, Hyemi Jang, Sungroh Yoon

Real-Time Selection Under General Constraints via Predictive Inference

Yuyang Huo, Lin Lu, Haojie Ren, Changliang Zou

PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization

Yao Ni, Shan Zhang, Piotr Koniusz

Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning

Runqian Wang, Soumya Ghosh, David Cox, Diego Antognini, Aude Oliva

Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting

Ziyi Yang, Xinyu Gao, Yang-Tian Sun, Xiaoyang Lyu, Wen Zhou

Exploring the Edges of Latent State Clusters for Goal-Conditioned Reinforcement Learning

Yuanlin Duan, Guofeng Cui, He Zhu

Diffusion Priors for Variational Likelihood Estimation and Image Denoising

Jun Cheng, Shan Tan

Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe

Albert Q. Jiang, Alicja Ziarko, Bartosz Piotrowski, Wenda Li, Mateja Jamnik

Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Anay Mehrotra, Manolis Zampetakis, Paul Kassianik, Blaine Nelson, Hyrum Anderson

DDR: Exploiting Deep Degradation Response as Flexible Image Descriptor

Juncheng Wu, Zhangkai Ni, Hanli Wang, Wenhan Yang, Yuyin Zhou

Neural Conditional Probability for Uncertainty Quantification

Vladimir R. Kostic, Karim Lounici, Grégoire Pacreau, Giacomo Turri, Pietro Novelli

TEG-DB: A Comprehensive Dataset and Benchmark of Textual-Edge Graphs

Zhuofeng Li, Zixing Gou, Xiangnan Zhang, Zhongyuan Liu, Sirui Li

A Canonicalization Perspective on Invariant and Equivariant Learning

George Ma, Yifei Wang, Derek Lim, Stefanie Jegelka, Yisen Wang

Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery

Haonan Lin, Wenbin An, Jiahao Wang, Yan Chen, Feng Tian

Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors

Chao Chen, Yu-Shen Liu, Zhizhong Han

RA-PbRL: Provably Efficient Risk-Aware Preference-Based Reinforcement Learning

Yujie Zhao, Jose Efraim Aguilar Escamill, Weyl Lu, Huazheng Wang

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models

Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Aaron Klein, Lennart Purucker

Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding

Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase

Constrained Binary Decision Making

Daniel Průša, Vojtěch Franc

Online Consistency of the Nearest Neighbor Rule

Sanjoy Dasgupta, Geelon So

YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals

Sandeep Mishra, Oindrila Saha, Alan C. Bovik

How Do Large Language Models Acquire Factual Knowledge During Pretraining?

Hoyeon Chang, Jinho Park, Seonghyeon Ye, Sohee Yang, Youngkyung Seo

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Wanyun Cui, Qianle Wang

Scaling Laws in Linear Regression: Compute, Parameters, and Data

Licong Lin, Jingfeng Wu, Sham M. Kakade, Peter L. Bartlett, Jason D. Lee

Opponent Modeling based on Subgoal Inference

XiaoPeng Yu, Jiechuan Jiang, Zongqing Lu

LibAMM: Empirical Insights into Approximate Computing for Accelerating Matrix Multiplication

Xianzhi Zeng, Wenchao Jiang, Shuhao Zhang

Localizing Memorization in SSL Vision Encoders

Wenhao Wang, Adam Dziedzic, Michael Backes, Franziska Boenisch

Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search

Nicola Dainese, Matteo Merler, Minttu Alakuijala, Pekka Marttinen

Multiclass Transductive Online Learning

Steve Hanneke, Vinod Raman, Amirreza Shaeri, Unqiue Subedi

Leveraging partial stragglers within gradient coding

Aditya Ramamoorthy, Ruoyu Meng, Vrinda S. Girimaji

DI-MaskDINO: A Joint Object Detection and Instance Segmentation Model

Zhixiong Nan, Xianghong Li, Tao Xiang, Jifeng Dai

ColJailBreak: Collaborative Generation and Editing for Jailbreaking Text-to-Image Deep Generation

Yizhuo Ma, Shanmin Pang, Qi Guo, Tianyu Wei, Qing Guo

On the Limitations of Fractal Dimension as a Measure of Generalization

Charlie B. Tan, Inés García-Redondo, Qiquan Wang, Michael M. Bronstein, Anthea Monod

SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning

Yangruibo Ding, Jinjun Peng, Marcus J. Min, Gail Kaiser, Junfeng Yang

ETO:Efficient Transformer-based Local Feature Matching by Organizing Multiple Homography Hypotheses

Junjie Ni, Guofeng Zhang, Guanglin Li, Yijin Li, Xinyang Liu

Infusing Synthetic Data with Real-World Patterns for Zero-Shot Material State Segmentation

Sagi Eppel, Jolina Yining Li, Manuel S. Drehwald, Alan Aspuru-Guzik

Simulation-Free Training of Neural ODEs on Paired Data

Semin Kim, Jaehoon Yoo, Jinwoo Kim, Yeonwoo Cha, Saehoon Kim

Parameterized Approximation Schemes for Fair-Range Clustering

Zhen Zhang, Xiaohong Chen, Limei Liu, Jie Chen, Junyu Huang

Are Language Models Actually Useful for Time Series Forecasting?

Mingtian Tan, Mike A. Merrill, Vinayak Gupta, Tim Althoff, Thomas Hartvigsen

SGD vs GD: Rank Deficiency in Linear Networks

Aditya Varre, Margarita Sagitova, Nicolas Flammarion

Active, anytime-valid risk controlling prediction sets

Ziyu Xu, Nikos Karampatziakis, Paul Mineiro

ReMI: A Dataset for Reasoning with Multiple Images

Mehran Kazemi, Nishanth Dikkala, Ankit Anand, Petar Devic, Ishita Dasgupta

Learning to Cooperate with Humans using Generative Agents

Yancheng Liang, Daphne Chen, Abhishek Gupta, Natasha Jaques, Simon S Du

Unveiling The Matthew Effect Across Channels: Assessing Layer Width Sufficiency via Weight Norm Variance

Yiting Chen, Jiazi Bu, Junchi Yan

ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models

Yuzhe Gu, Ziwei Ji, Wenwei Zhang, Chengqi Lyu, Dahua Lin

OPEL: Optimal Transport Guided ProcedurE Learning

Sayeed Shafayet Chowdhury, Soumyadeep Chandra, Kaushik Roy

SR-CACO-2: A Dataset for Confocal Fluorescence Microscopy Image Super-Resolution

Soufiane Belharbi, Mara KM Whitford, Phuong Hoang, Shakeeb Murtaza, Luke McCaffrey

S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity

Xinyu Yang, Jixuan Leng, Geyang Guo, Jiawei Zhao, Ryumei Nakada

ODRL: A Benchmark for Off-Dynamics Reinforcement Learning

Jiafei Lyu, Kang Xu, Jiacheng Xu, Mengbei Yan, Jingwen Yang

Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models

Yeming Wen, Swarat Chaudhuri

Coupled Mamba: Enhanced Multimodal Fusion with Coupled State Space Model

Wenbing Li, Hang Zhou, Junqing Yu, Zikai Song, Wei Yang

Wide Two-Layer Networks can Learn from Adversarial Perturbations

Soichiro Kumano, Hiroshi Kera, Toshihiko Yamasaki

RMLR: Extending Multinomial Logistic Regression into General Geometries

Ziheng Chen, Yue Song, Rui Wang, Xiao-Jun Wu, Nicu Sebe

Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning

Jonathan Cook, Chris Lu, Edward Hughes, Joel Z. Leibo, Jakob Foerster

Minimum Entropy Coupling with Bottleneck

M.Reza Ebrahimi, Jun Chen, Ashish Khisti

Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations

Hao Chen, Ankit Shah, Jindong Wang, Ran Tao, Yidong Wang

QTIP: Quantization with Trellises and Incoherence Processing

Albert Tseng, Qingyao Sun, David Hou, Christopher De Sa

Breaking Semantic Artifacts for Generalized AI-generated Image Detection

Chende Zheng, Chenhao Lin, Zhengyu Zhao, Hang Wang, Xu Guo

HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models

Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga, Yu Su

Navigable Graphs for High-Dimensional Nearest Neighbor Search: Constructions and Limits

Haya Diwan, Jinrui Gou, Cameron Musco, Christopher Musco, Torsten Suel

Reciprocal Reward Influence Encourages Cooperation From Self-Interested Agents

John L. Zhou, Weizhe Hong, Jonathan C. Kao

A Unified Framework for 3D Scene Understanding

Wei Xu, Chunsheng Shi, Sifan Tu, Xin Zhou, dingkang liang

MmCows: A Multimodal Dataset for Dairy Cattle Monitoring

Hien Vu, Omkar Prabhune, Unmesh Raskar, Dimuth Panditharatne, Hanwook Chung

Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming

Victor-Alexandru Pădurean, Adish Singla

Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characters

Haibo Jin, Andy Zhou, Joe D. Menke, Haohan Wang

Differentiable Task Graph Learning: Procedural Activity Representation and Online Mistake Detection from Egocentric Videos

Luigi Seminara, Giovanni Maria Farinella, Antonino Furnari