NeurIPS 2024

4,493 papers

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length

Xuezhe Ma, Xiaomeng Yang, Wenhan Xiong, Beidi Chen, LILI YU

Wolfgang Stammer, Antonia Wüst, David Steinmann, Kristian Kersting

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning

Yibo Yang, Xiaojie Li, Zhongzhu Zhou, Shuaiwen Leon Song, Jianlong Wu

OMG-LLaVA: Bridging Image-level, Object-level, Pixel-level Reasoning and Understanding

Tao Zhang, Xiangtai Li, Hao Fei, Haobo Yuan, Shengqiong Wu

Marrying Causal Representation Learning with Dynamical Systems for Science

Dingling Yao, Caroline Muller, Francesco Locatello

Great Minds Think Alike: The Universal Convergence Trend of Input Salience

Yipei Wang, Jeffrey Mark Siskind, Xiaoqian Wang

Integrating Deep Metric Learning with Coreset for Active Learning in 3D Segmentation

Arvind Murari Vepa, Zukang Yang, Andrew Choi, Jungseock Joo, Fabien Scalzo

Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs

Ching-An Cheng, Allen Nie, Adith Swaminathan

Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injections

Zihan Luo, Hong Huang, Yongkang Zhou, Jiping Zhang, Nuo Chen

Learning to Assist Humans without Inferring Rewards

Vivek Myers, Evan Ellis, Sergey Levine, Benjamin Eysenbach, Anca Dragan

FouRA: Fourier Low-Rank Adaptation

Shubhankar Borse, Shreya Kadambi, Nilesh Prasad Pandey, Kartikeya Bhardwaj, Viswanath Ganapathy

All-in-One Image Coding for Joint Human-Machine Vision with Multi-Path Aggregation

Xu Zhang, Peiyao Guo, Ming Lu, Zhan Ma

On the Inductive Bias of Stacking Towards Improving Reasoning

Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi, Sashank J. Reddi

Adaptive Domain Learning for Cross-domain Image Denoising

Zian Qian, Chenyang Qi, Ka Lung Law, Hao Fu, Chenyang Lei

Risk-sensitive control as inference with Rényi divergence

Kaito Ito, Kenji Kashima

Taming "data-hungry" reinforcement learning? Stability in continuous state-action spaces

Yaqi Duan, Martin J. Wainwright

Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization

Yuhang Cai, Jingfeng Wu, Song Mei, Michael Lindsey, Peter L. Bartlett

Even Sparser Graph Transformers

Hamed Shirzad, Honghao Lin, Balaji Venkatachalam, Ameya Velingker, David P. Woodruff

The Star Geometry of Critic-Based Regularizer Learning

Oscar Leong, Eliza O'Reilly, Yong Sheng Soh

Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study

Xuefei Ning, Zifu Wang, Shiyao Li, Zinan Lin, Peiran Yao

MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection

Haoyang He, Yuhu Bai, Jiangning Zhang, Qingdong He, Hongxu Chen

Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising Diffusion

Ye He, Kevin Rojas, Molei Tao

Using Surrogates in Covariate-adjusted Response-adaptive Randomization Experiments with Delayed Outcomes

Lei Shi, Waverly Wei, Jingshen Wang

2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution

Kai Liu, Haotong Qin, Yong Guo, Xin Yuan, Linghe Kong

MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map

Yuhong Chou, Man Yao, Kexin Wang, Yuqi Pan, Ruijie Zhu

The Ladder in Chaos: Improving Policy Learning by Harnessing the Parameter Evolving Path in A Low-dimensional Space

Hongyao Tang, Min Zhang, Chen Chen, Jianye Hao

Adaptive Labeling for Efficient Out-of-distribution Model Evaluation

Daksh Mittal, Yuanzhe Ma, Shalmali Joshi, Hongseok Namkoong

A Tractable Inference Perspective of Offline RL

Xuejie Liu, Anji Liu, Guy Van den Broeck, Yitao Liang

Faster Differentially Private Top-k Selection: A Joint Exponential Mechanism with Pruning

Hao Wu, Hanwen Zhang

Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning

Chia-Hsiang Kao, Bharath Hariharan

Neural Cover Selection for Image Steganography

Karl Chahine, Hyeji Kim

Almost Free: Self-concordance in Natural Exponential Families and an Application to Bandits

Shuai Liu, Alex Ayoub, Flore Sentenac, Xiaoqi Tan, Csaba Szepesvári

Improving Context-Aware Preference Modeling for Language Models

Silviu Pitis, Ziang Xiao, Nicolas Le Roux, Alessandro Sordoni

Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction

Liang Wang, Qiang Liu, Shaozhen Liu, Xin Sun, Shu Wu

Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem

Mathieu Even, Luca Ganassali, Jakob Maier, Laurent Massoulié

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes

Jerry Yao-Chieh Hu, Dennis Wu, Han Liu

Boosting Generalization in Parametric PDE Neural Solvers through Adaptive Conditioning

Armand Kassaï Koupaï, Jorge Mifsut Benet, Yuan Yin, Jean-Noël Vittaut, Patrick Gallinari

Performative Control for Linear Dynamical Systems

Songfu Cai, Fei Han, Xuanyu Cao

Offline Multitask Representation Learning for Reinforcement Learning

Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang

Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling

Junyi Li, Heng Huang

Dual-Perspective Activation: Efficient Channel Denoising via Joint Forward-Backward Criterion for Artificial Neural Networks

Tian Qiu, Chenchao Gao, Zunlei Feng, Jie Lei, Bingde Hu

Dual Defense: Enhancing Privacy and Mitigating Poisoning Attacks in Federated Learning

Runhua Xu, Shiqi Gao, CHAO LI, James Joshi, Jianxin Li

VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization

Yiwei Zhang, Jin Gao, Fudong Ge, Guan Luo, Bing Li

Predicting Label Distribution from Ternary Labels

Yunan Lu, Xiuyi Jia

LaSe-E2V: Towards Language-guided Semantic-aware Event-to-Video Reconstruction

Kanghao Chen, Hangyu Li, Jiazhou Zhou, Zeyu Wang, Lin Wang

Constrained Latent Action Policies for Model-Based Offline Reinforcement Learning

Marvin Alles, Philip Becker-Ehmck, Patrick van der Smagt, Maximilian Karl

Building a stable classifier with the inflated argmax

Jake A. Soloff, Rina Foygel Barber, Rebecca Willett

Deterministic Uncertainty Propagation for Improved Model-Based Offline Reinforcement Learning

Abdullah Akgül, Manuel Haußmann, Melih Kandemir

Perceptual Fairness in Image Restoration

Guy Ohayon, Michael Elad, Tomer Michaeli

A Consistency-Aware Spot-Guided Transformer for Versatile and Hierarchical Point Cloud Registration

Renlang Huang, Yufan Tang, Jiming Chen, Liang Li

ViLCo-Bench: VIdeo Language COntinual learning Benchmark

Tianqi Tang, Shohreh Deldari, Hao Xue, Celso De Melo, Flora Salim

WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment

Hao Tang, Darren Key, Kevin Ellis

ProxyFusion: Face Feature Aggregation Through Sparse Experts

Bhavin Jawade, Alexander Stone, Deen Dayal Mohan, Xiao Wang, Srirangaraj Setlur

Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioning

Penghui Ruan, Pichao WANG, Divya Saxena, Jiannong Cao, Yuhui Shi

Indoor Air Quality Dataset with Activities of Daily Living in Low to Middle-income Communities

Prasenjit Karmakar, Swadhin Pradhan, Sandip Chakraborty

Improving Generalization of Dynamic Graph Learning via Environment Prompt

Kuo Yang, Zhengyang Zhou, Qihe Huang, Limin Li, Yuxuan Liang

Scalable DP-SGD: Shuffling vs. Poisson Subsampling

Lynn Chua, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi

Self-Distilled Depth Refinement with Noisy Poisson Fusion

Jiaqi Li, Yiran Wang, Jinghong Zheng, Zihao Huang, Ke Xian

Continual Learning with Global Alignment

Xueying Bai, Jinghuan Shang, Yifan Sun, Niranjan Balasubramanian

VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks

Jiannan Wu, Muyan Zhong, Sen Xing, Zeqiang Lai, Zhaoyang Liu

Understanding Visual Feature Reliance through the Lens of Complexity

Thomas FEL, Louis Béthune, Andrew Kyle Lampinen, Thomas Serre, Katherine Hermann

Exploring the Precise Dynamics of Single-Layer GAN Models: Leveraging Multi-Feature Discriminators for High-Dimensional Subspace Learning

Andrew Bond, Zafer Doğan

LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation

Bowen Li, Zhaoyu Li, Qiwei Du, Jinqi Luo, Wenshan Wang

Semidefinite Relaxations of the Gromov-Wasserstein Distance

Junyu Chen, Binh T. Nguyen, Shang Hui Koh, Yong Sheng Soh

Externally Valid Policy Evaluation from Randomized Trials Using Additional Observational Data

Sofia Ek, Dave Zachariah

Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts

Mikayel Samvelyan, Sharath Chandra Raparthy, Andrei Lupu, Eric Hambro, Aram H. Markosyan

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

Qingyang Zhang, Qiuxuan Feng, Joey Tianyi Zhou, Yatao Bian, Qinghua Hu

MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset

Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen

No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO

Skander Moalla, Andrea Miele, Daniil Pyatko, Razvan Pascanu, Caglar Gulcehre

A New Multi-Source Light Detection Benchmark and Semi-Supervised Focal Light Detection

Jae-Yong Baek, Yong-Sang Yoo, Seung-Hwan Bae

Multi-Agent Domain Calibration with a Handful of Offline Data

Tao Jiang, Lei Yuan, Lihe Li, Cong Guan, Zongzhang Zhang

Training-Free Open-Ended Object Detection and Segmentation via Attention as Prompts

Zhiwei Lin, Yongtao Wang, Zhi Tang

A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era

Fangyun Wei, Jinjing Zhao, Kun Yan, Hongyang Zhang, Chang Xu

DINTR: Tracking via Diffusion-based Interpolation

Pha Nguyen, Ngan Le, Jackson Cothren, Alper Yilmaz, Khoa Luu

Tensor-Based Synchronization and the Low-Rankness of the Block Trifocal Tensor

Daniel Miao, Gilad Lerman, Joe Kileel

Qualitative Mechanism Independence

Oliver E. Richardson, Spencer Peters, Joseph Y. Halpern

Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation

Yu-Liang Zhan, Zhong-Yi Lu, Hao Sun, Ze-Feng Gao

CALANet: Cheap All-Layer Aggregation for Human Activity Recognition

Jaegyun Park, Dae-Won Kim, Jaesung Lee

Training Compute-Optimal Protein Language Models

Xingyi Cheng, Bo Chen, Pan Li, Jing Gong, Jie Tang

Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach

Hanyang Yuan, Jiarong Xu, Renhong Huang, Mingli Song, Chunping Wang

VideoGUI: A Benchmark for GUI Automation from Instructional Videos

Kevin Qinghong Lin, Linjie Li, Difei Gao, Qinchen Wu, Mingyi Yan

United We Stand, Divided We Fall: Fingerprinting Deep Neural Networks via Adversarial Trajectories

Tianlong Xu, Chen Wang, Gaoyang Liu, Yang Yang, Kai Peng

Log-concave Sampling from a Convex Body with a Barrier: a Robust and Unified Dikin Walk

Yuzhou Gu, Nikki Lijing Kuang, Zhao Song, Lichen Zhang, Yian Ma

FACT or Fiction: Can Truthful Mechanisms Eliminate Federated Free Riding?

Marco Bornstein, Amrit Singh Bedi, Abdirisak Mohamed, Furong Huang

Instruction Tuning With Loss Over Instructions

Zhengyan Shi, Adam X. Yang, Bin Wu, Laurence Aitchison, Emine Yilmaz

Stress-Testing Capability Elicitation With Password-Locked Models

Ryan Greenblatt, Fabien Roger, Dmitrii Krasheninnikov, David Krueger

Bias Detection via Signaling

Yiling Chen, Tao LIN, Aaditya Ramdas, Itai Shapira, Ariel D Procaccia

Thinking Forward: Memory-Efficient Federated Finetuning of Language Models

Kunjal Panchal, Nisarg Parikh, Sunav Choudhary, Lijun Zhang, Yuriy Brun

Putting Gale & Shapley to Work: Guaranteeing Stability Through Learning

Hadi Hosseini, Sanjukta Roy, Duohan Zhang

On the Worst Prompt Performance of Large Language Models

Bowen Cao, Deng Cai, Zhisong Zhang, Yuexian Zou, Wai Lam

SpeAr: A Spectral Approach for Zero-Shot Node Classification

Ting Guo, Da Wang, Jiye Liang, Kaihan Zhang, Jianchao Zeng

Consistency of Neural Causal Partial Identification

Jiyuan Tan, Jose Blanchet, Vasilis Syrgkanis

Approximation Rate of the Transformer Architecture for Sequence Modeling

Haotian Jiang, Qianxiao Li

P^2C^2Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics

Qi Wang, Pu Ren, Hao Zhou, Zhiwen Deng, Yi Zhang

Changing the Training Data Distribution to Reduce Simplicity Bias Improves In-distribution Generalization

Tuan Hai Dang Nguyen, Paymon Haddad, Eric Gan, Baharan Mirzasoleiman

Reasons and Solutions for the Decline in Model Performance after Editing

Xiusheng Huang, Jiaxiang Liu, Yequan Wang, Kang Liu

SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors

Chenyang Ma, Kai Lu, Ta-Ying Cheng, Niki Trigoni, Andrew Markham

LLM Evaluators Recognize and Favor Their Own Generations

Arjun Panickssery, Samuel R. Bowman, Shi Feng

Scaling transformer neural networks for skillful and reliable medium-range weather forecasting

Tung Nguyen, Rohan Shah, Hritik Bansal, Troy Arcomano, Romit Maulik

Group and Shuffle: Efficient Structured Orthogonal Parametrization

Mikhail Gorbunov, Nikolay Yudin, Vera Soboleva, Aibek Alanov, Alexey Naumov