NeurIPS 2024

4,493 papers

Attention Temperature Matters in ViT-Based Cross-Domain Few-Shot Learning

Yixiong Zou, Ran Ma, Yuhua Li, Ruixuan Li

Universal Rates of Empirical Risk Minimization

Steve Hanneke, Mingyue Xu

SE(3)-bi-equivariant Transformers for Point Cloud Assembly

Ziming Wang, Rebecka Jörnsten

Nuclear Norm Regularization for Deep Learning

Christopher Scarvelis, Justin Solomon

Instructor-inspired Machine Learning for Robust Molecular Property Prediction

Fang Wu, Shuting Jin, Siyuan Li, Stan Z. Li

Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks

Xin-Chun Li, Jin-Lin Tang, Bo Zhang, Lan Li, De-Chuan Zhan

A SARS-CoV-2 Interaction Dataset and VHH Sequence Corpus for Antibody Language Models

Hirofumi Tsuruta, Hiroyuki Yamazaki, Ryota Maeda, Ryotaro Tamura, Akihiro Imura

Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design

Ruisi Cai, Yeonju Ro, Geon-Woo Kim, Peihao Wang, Babak Ehteshami Bejnordi

You Don’t Need Domain-Specific Data Augmentations When Scaling Self-Supervised Learning

Théo Moutakanni, Maxime Oquab, Marc Szafraniec, Maria Vakalopoulou, Piotr Bojanowski

Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning

Divyam Madaan, Taro Makino, Sumit Chopra, Kyunghyun Cho

Towards Flexible 3D Perception: Object-Centric Occupancy Completion Augments 3D Object Detection

Chaoda Zheng, Feng Wang, Naiyan Wang, Shuguang Cui, Zhen Li

Testing Calibration in Nearly-Linear Time

Lunjia Hu, Arun Jambulapati, Kevin Tian, Chutong Yang

WONDERBREAD: A Benchmark for Evaluating Multimodal Foundation Models on Business Process Management Tasks

Michael Wornow, Avanika Narayan, Ben Viggiano, Ishan S. Khare, Tathagat Verma

A teacher-teacher framework for clinical language representation learning

Feiqing Huang, Shenghan Zhang, Sara Morini Sweet, Tianxi Cai

Provable Benefits of Complex Parameterizations for Structured State Space Models

Yuval Ran-Milo, Eden Lumbroso, Edo Cohen-Karlik, Raja Giryes, Amir Globerson

A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts

Samuele Bortolotti, Emanuele Marconato, Tommaso Carraro, Paolo Morettin, Emile van Krieken

Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations

Artem Agafonov, Petr Ostroukhov, Roman Mozhaev, Konstantin Yakovlev, Eduard Gorbunov

Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation

Chengting Yu, Lei Liu, Gaoang Wang, Erping Li, Aili Wang

Geometry Awakening: Cross-Geometry Learning Exhibits Superiority over Individual Structures

Yadong Sun, Xiaofeng Cao, Yu Wang, Wei Ye, Jingcai Guo

Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing

Haonan Lin, Yan Chen, Jiahao Wang, Wenbin An, Mengmeng Wang

The Selective G-Bispectrum and its Inversion: Applications to G-Invariant Networks

Simon Mataigne, Johan Mathe, Sophia Sanborn, Christopher Hillar, Nina Miolane

Clustering in Causal Attention Masking

Nikita Karagodin, Yury Polyanskiy, Philippe Rigollet

FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction

Feijie Wu, Xingchen Wang, Yaqing Wang, Tianci Liu, Lu Su

FLAME : Factuality-Aware Alignment for Large Language Models

Sheng-Chieh Lin, Luyu Gao, Barlas Oguz, Wenhan Xiong, Jimmy Lin

Adaptable Logical Control for Large Language Models

Honghua Zhang, Po-Nien Kung, Masahiro Yoshida, Guy Van den Broeck, Nanyun Peng

Cost-aware Bayesian Optimization via the Pandora's Box Gittins Index

Qian Xie, Raul Astudillo, Peter I. Frazier, Ziv Scully, Alexander Terenin

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Songlin Yang, bailin wang, Yu Zhang, Yikang Shen, Yoon Kim

Real-time Stereo-based 3D Object Detection for Streaming Perception

Changcai Li, Zonghua Gu, Gang Chen, Libo Huang, Wei Zhang

Last-Iterate Convergence for Generalized Frank-Wolfe in Monotone Variational Inequalities

Zaiwei Chen, Eric Mazumdar

Structured Learning of Compositional Sequential Interventions

Jialin Yu, Andreas Koukorinis, Nicolo Colombo, Yuchen Zhu, Ricardo Silva

One-Step Diffusion Distillation through Score Implicit Matching

Weijian Luo, Zemin Huang, Zhengyang Geng, J. Zico Kolter, Guo-Jun Qi

Exploitation of a Latent Mechanism in Graph Contrastive Learning: Representation Scattering

Dongxiao He, Lianze Shan, Jitao Zhao, Hengrui Zhang, Zhen Wang

High Rank Path Development: an approach to learning the filtration of stochastic processes

Jiajie Tao, Hao Ni, Chong Liu

LoQT: Low-Rank Adapters for Quantized Pretraining

Sebastian Loeschcke, Mads Toftrup, Michael J. Kastoryano, Serge Belongie, Vésteinn Snæbjarnarson

Cost-efficient Knowledge-based Question Answering with Large Language Models

Junnan Dong, Qinggang Zhang, Chuang Zhou, Hao Chen, Daochen Zha

PowerPM: Foundation Model for Power Systems

Shihao Tu, Yupeng Zhang, Jing Zhang, Zhendong Fu, Yin Zhang

Leveraging Catastrophic Forgetting to Develop Safe Diffusion Models against Malicious Finetuning

Jiadong Pan, Hongcheng Gao, Zongyu Wu, Taihang Hu, Li Su

Mixture of Adversarial LoRAs: Boosting Robust Generalization in Meta-Tuning

Xu Yang, Chen Liu, Ying Wei

LOVA3: Learning to Visual Question Answering, Asking and Assessment

Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Zechen Bai, Mike Zheng Shou

AutoSurvey: Large Language Models Can Automatically Write Surveys

Yidong Wang, Qi Guo, Wenjin Yao, Hongbo Zhang, Xin Zhang

Offline Behavior Distillation

Shiye Lei, Sen Zhang, Dacheng Tao

Image2Struct: Benchmarking Structure Extraction for Vision-Language Models

Josselin Somerville Roberts, Tony Lee, Chi Heem Wong, Michihiro Yasunaga, Yifan Mai

Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecasting

Romain Ilbert, Malik Tiomoko, Cosme Louart, Ambroise Odonnat, Vasilii Feofanov

Amortized Fourier Neural Operators

Zipeng Xiao, Siqi Kou, Zhongkai Hao, Bokai Lin, Zhijie Deng

Theoretical Characterisation of the Gauss Newton Conditioning in Neural Networks

Jim Zhao, Sidak Pal Singh, Aurelien Lucchi

Breaking the False Sense of Security in Backdoor Defense through Re-Activation Attack

Mingli Zhu, Siyuan Liang, Baoyuan Wu

Graph Coarsening with Message-Passing Guarantees

Antonin Joly, Nicolas Keriven

Calibrating Reasoning in Language Models with Internal Consistency

Zhihui Xie, Jizhou Guo, Tong Yu, Shuai Li

Agent Planning with World Knowledge Model

Shuofei Qiao, Runnan Fang, Ningyu Zhang, YUQI ZHU, Xiang Chen

Large language model validity via enhanced conformal prediction methods

John J. Cherian, Isaac Gibbs, Emmanuel J. Candès

Off to new Shores: A Dataset & Benchmark for (near-)coastal Flood Inundation Forecasting

Brandon Victor, Mathilde Letard, Peter Naylor, Karim Douch, Nicolas Longépé

Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation

Wangbo Zhao, Jiasheng Tang, Yizeng Han, Yibing Song, Kai Wang

A PID Controller Approach for Adaptive Probability-dependent Gradient Decay in Model Calibration

Siyuan Zhang, Linbo Xie

Provable Benefit of Cutout and CutMix for Feature Learning

Junsoo Oh, Chulhee Yun

Multi-Group Proportional Representation in Retrieval

Alex Oesterling, Claudio Mayrink Verdun, Carol Xuan Long, Alexander Glynn, Lucas Monteiro Paes

Diffusion Tuning: Transferring Diffusion Models via Chain of Forgetting

Jincheng Zhong, Xingzhuo Guo, Jiaxiang Dong, Mingsheng Long

Q-VLM: Post-training Quantization for Large Vision-Language Models

Changyuan Wang, Ziwei Wang, Xiuwei Xu, Yansong Tang, Jie Zhou

BECAUSE: Bilinear Causal Representation for Generalizable Offline Model-based Reinforcement Learning

Haohong Lin, Wenhao Ding, Jian Chen, Laixi Shi, Jiacheng Zhu

Learning to Solve Quadratic Unconstrained Binary Optimization in a Classification Way

Ming Chen, Jie Chun, Shang Xiang, Luona Wei, Yonghao Du

TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scene

Sandika Biswas, Qianyi Wu, Biplab Banerjee, Hamid Rezatofighi

FIDE: Frequency-Inflated Conditional Diffusion Model for Extreme-Aware Time Series Generation

Asadullah Hill Galib, Pang-Ning Tan, Lifeng Luo

Low-Rank Optimal Transport through Factor Relaxation with Latent Coupling

Peter Halmos, Xinhao Liu, Julian Gold, Benjamin J. Raphael

BAN: Detecting Backdoors Activated by Adversarial Neuron Noise

Xiaoyun Xu, Zhuoran Liu, Stefanos Koffas, Shujian Yu, Stjepan Picek

Artemis: Towards Referential Understanding in Complex Videos

Jihao Qiu, yuan zhang, Xi Tang, Lingxi Xie, Tianren Ma

Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment

Teng Xiao, Yige Yuan, Huaisheng Zhu, Mingxiao Li, Vasant G Honavar

User-item fairness tradeoffs in recommendations

Sophie Greenwood, Sudalakshmee Chiniah, Nikhil Garg

Value Imprint: A Technique for Auditing the Human Values Embedded in RLHF Datasets

Ike Obi, Rohan Pant, Srishti Shekhar Agrawal, Maham Ghazanfar, Aaron Basiletti

Are Self-Attentions Effective for Time Series Forecasting?

Dongbin Kim, Jinseong Park, Jaewook Lee, Hoki Kim

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Chaofan Tao, Qian Liu, Longxu Dou, Niklas Muennighoff, Zhongwei Wan

Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learning

Ronglong Fang, Yuesheng Xu

Implicit Bias of Mirror Flow on Separable Data

Scott Pesme, Radu-Alexandru Dragomir, Nicolas Flammarion

UMFC: Unsupervised Multi-Domain Feature Calibration for Vision-Language Models

Jiachen Liang, Ruibing Hou, Minyang Hu, Hong Chang, Shiguang Shan

SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Prediction

Wei Wu, Xiaoxin Feng, Ziyan Gao, Yuheng Kan

Scaling Sign Language Translation

Biao Zhang, Garrett Tanzer, Orhan Firat

Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers

Haifeng Huang, Yilun Chen, Zehan Wang, Rongjie Huang, Runsen Xu

On the Surprising Effectiveness of Attention Transfer for Vision Transformers

Alexander C. Li, Yuandong Tian, Beidi Chen, Deepak Pathak, Xinlei Chen

Information-theoretic Limits of Online Classification with Noisy Labels

Changlong Wu, Ananth Grama, Wojciech Szpankowski

Spike-based Neuromorphic Model for Sound Source Localization

Dehao Zhang, Shuai Wang, Ammar Belatreche, Wenjie Wei, Yichen Xiao

A Study of Plasticity Loss in On-Policy Deep Reinforcement Learning

Arthur Juliani, Jordan T. Ash

Provable Editing of Deep Neural Networks using Parametric Linear Relaxation

Zhe Tao, Aditya V Thakur, Aditya V. Thakur

Improved Particle Approximation Error for Mean Field Neural Networks

Atsushi Nitanda

Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discovery

Yue Yu, Ning Liu, Fei Lu, Tian Gao, Siavash Jafarzadeh

SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models

Linglan Zhao, Xuerui Zhang, Ke Yan, Shouhong Ding, Weiran Huang

Rad-NeRF: Ray-decoupled Training of Neural Radiance Field

Lidong Guo, Xuefei Ning, Yonggan Fu, Tianchen Zhao, Zhuoliang Kang

Achieving Optimal Clustering in Gaussian Mixture Models with Anisotropic Covariance Structures

Xin Chen, Anderson Ye Zhang

CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

Zirui Wang, Mengzhou Xia, Luxi He, Howard Chen, Yitao Liu

Enhancing Large Language Models through Adaptive Tokenizers

Mengyu Zheng, Hanting Chen, Tianyu Guo, Chong Zhu, Binfan Zheng

Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu

Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation

Shen Yuan, Haotian Liu, Hongteng Xu

Approximating the Top Eigenvector in Random Order Streams

Praneeth Kacham, David P. Woodruff

Understanding the Limits of Vision Language Models Through the Lens of the Binding Problem

Declan Campbell, Sunayana Rane, Tyler Giallanza, Nicolò De Sabbata, Kia Ghods

Exclusively Penalized Q-learning for Offline Reinforcement Learning

Junghyuk Yeom, Yonghyeon Jo, Jungmo Kim, Sanghyeon Lee, Seungyul Han

Copycats: the many lives of a publicly available medical imaging dataset

Amelia Jiménez-Sánchez, Natalia-Rozalia Avlona, Dovile Juodelyte, Théo Sourget, Caroline Vang-Larsen

Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Context

Jingru Jia, Zehua Yuan, Junhao Pan, Paul E. McNamara, Deming Chen

Generalizablity of Memorization Neural Network

Lijia Yu, Xiao-Shan Gao, Lijun Zhang, yibo miao

DeltaDock: A Unified Framework for Accurate, Efficient, and Physically Reliable Molecular Docking

Jiaxian Yan, ZAIXI ZHANG, Jintao Zhu, Kai Zhang, Jianfeng Pei

Learning-Augmented Algorithms for the Bahncard Problem

Hailiang Zhao, Xueyan Tang, Peng Chen, Shuiguang Deng

Oracle-Efficient Differentially Private Learning with Public Data

Adam Block, Mark Bun, Rathin Desai, Abhishek Shetty, Zhiwei Steven Wu

Unsupervised Discovery of Formulas for Mathematical Constants

Michael Shalyt, Uri Seligmann, Itay Beit Halachmi, Ofir David, Rotem Elimelech

ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction

Renze Chen, Zhuofeng Wang, Beiquan Cao, Tong Wu, Size Zheng