NeurIPS 2024

4,493 papers

Beyond task diversity: provable representation transfer for sequential multitask linear bandits

Thang Duong, Zhi Wang, Chicheng Zhang

Efficient Temporal Action Segmentation via Boundary-aware Query Voting

peiyao wang, Yuewei Lin, Erik Blasch, Jie Wei, Haibin Ling

To Learn or Not to Learn, That is the Question — A Feature-Task Dual Learning Model of Perceptual Learning

Xiao Liu, Muyang Lyu, Cong Yu, Si Wu

Efficient Sketches for Training Data Attribution and Studying the Loss Landscape

Andrea Schioppa

Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs

Liyi Chen, Panrong Tong, Zhongming Jin, Ying Sun, Jieping Ye

From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimization

Mohammad Pedramfar, Vaneet Aggarwal

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models

Xiang Meng, Kayhan Behdin, Haoyue Wang, Rahul Mazumder

Towards Editing Time Series

Baoyu Jing, Shuqi Gu, Tianyu Chen, Zhiyu Yang, Dongsheng Li

DiffGS: Functional Gaussian Splatting Diffusion

Junsheng Zhou, Weiqi Zhang, Yu-Shen Liu

MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training

Bo Chen, Zhilei Bei, Xingyi Cheng, Pan Li, Jie Tang

Unified Graph Augmentations for Generalized Contrastive Learning on Graphs

Jiaming Zhuo, Yintong Lu, Hui Ning, Kun Fu, bingxin niu

Why the Metric Backbone Preserves Community Structure

Maximilien Dreveton, Charbel Chucri, Matthias Grossglauser, Patrick Thiran

Disentangling Interpretable Factors with Supervised Independent Subspace Principal Component Analysis

Jiayu Su, David A. Knowles, Raul Rabadan

Adjust Pearson's r to Measure Arbitrary Monotone Dependence

Xinbo Ai

Aligning Large Language Models with Representation Editing: A Control Perspective

Lingkai Kong, Haorui Wang, Wenhao Mu, Yuanqi Du, Yuchen Zhuang

Barely Random Algorithms and Collective Metrical Task Systems

Romain Cosson, Laurent Massoulié

Fast Tree-Field Integrators: From Low Displacement Rank to Topological Transformers

Krzysztof Choromanski, Arijit Sehanobish, Somnath Basu Roy Chowdhury, Han Lin, Avinava Dubey

Towards Exact Gradient-based Training on Analog In-memory Computing

Zhaoxian Wu, Tayfun Gokmen, Malte J. Rasch, Tianyi Chen

Fair Online Bilateral Trade

Francois Bachoc, Nicolò Cesa-bianchi, Tommaso Cesari, Roberto Colomboni

TopoFR: A Closer Look at Topology Alignment on Face Recognition

Jun Dan, Yang Liu, Jiankang Deng, Haoyu Xie, Siyuan Li

Differentiable Quantum Computing for Large-scale Linear Control

Connor Clayton, Jiaqi Leng, Gengzhi Yang, Yi-Ling Qiao, Ming C. Lin

Polyhedral Complex Derivation from Piecewise Trilinear Networks

Jin-Hwa Kim

Group Robust Preference Optimization in Reward-free RLHF

Shyam Sundhar Ramesh, Yifan Hu, Iason Chaimalas, Viraj Mehta, Pier Giuseppe Sessa

Generalization Error Bounds for Two-stage Recommender Systems with Tree Structure

Jin Zhang, Ze Liu, Defu Lian, Enhong Chen

Robust and Faster Zeroth-Order Minimax Optimization: Complexity and Applications

Weixin An, Yuanyuan Liu, Fanhua Shang, Hongying Liu

Bridging Gaps: Federated Multi-View Clustering in Heterogeneous Hybrid Views

Xinyue Chen, Yazhou Ren, Jie Xu, Fangfei Lin, Xiaorong Pu

Scaling White-Box Transformers for Vision

Jinrui Yang, Xianhang Li, Druv Pai, Yuyin Zhou, Yi Ma

StackEval: Benchmarking LLMs in Coding Assistance

Nidhish Shah, Zulkuf Genc, Dogu Araci

Learning Discrete Concepts in Latent Hierarchical Models

Lingjing Kong, Guangyi Chen, Biwei Huang, Eric P. Xing, Yuejie Chi

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Edoardo Debenedetti, Javier Rando, Daniel Paleka, Fineas Silaghi, Dragos Albastroiu

D2R2: Diffusion-based Representation with Random Distance Matching for Tabular Few-shot Learning

Ruoxue Liu, Linjiajie Fang, Wenjia Wang, Bing-Yi Jing

$\nabla^2$DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentials

Kuzma Khrabrov, Anton Ber, Artem Tsypin, Konstantin Ushenin, Egor Rumiantsev

Almost-Linear RNNs Yield Highly Interpretable Symbolic Codes in Dynamical Systems Reconstruction

Manuel Brenner, Christoph Jürgen Hemmer, Zahra Monfared, Daniel Durstewitz

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens

Anas Awadalla, Le Xue, Oscar Lo, Manli Shu, Hannah Lee

PuLID: Pure and Lightning ID Customization via Contrastive Alignment

Zinan Guo, Yanze Wu, Zhuowei Chen, Lang Chen, Peng Zhang

Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Models

Yimeng Zhang, Xin Chen, Jinghan Jia, Yihua Zhang, Chongyu Fan

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

Weiyu Guo, Ying Sun, Yijie Xu, Ziyue Qiao, Yongkui Yang

On the Computational Complexity of Private High-dimensional Model Selection

Saptarshi Roy, Zehua Wang, Ambuj Tewari

Benign overfitting in leaky ReLU networks with moderate input dimension

Kedar Karhadkar, Erin George, Michael Murray, Guido Montúfar, Deanna Needell

Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback

Hamish Ivison, Yizhong Wang, Jiacheng Liu, Zeqiu Wu, Valentina Pyatkin

What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights

Xin Wen, Bingchen Zhao, Yilun Chen, Jiangmiao Pang, Xiaojuan Qi

Interpreting Learned Feedback Patterns in Large Language Models

Luke Marks, Amir Abdullah, Clement Neo, Rauno Arike, David Krueger

Learning the Optimal Policy for Balancing Short-Term and Long-Term Rewards

Qinwei Yang, Xueqing Liu, Yan Zeng, Ruocheng Guo, Yang Liu

On the Ability of Developers' Training Data Preservation of Learnware

Hao-Yi Lei, Zhi-Hao Tan, Zhi-Hua Zhou

Bayesian Nonparametrics Meets Data-Driven Distributionally Robust Optimization

Nicola Bariletto, nhật Hồ

Mutli-Armed Bandits with Network Interference

Abhineet Agarwal, Anish Agarwal, Lorenzo Masoero, Justin Whitehouse

Learning to Reason via Program Generation, Emulation, and Search

Nathaniel Weir, Muhammad Khalifa, Linlu Qiu, Orion Weller, Peter Clark

A Phase Transition between Positional and Semantic Learning in a Solvable Model of Dot-Product Attention

Hugo Cui, Freya Behrens, Florent Krzakala, Lenka Zdeborová

Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classification

Yihe Wang, Nan Huang, Taida Li, Yujun Yan, Xiang Zhang

BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity

Zahra Gharaee, Scott C. Lowe, ZeMing Gong, Pablo Millan Arias, Nicholas Pellegrino

Causal discovery with endogenous context variables

Wiebke Günther, Oana-Iuliana Popescu, Martin Rabel, Urmi Ninad, Andreas Gerhardus

Probabilistic Conformal Distillation for Enhancing Missing Modality Robustness

Mengxi Chen, Fei Zhang, Zihua Zhao, Jiangchao Yao, Ya Zhang

Mobility-LLM: Learning Visiting Intentions and Travel Preference from Human Mobility Data with Large Language Models

Letian Gong, Yan Lin, Xinyue Zhang, Yiwen Lu, Xuedi Han

Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction

Xingyu Xu, Yuejie Chi

Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum

Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, Pavan Kumar Anasosalu Vasu, Cem Koc

NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing

Ting-Hsuan Chen, Jiewen Chan, Hau-Shiang Shiu, Shih-Han Yen, Chang-Han Yeh

AUC Maximization under Positive Distribution Shift

Atsutoshi Kumagai, Tomoharu Iwata, Hiroshi Takahashi, Taishi Nishiyama, Yasuhiro Fujiwara

Multistep Distillation of Diffusion Models via Moment Matching

Tim Salimans, Thomas Mensink, Jonathan Heek, Emiel Hoogeboom

Separations in the Representational Capabilities of Transformers and Recurrent Architectures

Satwik Bhattamishra, Michael Hahn, Phil Blunsom, Varun Kanade

Implicitly Guided Design with PropEn: Match your Data to Follow the Gradient

Natasa Tagasovska, Vladimir Gligorijevic, Kyunghyun Cho, Andreas Loukas

Boundary Matters: A Bi-Level Active Finetuning Method

Han Lu, Yichen Xie, Xiaokang Yang, Junchi Yan

On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory

Guhan Chen, Yicheng Li, Qian Lin

WeiPer: OOD Detection using Weight Perturbations of Class Projections

Maximilian Granz, Manuel Heurich, Tim Landgraf

Infinite Limits of Multi-head Transformer Dynamics

Blake Bordelon, Hamza Chaudhry, Cengiz Pehlevan

STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics

Jiawen Chen, Muqing Zhou, Wenrong Wu, Jinwei Zhang, Yun Li

NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates

Hexuan Deng, Wenxiang Jiao, Xuebo Liu, Min Zhang, Zhaopeng Tu

The Dormant Neuron Phenomenon in Multi-Agent Reinforcement Learning Value Factorization

Haoyuan Qin, Chennan Ma, Mian Deng, Zhengzhu Liu, Songzhu Mei

ProSST: Protein Language Modeling with Quantized Structure and Disentangled Attention

Mingchen Li, Yang Tan, Xinzhu Ma, Bozitao Zhong, Huiqun Yu

OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step

Owen Dugan, Donato M. Jiménez-Benetó, Charlotte Loh, Zhuo Chen, Rumen Dangovski

Randomized Strategic Facility Location with Predictions

Eric Balkanski, Vasilis Gkatzelis, Golnoosh Shahkarami

CemiFace: Center-based Semi-hard Synthetic Face Generation for Face Recognition

Zhonglin Sun, Siyang Song, Ioannis Patras, Georgios Tzimiropoulos

Time-Constrained Robust MDPs

Adil Zouitine, David Bertoin, Pierre Clavier, Matthieu Geist, Emmanuel Rachelson

Guiding Neural Collapse: Optimising Towards the Nearest Simplex Equiangular Tight Frame

Evan Markou, Thalaiyasingam Ajanthan, Stephen Gould

LeDex: Training LLMs to Better Self-Debug and Explain Code

Nan Jiang, Xiaopeng Li, Shiqi Wang, Qiang Zhou, Soneya Binta Hossain

Improving robustness to corruptions with multiplicative weight perturbations

Trung Trinh, Markus Heinonen, Luigi Acerbi, Samuel Kaski

Mining and Transferring Feature-Geometry Coherence for Unsupervised Point Cloud Registration

Kezheng Xiong, Haoen Xiang, Qingshan Xu, Chenglu Wen, Siqi Shen

FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learning

Sizhe Liu, Jun Xia, Lecheng Zhang, Yuchen Liu, Yue Liu

Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models

Jiaqi Li, Qianshan Wei, Chuanyi Zhang, Guilin Qi, Miaozeng Du

AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making

Yizhe Huang, Xingbo Wang, Hao Liu, Fanqi Kong, Aoyang Qin

Topological obstruction to the training of shallow ReLU neural networks

Marco Nurisso, Pierrick Leroy, Francesco Vaccarino

Automatic Outlier Rectification via Optimal Transport

Jose Blanchet, JIAJIN LI, Markus Pelger, Greg Zanotti

Quantum Algorithms for Non-smooth Non-convex Optimization

Chengchang Liu, Chaowen Guan, Jianhao He, John C.S. Lui

Extensive-Form Game Solving via Blackwell Approachability on Treeplexes

Darshan Chakrabarti, Julien Grand-Clément, Christian Kroer

Advection Augmented Convolutional Neural Networks

Niloufar Zakariaei, Siddharth Rout, Eldad Haber, Moshe Eliasof

Mean-Field Langevin Dynamics for Signed Measures via a Bilevel Approach

Guillaume Wang, Alireza Mousavi-Hosseini, Lénaïc Chizat

Preference Alignment with Flow Matching

Minu Kim, Yongsik Lee, Sehyeok Kang, Jihwan Oh, Song Chong

FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Models

Rui Hu, Qian He, Gaofeng He, Jiedong Zhuang, Huang Chen

Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasoner

Xing Cui, Peipei Li, Zekun Li, Xuannan Liu, Yueying Zou

Bridging OOD Detection and Generalization: A Graph-Theoretic View

Han Wang, Yixuan Li

3-in-1: 2D Rotary Adaptation for Efficient Finetuning, Efficient Batching and Composability

Baohao Liao, Christof Monz

Is Your LiDAR Placement Optimized for 3D Scene Understanding?

Ye Li, Lingdong Kong, Hanjiang Hu, Xiaohao Xu, Xiaonan Huang

Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences

Grigory Malinovsky, Peter Richtarik, Samuel Horváth, Eduard Gorbunov

Rule Extrapolation in Language Modeling: A Study of Compositional Generalization on OOD Prompts

Anna Mészáros, Szilvia Ujváry, Wieland Brendel, Patrik Reizinger, Ferenc Huszar

What is my quantum computer good for? Quantum capability learning with physics-aware neural networks

Daniel Hothem, Ashe Miller, Timothy Proctor

Algebraic Positional Encodings

Konstantinos Kogkalidis, Jean-Philippe Bernardy, Vikas Garg

Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Coding

Jiewen Yang, Yiqun Lin, Bin Pu, Xiaomeng Li

TACT: Advancing Complex Aggregative Reasoning with Information Extraction Tools

Avi Caciularu, Alon Jacovi, Eyal Ben-David, Sasha Goldshtein, Tal Schuster

OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran, Daria Gitman, Fei Jia

Exploring Behavior-Relevant and Disentangled Neural Dynamics with Generative Diffusion Models

Yule Wang, Chengrui Li, Weihan Li, Anqi Wu

Multistable Shape from Shading Emerges from Patch Diffusion

Xinran Nicole Han, Todd Zickler, Ko Nishino