NeurIPS 2024

4,493 papers

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

Keyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng, Liwei Wang

CultureLLM: Incorporating Cultural Differences into Large Language Models

Cheng Li, Mengzhuo Chen, Jindong Wang, Sunayana Sitaram, Xing Xie

Deep Learning for Computing Convergence Rates of Markov Chains

Yanlin Qu, Jose Blanchet, Peter Glynn

Parameter Competition Balancing for Model Merging

Guodong Du, Junlin Lee, Jing Li, Runhua Jiang, Yifei Guo

MedCalc-Bench: Evaluating Large Language Models for Medical Calculations

Nikhil Khandekar, Qiao Jin, Guangzhi Xiong, Soren Dunn, Serina S Applebaum

Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space

Core Francisco Park, Maya Okawa, Andrew Lee, Hidenori Tanaka, Ekdeep Singh Lubana

Mimicking To Dominate: Imitation Learning Strategies for Success in Multiagent Games

The Viet Bui, Tien Mai, Thanh Hong Nguyen

Hyper-opinion Evidential Deep Learning for Out-of-Distribution Detection

Jingen Qu, Yufei Chen, Xiaodong Yue, Wei Fu, Qiguang Huang

Hybrid Generative AI for De Novo Design of Co-Crystals with Enhanced Tabletability

Nina Gubina, Andrei Dmitrenko, Gleb Solovev, Lyubov Yamshchikova, Oleg Petrov

Don't Compress Gradients in Random Reshuffling: Compress Gradient Differences

Abdurakhmon Sadiev, Grigory Malinovsky, Eduard Gorbunov, Igor Sokolov, Ahmed Khaled

EffiLearner: Enhancing Efficiency of Generated Code via Self-Optimization

Dong Huang, Jianbo Dai, Han Weng, Puzhen Wu, Yuhao Qing

FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic Model

Xiaobao Wu, Thong Nguyen, Delvin Ce Zhang, William Yang Wang, Anh Tuan Luu

Leveraging an ECG Beat Diffusion Model for Morphological Reconstruction from Indirect Signals

Lisa Bedin, Gabriel Cardoso, Josselin Duchateau, Remi Dubois, Eric Moulines

Mind the Gap: A Causal Perspective on Bias Amplification in Prediction & Decision-Making

Drago Plecko, Elias Bareinboim

One-Shot Safety Alignment for Large Language Models via Optimal Dualization

Xinmeng Huang, Shuo Li, Edgar Dobriban, Osbert Bastani, Hamed Hassani

Small coresets via negative dependence: DPPs, linear statistics, and concentration

Rémi Bardenet, Subhroshekhar Ghosh, Hugo Simon-Onfroy, Hoang Son Tran

Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE)

Usha Bhalla, Alex Oesterling, Suraj Srinivas, Flavio P. Calmon, Himabindu Lakkaraju

Information-theoretic Generalization Analysis for Expected Calibration Error

Futoshi Futami, Masahiro Fujisawa

Vision Transformer Neural Architecture Search for Out-of-Distribution Generalization: Benchmark and Insights

Sy-Tuyen Ho, Tuan Van Vo, Somayeh Ebrahimkhani, Ngai-Man Cheung

Dissect Black Box: Interpreting for Rule-Based Explanations in Unsupervised Anomaly Detection

Yu Zhang, Ruoyu Li, Nengwu Wu, Qing Li, Xinhan Lin

PGN: The RNN's New Successor is Effective for Long-Range Time Series Forecasting

Yuxin Jia, Youfang Lin, Jing Yu, Shuo Wang, Tianhao Liu

DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Rendering

Jiahao Lu, Jiacheng Deng, Ruijie Zhu, Yanzhe Liang, Wenfei Yang

Practical Shuffle Coding

Julius Kunze, Daniel Severo, Jan-Willem van de Meent, James Townsend

Learning Disentangled Representations for Perceptual Point Cloud Quality Assessment via Mutual Information Minimization

Ziyu Shan, Yipeng Liu, Yiling Xu, Yu-Jie Zhang, Yujie Zhang

Toward Efficient Inference for Mixture of Experts

Haiyang Huang, Newsha Ardalani, Anna Sun, Liu Ke, Hsien-Hsin S. Lee

Zero-shot Image Editing with Reference Imitation

Xi Chen, Yutong Feng, Mengting Chen, Yiyang Wang, Shilong Zhang

Phased Consistency Models

Fu-Yun Wang, Zhaoyang Huang, Alexander William Bergman, Dazhong Shen, peng gao

Achievable distributional robustness when the robust risk is only partially identified

Julia Kostin, Nicola Gnecco, Fanny Yang

Towards training digitally-tied analog blocks via hybrid gradient computation

Timothy Nest, Maxence Ernoult

Guided Trajectory Generation with Diffusion Models for Offline Model-based Optimization

Taeyoung Yun, Sujin Yun, Jaewoo Lee, Jinkyoo Park

Understanding and Minimising Outlier Features in Transformer Training

Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

How Does Variance Shape the Regret in Contextual Bandits?

Zeyu Jia, Jian Qian, Alexander Rakhlin, Chen-Yu Wei

Cross-model Control: Improving Multiple Large Language Models in One-time Training

Jiayi Wu, Hao Sun, Hengyi Cai, Lixin Su, Shuaiqiang Wang

On the Stability and Generalization of Meta-Learning

Yunjuan Wang, Raman Arora

The Value of Reward Lookahead in Reinforcement Learning

Nadav Merlis, Dorian Baudry, Vianney Perchet

Multi-language Diversity Benefits Autoformalization

Albert Q. Jiang, Wenda Li, Mateja Jamnik

Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation

Sahar Abdelnabi, Amr Gomaa, Sarath Sivaprasad, Lea Schönherr, Mario Fritz

ClavaDDPM: Multi-relational Data Synthesis with Cluster-guided Diffusion Models

Wei Pang, Masoumeh Shafieinejad, Lucy Liu, Stephanie Hazlewood, Xi He

Improving Equivariant Model Training via Constraint Relaxation

Stefanos Pertigkiozoglou, Evangelos Chatzipantazis, Shubhendu Trivedi, Kostas Daniilidis

SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models

Yu Yang, Siddhartha Mishra, Jeffrey Chiang, Baharan Mirzasoleiman

TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks

Benjamin Feuer, Robin Tibor Schirrmeister, Valeriia Cherepanova, Chinmay Hegde, Frank Hutter

Model Reconstruction Using Counterfactual Explanations: A Perspective From Polytope Theory

Pasan Dissanayake, Sanghamitra Dutta

Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models

Yuxin Wen, Leo Marchyok, Sanghyun Hong, Jonas Geiping, Tom Goldstein

Improving Alignment and Robustness with Circuit Breakers

Andy Zou, Long Phan, Justin Wang, Derek Duenas, Maxwell Lin

Scaling Law for Time Series Forecasting

Jingzhe Shi, Qinwei Ma, Huan Ma, Lei Li

Trajectory Data Suffices for Statistically Efficient Learning in Offline RL with Linear q^π-Realizability and Concentrability

Volodymyr Tkachuk, Gellert Weisz, Csaba Szepesvári

Fairness-Aware Meta-Learning via Nash Bargaining

Yi Zeng, Xuelin Yang, Li Chen, Cristian Canton Ferrer, Ming Jin

Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset

Alexandre Galashov, Michalis K. Titsias, András György, Clare Lyle, Razvan Pascanu

AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenario

Yuhan Li, Hao Zhou, Wenxiang Shang, Ran Lin, Xuanhong Chen

Towards a theory of how the structure of language is acquired by deep neural networks

Francesco Cagnetta, Matthieu Wyart

Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models

Adam Karvonen, Benjamin Wright, Can Rager, Rico Angell, Jannik Brinkmann

Self-supervised Transformation Learning for Equivariant Representations

Jaemyung Yu, Jaehyun Choi, Dong-Jae Lee, HyeongGwon Hong, Junmo Kim

QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion

Yixing Xu, CHAO LI, Dong Li, Xiao Sheng, Fan Jiang

GACL: Exemplar-Free Generalized Analytic Continual Learning

HUIPING ZHUANG, Yizhu Chen, Di Fang, Run He, Kai Tong

Codec Avatar Studio: Paired Human Captures for Complete, Driveable, and Generalizable Avatars

Julieta Martinez, Emily Kim, Javier Romero, Timur Bagautdinov, Shunsuke Saito

Gradient-free Decoder Inversion in Latent Diffusion Models

Seongmin Hong, Suh Yoon Jeon, Kyeonghyun Lee, Ernest K. Ryu, Se Young Chun

SAM-Guided Masked Token Prediction for 3D Scene Understanding

Zhimin Chen, Liang Yang, Yingwei Li, Longlong Jing, Bing Li

Theoretical Investigations and Practical Enhancements on Tail Task Risk Minimization in Meta Learning

Yiqin Lv, Qi Wang, Dong Liang, Zheng Xie

AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents

Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer

Provable Posterior Sampling with Denoising Oracles via Tilted Transport

Joan Bruna, Jiequn Han

Auditing Privacy Mechanisms via Label Inference Attacks

Róbert István Busa-Fekete, Travis Dick, Claudio Gentile, Andres Munoz Medina, Adam Smith

Proving Olympiad Algebraic Inequalities without Human Demonstrations

Chenrui Wei, Mengzhou Sun, Wei Wang

REDUCR: Robust Data Downsampling using Class Priority Reweighting

William Bankes, George Hughes, Ilija Bogunovic, Zi Wang

AFBench: A Large-scale Benchmark for Airfoil Design

Jian Liu, Jianyu Wu, Hairun Xie, Guoqing Zhang, Jing Wang

RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluation

Jeongyeol Kwon, Shie Mannor, Constantine Caramanis, Yonathan Efroni

Customized Multiple Clustering via Multi-Modal Subspace Proxy Learning

Jiawei Yao, Qi Qian, Juhua Hu

CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework

Yiyang Zhao, Yunzhuo Liu, Bo Jiang, Tian Guo

Learning from Noisy Labels via Conditional Distributionally Robust Optimization

Hui GUO, Grace Y. Yi, Boyu Wang

Benchmarking Estimators for Natural Experiments: A Novel Dataset and a Doubly Robust Algorithm

R. Teal Witter, Christopher Musco

Conjugated Semantic Pool Improves OOD Detection with Pre-trained Vision-Language Models

Mengyuan Chen, Junyu Gao, Changsheng Xu

Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms

Dimitri Meunier, Zikai Shen, Mattes Mollenhauer, Arthur Gretton, Zhu Li

Error Correction Output Codes for Robust Neural Networks against Weight-errors: A Neural Tangent Kernel Point of View

Anlan Yu, Shusen Jing, Ning Lyu, Wujie Wen, Zhiyuan Yan

Diffusion Model with Cross Attention as an Inductive Bias for Disentanglement

Tao Yang, Cuiling Lan, Yan Lu, Nanning Zheng

Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training

Yanlai Yang, Matt Jones, Michael C. Mozer, Mengye Ren

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling

Haider Al-Tahan, Quentin Garrido, Randall Balestriero, Diane Bouchacourt, Caner Hazirbas

Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization

Junlin He, Jinxiao Du, Susu Xu, Wei Ma

Leveraging Separated World Model for Exploration in Visually Distracted Environments

Kaichen Huang, Shenghua Wan, Minghao Shao, Hai-Hang Sun, Le Gan

Generalizing CNNs to graphs with learnable neighborhood quantization

Isaac Osafo Nkansah, Neil Gallagher, Ruchi Sandilya, Conor Liston, Logan Grosenick

Sample Complexity of Posted Pricing for a Single Item

Billy Jin, Thomas Kesselheim, Will Ma, Sahil Singla

From Trojan Horses to Castle Walls: Unveiling Bilateral Data Poisoning Effects in Diffusion Models

Zhuoshi Pan, Yuguang Yao, Gaowen Liu, Bingquan Shen, H. Vicky Zhao

RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models

Maya Varma, Jean-Benoit Delbrouck, Zhihong Chen, Akshay Chaudhari, Curtis Langlotz

Promoting Fairness Among Dynamic Agents in Online-Matching Markets under Known Stationary Arrival Distributions

Will Ma, Pan Xu

One-Layer Transformer Provably Learns One-Nearest Neighbor In Context

Zihao Li, Yuan Cao, Cheng Gao, Yihan He, Han Liu

TAPVid-3D: A Benchmark for Tracking Any Point in 3D

Skanda Koppula, Ignacio Rocco, Yi Yang, Joe Heyward, Joao Carreira

Croissant: A Metadata Format for ML-Ready Datasets

Mubashara Akhtar, Omar Benjelloun, Costanza Conforti, Luca Foschini, Pieter Gijsbers

Bayes-optimal learning of an extensive-width neural network from quadratically many samples

Antoine Maillard, Emanuele Troiani, Simon Martin, Lenka Zdeborová, Florent Krzakala

SceneCraft: Layout-Guided 3D Scene Generation

Xiuyu Yang, Yunze Man, Jun-Kun Chen, Yu-Xiong Wang

Input-to-State Stable Coupled Oscillator Networks for Closed-form Model-based Control in Latent Space

Maximilian Stölzle, Cosimo Della Santina

BuckTales: A multi-UAV dataset for multi-object tracking and re-identification of wild antelopes

Hemal Naik, Junran Yang, Dipin Das, Margaret C Crofoot, Akanksha Rathore

Monoculture in Matching Markets

Kenny Peng, Nikhil Garg

Probabilistic Federated Prompt-Tuning with Non-IID and Imbalanced Data

Pei-Yau Weng, Minh Hoang, Lam M. Nguyen, My T. Thai, Tsui-Wei Weng

realSEUDO for real-time calcium imaging analysis

Iuliia Dmitrieva, Sergey Babkin, Adam S Charles, Adam S. Charles

Differentially Private Set Representations

Sarvar Patel, Giuseppe Persiano, Joon Young Seo, Kevin Yeo

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents

Niels Mündler, Mark Niklas Müller, Jingxuan He, Martin Vechev

Higher-Order Causal Message Passing for Experimentation with Complex Interference

Mohsen Bayati, Yuwei Luo, William Overman, Sadegh Shirani, Ruoxuan Xiong

SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM

Ming Nie, Dan Ding, Chunwei Wang, Yuanfan Guo, Jianhua Han

Online Iterative Reinforcement Learning from Human Feedback with General Preference Model

Chenlu Ye, Wei Xiong, Yuheng Zhang, Hanze Dong, Nan Jiang

A Structure-Aware Framework for Learning Device Placements on Computation Graphs

Shukai Duan, Heng Ping, Nikos Kanakaris, Xiongye Xiao, Panagiotis Kyriakis

Mitigating Reward Overoptimization via Lightweight Uncertainty Estimation

Xiaoying Zhang, Jean-Francois Ton, Wei Shen, Hongning Wang, Yang Liu

Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality

Tianle Zhang, Langtian Ma, Yuchen Yan, Yuchen Zhang, Kai Wang