NeurIPS 2024

4,493 papers

Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions

Zhe Hu, Tuo Liang, Jing Li, Yiren Lu, Yunlai Zhou

WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models

Liwei Jiang, Kavel Rao, Seungju Han, Allyson Ettinger, Faeze Brahman

Generalizable Person Re-identification via Balancing Alignment and Uniformity

Yoonki Cho, Jaeyoon Kim, Woo Jae Kim, Junsik Jung, Sung-eui Yoon

Metric Transforms and Low Rank Representations of Kernels for Fast Attention

Timothy Chu, Josh Alman, Gary Miller, Shyam Narayanan, Mark Sellke

Model Collapse Demystified: The Case of Regression

Elvis DOHMATOB, Yুনzhen Feng, Julia Kempe

Exploring Molecular Pretraining Model at Scale

Xiaohong Ji, Zhen Wang, Zhifeng Gao, Hang Zheng, Linfeng Zhang

RGFN: Synthesizable Molecular Generation Using GFlowNets

Michał Koziarski, Andrei Rekesh, Dmytro Shevchuk, Almer van der Sloot, Piotr Gaiński

Grasp as You Say: Language-guided Dexterous Grasp Generation

Yi-Lin Wei, Jian-Jian Jiang, Chengyi Xing, Xian-Tuo Tan, Xiao-ming Wu

Theoretical Analysis of Weak-to-Strong Generalization

Hunter Lang, David Sontag, Aravindan Vijayaraghavan

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Hugh Zhang, Jeff Da, Dean Lee, Vaughn Robinson, Catherine Wu

Zero-Shot Tokenizer Transfer

Benjamin Minixhofer, Edoardo M. Ponti, Ivan Vulić

2D-OOB: Attributing Data Contribution Through Joint Valuation Framework

Yifan Sun, Jingyan Shen, Yongchan Kwon

Gradient-based Discrete Sampling with Automatic Cyclical Scheduling

Patrick Pynadath, Riddhiman Bhattacharya, Arun Hariharan, Ruqi Zhang

Loss Landscape Characterization of Neural Networks without Over-Parametrization

Rustem Islamov, Niccoló Ajroldi, Antonio Orvieto, Aurelien Lucchi

AlterMOMA: Fusion Redundancy Pruning for Camera-LiDAR Fusion Models with Alternative Modality Masking

Shiqi Sun, Yantao Lu, Ning Liu, Bo Jiang, Jinchao Chen

Grounded Answers for Multi-agent Decision-making Problem through Generative World Model

Zeyang Liu, Xinrui Yang, Shiguang Sun, Long Qian, Lipeng Wan

ReFIR: Grounding Large Restoration Models with Retrieval Augmentation

Hang Guo, Tao Dai, Zhihao Ouyang, Taolin Zhang, Yaohua Zha

MARVEL: Multidimensional Abstraction and Reasoning through Visual Evaluation and Learning

Yifan Jiang, Jiarui Zhang, Kexuan Sun, Zhivar Sourati, Kian Ahrabian

Pipeline Parallelism with Controllable Memory

Penghui Qi, Xinyi Wan, Nyamdavaa Amar, Min Lin

How does Gradient Descent Learn Features --- A Local Analysis for Regularized Two-Layer Neural Networks

Mo Zhou, Rong Ge

II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Models

Ziqiang Liu, Feiteng Fang, Xi Feng, Xinrun Du, Chenhao Zhang

Private and Personalized Frequency Estimation in a Federated Setting

Amrith Setlur, Vitaly Feldman, Kunal Talwar

A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets

Kyungeun Lee, Wonjong Rhee

Goal Conditioned Reinforcement Learning for Photo Finishing Tuning

Jiarui Wu, Yujin Wang, Lingen Li, Fan Zhang, Tianfan Xue

Private Geometric Median

Mahdi Haghifam, Thomas Steinke, Jonathan Ullman

Text-Aware Diffusion for Policy Learning

Calvin Luo, Mandy He, Zilai Zeng, Chen Sun

SparseLLM: Towards Global Pruning of Pre-trained Language Models

Guangji Bai, Yijiang Li, Chen Ling, Kibaek Kim, Liang Zhao

Learning to Understand: Identifying Interactions via the Möbius Transform

Justin Singh Kang, Yigit Efe Erginbas, Landon Butler, Ramtin Pedarsani, Kannan Ramchandran

BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Models

Fangyikang Wang, Hubery Yin, Yuejiang Dong, Huminhao Zhu, Chao Zhang

Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis

Hongru Yang, Bhavya Kailkhura, Zhangyang Wang, Yingbin Liang

FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributions

Anuroop Sriram, Benjamin Kurt Miller, Ricky T. Q. Chen, Brandon M. Wood

Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasets

Wolfgang Boettcher, Lukas Hoyer, Ozan Unal, Jan Eric Lenssen, Bernt Schiele

Goal-Conditioned On-Policy Reinforcement Learning

Xudong Gong, Dawei Feng, Kele Xu, Bo Ding, Huaimin Wang

Diversify, Contextualize, and Adapt: Efficient Entropy Modeling for Neural Image Codec

Jun-Hyuk Kim, Seungeon Kim, Won-Hee Lee, Dokwan Oh

Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion

Zhiwei Bai, Jiajie Zhao, Yaoyu Zhang

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion

Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu

Questioning the Survey Responses of Large Language Models

Ricardo Dominguez-Olmedo, Moritz Hardt, Celestine Mendler-Dünner

MMSite: A Multi-modal Framework for the Identification of Active Sites in Proteins

Song Ouyang, Huiyu Cai, Yong Luo, Kehua Su, Lefei Zhang

Federated Transformer: Multi-Party Vertical Federated Learning on Practical Fuzzily Linked Data

Zhaomin Wu, Junyi Hou, Yiqun Diao, Bingsheng He

Are More LLM Calls All You Need? Towards the Scaling Properties of Compound AI Systems

Lingjiao Chen, Jared Davis, Boris Hanin, Peter Bailis, Ion Stoica

In-N-Out: Lifting 2D Diffusion Prior for 3D Object Removal via Tuning-Free Latents Alignment

Dongting Hu, Huan Fu, Jiaxian Guo, Liuhua Peng, Tingjin Chu

DEL: Discrete Element Learner for Learning 3D Particle Dynamics with Neural Rendering

Jiaxu Wang, Jingkai Sun, Junhao He, Ziyi Zhang, Qiang Zhang

PLIP: Language-Image Pre-training for Person Representation Learning

Jialong Zuo, Jiahao Hong, Feng Zhang, Changqian Yu, Hanyu Zhou

Adaptive Important Region Selection with Reinforced Hierarchical Search for Dense Object Detection

Dingrong Wang, Hitesh Sapkota, Qi Yu

HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach

Maxim Nikolaev, Mikhail Kuznetsov, Dmitry Vetrov, Aibek Alanov

Flaws can be Applause: Unleashing Potential of Segmenting Ambiguous Objects in SAM

Chenxin Li, Yuzhi Huang, Wuyang Li, Hengyu Liu, Xinyu Liu

From Instance Training to Instruction Learning: Task Adapters Generation from Instructions

Huanxuan Liao, Shizhu He, Yao Xu, Yuanzhe Zhang, Yanchao Hao

Enhancing Domain Adaptation through Prompt Gradient Alignment

Hoang Phan, Lam Tran, Quyen Tran, Trung Le

Dual-frame Fluid Motion Estimation with Test-time Optimization and Zero-divergence Loss

Yifei Zhang, Huan-ang Gao, Zhou Jiang, Hao Zhao

A versatile informative diffusion model for single-cell ATAC-seq data generation and analysis

Lei Huang, Lei Xiong, Na Sun, Zunpeng Liu, Ka-Chun Wong

Gradient-Free Methods for Nonconvex Nonsmooth Stochastic Compositional Optimization

Zhuanghua Liu, Luo Luo, Bryan Kian Hsiang Low

GraphCroc: Cross-Correlation Autoencoder for Graph Structural Reconstruction

Shijin Duan, Ruyi Ding, Jiaxing He, Aidong Adam Ding, Yunsi Fei

Learning Noisy Halfspaces with a Margin: Massart is No Harder than Random

Gautam Chandrasekaran, Vasilis Kontonis, Konstantinos Stavropoulos, Kevin Tian

Can Language Models Learn to Skip Steps?

Tengxiao Liu, Qipeng Guo, Xiangkun Hu, Cheng Jiayang, Yue Zhang

Biologically Inspired Learning Model for Instructed Vision

Roy Abel, Shimon Ullman

Transferable Boltzmann Generators

Leon Klein, Frank Noe

4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models

Heng Yu, Chaoyang Wang, Peiye Zhuang, Willi Menapace, Aliaksandr Siarohin

Continuous Spatiotemporal Events Decoupling through Spike-based Bayesian Computation

Yajing Zheng, Jiyuan Zhang, Zhaofei Yu, Tiejun Huang

ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models

Mingrui Wu, Xinyue Cai, Jiayi Ji, Jiale Li, Oucheng Huang

Large Scale Transfer Learning for Tabular Data via Language Modeling

Josh Gardner, Juan C. Perdomo, Ludwig Schmidt

An Accelerated Gradient Method for Convex Smooth Simple Bilevel Optimization

Jincheng Cao, Ruichen Jiang, Erfan Yazdandoost Hamedani, Aryan Mokhtari

A Motion-aware Spatio-temporal Graph for Video Salient Object Ranking

Hao Chen, Yufei Zhu, Yongjian Deng

EM Distillation for One-step Diffusion Models

Sirui Xie, Zhisheng Xiao, Diederik P. Kingma, Tingbo Hou, Ying Nian Wu

Reliable Learning of Halfspaces under Gaussian Marginals

Ilias Diakonikolas, Lisheng Ren, Nikos Zarifis

The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning

Ruben Ohana, Michael McCabe, Lucas Meyer, Rudy Morel, Fruzsina J. Agocs

FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge

Hanzhe Li, Jiaran Zhou, Yuezun Li, Baoyuan Wu, Bin Li

Data-faithful Feature Attribution: Mitigating Unobservable Confounders via Instrumental Variables

Qiheng Sun, Haocheng Xia, Jinfei Liu

R$^2$-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction

Ruyi Zha, Tao Jun Lin, Yuanhao Cai, Jiwen Cao, Yanhao Zhang

Poisson Variational Autoencoder

Hadi Vafaii, Dekel Galor, Jacob L. Yates

Meta-DT: Offline Meta-RL as Conditional Sequence Modeling with World Model Disentanglement

Zhi Wang, Li Zhang, Wenhao Wu, Yuanheng Zhu, Dongbin Zhao

Be Confident in What You Know: Bayesian Parameter Efficient Fine-Tuning of Vision Foundation Models

Deep Shankar Pandey, Spandan Pyakurel, Qi Yu

Referring Human Pose and Mask Estimation In the Wild

Bo Miao, Mingtao Feng, Zijie Wu, Mohammed Bennamoun, Yongsheng Gao

Is Programming by Example Solved by LLMs?

Wen-Ding Li, Kevin Ellis

Aligning Individual and Collective Objectives in Multi-Agent Cooperation

Yang Li, Wenhao Zhang, Jianhong Wang, Shao Zhang, Yali Du

Learning to Embed Distributions via Maximum Kernel Entropy

Oleksii Kachaiev, Stefano Recanatesi

Symbolic Regression with a Learned Concept Library

Arya Grayeli, Atharva Sehgal, Omar Costilla-Reyes, Miles Cranmer, Swarat Chaudhuri

DOFEN: Deep Oblivious Forest ENsemble

Kuan-Yu Chen, Ping-Han Chiang, Hsin-Rung Chou, Chih-Sheng Chen, Darby Tien-Hao Chang

Acoustic Volume Rendering for Neural Impulse Response Fields

Zitong Lan, Chenhao Zheng, Zhiwei Zheng, Mingmin Zhao

Parameter-free Clipped Gradient Descent Meets Polyak

Yuki Takezawa, Han Bao, Ryoma Sato, Kenta Niwa, Makoto Yamada

Temporally Consistent Atmospheric Turbulence Mitigation with Neural Representations

Haoming Cai, Jingxi Chen, Brandon Y. Feng, Weiyun Jiang, Mingyang Xie

Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge

Weihua Du, Qiushi Lyu, Jiaming Shan, Zhenting Qi, Hongxin Zhang

Simplifying Constraint Inference with Inverse Reinforcement Learning

Adriana Hugessen, Harley Wiltzer, Glen Berseth

Reimagining Mutual Information for Enhanced Defense against Data Leakage in Collaborative Inference

Lin Duan, Jingwei Sun, Jinyuan Jia, Yiran Chen, Maria Gorlatova

Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems

Bingcong Li, Liang Zhang, Niao He

Diffusing Differentiable Representations

Yash Savani, Marc Finzi, J. Zico Kolter

Multi-Object Hallucination in Vision Language Models

Xuweiyi Chen, Ziqiao Ma, Xuejun Zhang, Sihan Xu, Jianing Yang

MALT Powers Up Adversarial Attacks

Odelia Melamed, Gilad Yehudai, Adi Shamir

Easy2Hard-Bench: Standardized Difficulty Labels for Profiling LLM Performance and Generalization

Mucong Ding, Chenghao Deng, Jocelyn Choo, Zichu Wu, Aakriti Agrawal

Generalized Eigenvalue Problems with Generative Priors

Zhaoqiang Liu, Wen Li, Junren Chen

A Single-Step, Sharpness-Aware Minimization is All You Need to Achieve Efficient and Accurate Sparse Training

Jie Ji, Gen Li, Jingjing Fu, Fatemeh Afghah, Linke Guo

Long-range Meta-path Search on Large-scale Heterogeneous Graphs

CHAO LI, Zijie Guo, Qiuting He, Kun He

Amortized Active Causal Induction with Deep Reinforcement Learning

Yashas Annadani, Panagiotis Tigas, Stefan Bauer, Adam Foster

The GAN is dead; long live the GAN! A Modern GAN Baseline

Yiwen Huang, Aaron Gokaslan, Volodymyr Kuleshov, James Tompkin

SCRREAM : SCan, Register, REnder And Map: A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark

Hyunjun Jung, Weihang Li, Shun-Cheng Wu, William Bittner, Nikolas Brasch

A Closer Look at AUROC and AUPRC under Class Imbalance

Matthew B. McDermott, Haoran Zhang, Lasse Hyldig Hansen, Giovanni Angelotti, Jack Gallifant

OTTER: Effortless Label Distribution Adaptation of Zero-shot Models

Changho Shin, Jitian Zhao, Sonia Cromp, Harit Vishwakarma, Frederic Sala

Aligning Target-Aware Molecule Diffusion Models with Exact Energy Optimization

Siyi Gu, Minkai Xu, Alexander Powers, Weili Nie, Tomas Geffner

Generative Adversarial Model-Based Optimization via Source Critic Regularization

Michael S. Yao, Yimeng Zeng, Hamsa Bastani, Jacob Gardner, James C. Gee

When are dynamical systems learned from time series data statistically accurate?

Jeongjin (Jayjay) Park, Nicole Tianjiao Yang, Nisha Chandramoorthy

Out-of-Distribution Detection with a Single Unconditional Diffusion Model

Alvin Heng, Alexandre H. Thiery, Harold Soh