NeurIPS 2024

4,493 papers

An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding

Tong Wu, Yanpeng Zhao, Zilong Zheng

Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection

Geng Yu, Jianing Zhu, Jiangchao Yao, Bo Han

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts

Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz

Learning in Markov Games with Adaptive Adversaries: Policy Regret, Fundamental Barriers, and Efficient Algorithms

Thanh Nguyen-Tang, Raman Arora

Rethinking LLM Memorization through the Lens of Adversarial Compression

Avi Schwarzschild, Zhili Feng, Pratyush Maini, Zachary C. Lipton, J. Zico Kolter

Iteratively Refined Behavior Regularization for Offline Reinforcement Learning

Yi Ma, Jianye Hao, Xiaohan Hu, YAN ZHENG, Chenjun Xiao

Large Pre-trained time series models for cross-domain Time series analysis tasks

Harshavardhan Kamarthi, B. Aditya Prakash

FasterDiT: Towards Faster Diffusion Transformers Training without Architecture Modification

Jingfeng Yao, Cheng Wang, Wenyu Liu, Xinggang Wang

Maximum Entropy Reinforcement Learning via Energy-Based Normalizing Flow

Chen-Hao Chao, Chien Feng, Wei-Fang Sun, Cheng-Kuang Lee, Simon See

When to Act and When to Ask: Policy Learning With Deferral Under Hidden Confounding

Marah Ghoummaid, Uri Shalit

Deep Homomorphism Networks

Takanori Maehara, Hoang NT

Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature

Tong Zhou, Xuandong Zhao, Xiaolin Xu, Shaolei Ren

Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study

Sangwon Jung, Sumin Yu, Sanghyuk Chun, Taesup Moon

Piecewise-Stationary Bandits with Knapsacks

Xilin Zhang, Cheung Wang Chi

Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention

Peng Li, Yuan Liu, Xiaoxiao Long, FEIHU ZHANG, Cheng Lin

Towards Robust Multimodal Sentiment Analysis with Incomplete Data

Haoyu Zhang, Wenbin Wang, Tianshu Yu

QWO: Speeding Up Permutation-Based Causal Discovery in LiGAMs

Mohammad Shahverdikondori, Ehsan Mokhtarian, Negar Kiyavash

Online Classification with Predictions

Vinod Raman, Ambuj Tewari

Near-Optimal Dynamic Regret for Adversarial Linear Mixture MDPs

Peng Zhao, Zhi-Hua Zhou, Longfei Li, Long-Fei Li

EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detection

Qinqian Lei, Bo Wang, Robby T. Tan

Disentangled Style Domain for Implicit z-Watermark Towards Copyright Protection

Junqiang Huang, Zhaojun Guo, Ge Luo, Zhenxing Qian, Sheng Li

CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference

Shayan Shekarforoush, David B. Lindell, Marcus A Brubaker, David J Fleet, Marcus A. Brubaker

GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generation

Chubin Zhang, Hongliang Song, Yi Wei, Yu Chen, Jiwen Lu

SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout

Chiyu Max Jiang, Yijing Bai, Andre Cornman, Christopher Davis, Xiukun Huang

emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation

Sasha Salter, Richard Warren, Collin Schlager, Adrian Spurr, Shangchen Han

Preferential Normalizing Flows

Petrus Mikkola, Luigi Acerbi, Arto Klami

Shuffling Gradient-Based Methods for Nonconvex-Concave Minimax Optimization

Trang H. Tran, Lam M. Nguyen, Quoc Tran Dinh, Quoc Tran-Dinh

WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models

Jinghan Jia, Jiancheng Liu, Yihua Zhang, Parikshit Ram, Nathalie Baracaldo

Cascade of phase transitions in the training of energy-based models

Dimitrios Bachtis, Giulio Biroli, Aurélien Decelle, Beatriz Seoane

Selective Explanations

Lucas Monteiro Paes, Dennis Wei, Flavio P. Calmon

Dual Lagrangian Learning for Conic Optimization

Mathieu Tanneau, Pascal Van Hentenryck

Empowering Active Learning for 3D Molecular Graphs with Geometric Graph Isomorphism

Ronast Subedi, Lu Wei, Wenhan Gao, Shayok Chakraborty, Yi Liu

Revisiting Differentially Private ReLU Regression

Meng Ding, Mingxi Lei, Liyang Zhu, Shaowei Wang, Di Wang

DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation

Yuang Ai, Xiaoqiang Zhou, Huaibo Huang, Xiaotian Han, Zhengyu Chen

UAV3D: A Large-scale 3D Perception Benchmark for Unmanned Aerial Vehicles

Hui Ye, Rajshekhar Sunderraman, Shihao Ji

MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer

Minghao Zhu, Zhengpu Wang, Mengxian Hu, Ronghao Dang, Xiao Lin

Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models

Zhengmian Hu, Heng Huang

Towards Understanding the Working Mechanism of Text-to-Image Diffusion Model

Mingyang Yi, Aoxue Li, Yi Xin, Zhenguo Li

When does perceptual alignment benefit vision representations?

Shobhita Sundaram, Stephanie Fu, Lukas Muttenthaler, Netanel Tamir, Lucy Chai

START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformation

Jintao Guo, Lei Qi, Yinghuan Shi, Yang Gao

Recursive Introspection: Teaching Language Model Agents How to Self-Improve

Yuxiao Qu, Tianjun Zhang, Naman Garg, Aviral Kumar

Single Image Reflection Separation via Dual-Stream Interactive Transformers

Qiming Hu, Hainuo Wang, Xiaojie Guo

DECRL: A Deep Evolutionary Clustering Jointed Temporal Knowledge Graph Representation Learning Approach

Qian Chen, Ling Chen

Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data

Seunggeun Chi, Pin-Hao Huang, Enna Sachdeva, Hengbo Ma, Karthik Ramani

Not All Diffusion Model Activations Have Been Evaluated as Discriminative Features

Benyuan Meng, Qianqian Xu, Zitai Wang, Xiaochun Cao, Qingming Huang

FilterNet: Harnessing Frequency Filters for Time Series Forecasting

Kun Yi, Jingru Fei, Qi Zhang, Hui He, Shufeng Hao

Pre-Trained Multi-Goal Transformers with Prompt Optimization for Efficient Online Adaptation

Haoqi Yuan, Yuhui Fu, Feiyang Xie, Zongqing Lu

Abrupt Learning in Transformers: A Case Study on Matrix Completion

Pulkit Gopalani, Ekdeep Singh Lubana, Wei Hu

Distributionally Robust Performative Prediction

Songkai Xue, Yuekai Sun

JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models

Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce

Free-Rider and Conflict Aware Collaboration Formation for Cross-Silo Federated Learning

Mengmeng Chen, Xiaohu Wu, Xiaoli Tang, Tiantian He, Qiqi Liu

DALD: Improving Logits-based Detector without Logits from Black-box LLMs

Cong Zeng, Shengkun Tang, Xianjun Yang, Yuanzhou Chen, Yiyou Sun

FVEL: Interactive Formal Verification Environment with Large Language Models via Theorem Proving

Xiaohan Lin, Qingxing Cao, Yinya Huang, Haiming Wang, Jianqiao Lu

LoRA-GA: Low-Rank Adaptation with Gradient Approximation

Shaowen Wang, Linxi Yu, Jian Li

Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought

Qiguang Chen, Libo Qin, Jiaqi Wang, Jinxuan Zhou, Wanxiang Che

How does Inverse RL Scale to Large State Spaces? A Provably Efficient Approach

Filippo Lazzati, Mirco Mutti, Alberto Maria Metelli

Categorical Flow Matching on Statistical Manifolds

Chaoran Cheng, Jiahan Li, Jian Peng, Ge Liu

Instruction Tuning Large Language Models to Understand Electronic Health Records

Zhenbang Wu, Anant Dadu, Mike Nalls, Faraz Faghri, Jimeng Sun

Taming the Long Tail in Human Mobility Prediction

Xiaohang Xu, Renhe Jiang, Chuang Yang, Zipei Fan, Kaoru Sezaki

USCILab3D: A Large-scale, Long-term, Semantically Annotated Outdoor Dataset

Kiran Lekkala, Henghui Bao, Peixu Cai, Wei Zer Lim, Chen Liu

Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms

Firas Trabelsi, David Vilar, Mara Finkelstein, Markus Freitag

pFedClub: Controllable Heterogeneous Model Aggregation for Personalized Federated Learning

Jiaqi Wang, Qi Li, Lingjuan Lyu, Fenglong Ma

Idiographic Personality Gaussian Process for Psychological Assessment

Yehu Chen, Muchen Xi, Jacob Montgomery, Joshua Jackson, Roman Garnett

PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning

Chengyang Ying, Zhongkai Hao, Xinning Zhou, Xuezhou Xu, Hang Su

Dissecting Query-Key Interaction in Vision Transformers

Xu Pan, Aaron Philip, Ziqian Xie, Odelia Schwartz

NeuralFuse: Learning to Recover the Accuracy of Access-Limited Neural Network Inference in Low-Voltage Regimes

Hao-Lun Sun, Lei Hsiung, Nandhini Chandramoorthy, Pin-Yu Chen, Tsung-Yi Ho

EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views

Yuhang Yang, Wei Zhai, Chengfeng Wang, Chengjun Yu, Yang Cao

What Rotary Position Embedding Can Tell Us: Identifying Query and Key Weights Corresponding to Basic Syntactic or High-level Semantic Information

Yiting Chen, Junchi Yan

ChatCam: Empowering Camera Control through Conversational AI

Xinhang Liu, Yu-Wing Tai, Chi-Keung Tang

APIGen: Automated PIpeline for Generating Verifiable and Diverse Function-Calling Datasets

ZUXIN LIU, Thai Hoang, Jianguo Zhang, Ming Zhu, Tian Lan

Q-Distribution guided Q-learning for offline reinforcement learning: Uncertainty penalized Q-value via consistency model

Jing Zhang, Linjiajie Fang, Kexin Shi, Wenjia Wang, Bing-Yi Jing

BrainBits: How Much of the Brain are Generative Reconstruction Methods Using?

David Mayo, Christopher Wang, Asa Harbin, Abdulrahman Alabdulkareem, Albert Shaw

MILP-StuDio: MILP Instance Generation via Block Structure Decomposition

Haoyang Liu, Jie Wang, Wanbo Zhang, Zijie Geng, Yufei Kuang

Variational Delayed Policy Optimization

Qingyuan Wu, Simon Sinong Zhan, Yixuan Wang, Yuhui Wang, Chung-Wei Lin

Multivariate Probabilistic Time Series Forecasting with Correlated Errors

Vincent Zhihao Zheng, Lijun Sun

Freya PAGE: First Optimal Time Complexity for Large-Scale Nonconvex Finite-Sum Optimization with Heterogeneous Asynchronous Computations

Alexander Tyurin, Kaja Gruntkowska, Peter Richtarik

Can LLMs Implicitly Learn Numeric Parameter Constraints in Data Science APIs?

Yinlin Deng, Chunqiu Steven Xia, Zhezhen Cao, Meiziniu Li, LINGMING ZHANG

Diffusion Actor-Critic with Entropy Regulator

Yinuo Wang, Likun Wang, Yuxuan Jiang, Wenjun Zou, Tong Liu

LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing

Xiaonan Nie, Qibin Liu, Fangcheng Fu, Shenhan Zhu, Xupeng Miao

A Foundation Model for Zero-shot Logical Query Reasoning

Mikhail Galkin, Jincheng Zhou, Bruno Ribeiro, Jian Tang, Zhaocheng Zhu

PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation

Kaidong Zhang, Pengzhen Ren, Bingqian Lin, Junfan Lin, Shikui Ma

Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers

Seunghoon Hong, Donghoon Lee, Dong Hoon Lee

StepbaQ: Stepping backward as Correction for Quantized Diffusion Models

Yi-Chung Chen, Zhi-Kai Huang, Jing-Ren Chen

Transformer Doctor: Diagnosing and Treating Vision Transformers

Jiacong Hu, Hao Chen, Kejia Chen, Yang Gao, Jingwen Ye

Denoising Diffusion Path: Attribution Noise Reduction with An Auxiliary Diffusion Model

Yiming Lei, Zilong Li, Junping Zhang, Hongming Shan

EAI: Emotional Decision-Making of LLMs in Strategic Games and Ethical Dilemmas

Mikhail Mozikov, Nikita Severin, Valeria Bodishtianu, Maria Glushanina, Ivan Nasonov

Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimization

Shutong Ding, Ke Hu, Zhenhao Zhang, Kan Ren, Weinan Zhang

FlexSBDD: Structure-Based Drug Design with Flexible Protein Modeling

ZAIXI ZHANG, Mengdi Wang, Qi Liu

Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes

Syrine Belakaria, Benjamin Letham, Janardhan Rao Doppa, Barbara Engelhardt, Stefano Ermon

Harnessing Multiple Correlated Networks for Exact Community Recovery

Miklós Z. Rácz, Jifan Zhang

HEST-1k: A Dataset For Spatial Transcriptomics and Histology Image Analysis

Guillaume Jaume, Paul Doucet, Andrew H. Song, Ming Y. Lu, Cristina Almagro-Pérez

WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models

Peng Wang, Zexi Li, Ningyu Zhang, Ziwen Xu, Yunzhi Yao

Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception

Shuangpeng Han, Ziyu Wang, Mengmi Zhang

Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling

Yiran Zhao, Wenyue Zheng, Tianle Cai, Xuan Long Do, Kenji Kawaguchi

Unelicitable Backdoors via Cryptographic Transformer Circuits

Andis Draguns, Andrew Gritsevskiy, Sumeet Ramesh Motwani, Christian Schroeder de Witt

Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?

Francesco Innocenti, El Mehdi Achour, Ryan Singh, Christopher L Buckley, Christopher L. Buckley

The State of Data Curation at NeurIPS: An Assessment of Dataset Development Practices in the Datasets and Benchmarks Track

Eshta Bhardwaj, Harshit Gujral, Siyi Wu, Ciara Zogheib, Tegan Maharaj

Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency

Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang

AllClear: A Comprehensive Dataset and Benchmark for Cloud Removal in Satellite Imagery

Hangyu Zhou, Chia-Hsiang Kao, Cheng Perng Phoo, Utkarsh Mall, Bharath Hariharan

Dynamic Service Fee Pricing under Strategic Behavior: Actions as Instruments and Phase Transition

Rui Ai, David Simchi-Levi, Feng Zhu