NeurIPS 2024

4,493 papers

Language Model as Visual Explainer

Xingyi Yang, Xinchao Wang

SpatialRGPT: Grounded Spatial Reasoning in Vision-Language Models

An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang

Feature-Level Adversarial Attacks and Ranking Disruption for Visible-Infrared Person Re-identification

Xi Yang, Huanling liu, De Cheng, Nannan Wang, Xinbo Gao

Metric Flow Matching for Smooth Interpolations on the Data Manifold

Kacper Kapuśniak, Peter Potaptchik, Teodora Reu, Leo Zhang, Alexander Tong

Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration

Wenjie Fu, Huandong Wang, Chen Gao, Guanghua Liu, Yong Li

Optimal Batched Best Arm Identification

Tianyuan Jin, Yu Yang, Jing Tang, Xiaokui Xiao, Pan Xu

CALE: Continuous Arcade Learning Environment

Jesse Farebrother, Pablo Samuel Castro

SeeClear: Semantic Distillation Enhances Pixel Condensation for Video Super-Resolution

Qi Tang, Yao Zhao, Meiqin Liu, Chao Yao

Attack-Aware Noise Calibration for Differential Privacy

Bogdan Kulynych, Juan Felipe Gomez, Georgios Kaissis, Flavio du Pin Calmon, Carmela Troncoso

Neural Combinatorial Optimization for Robust Routing Problem with Uncertain Travel Times

Pei Xiao, Zizhen Zhang, Jinbiao Chen, Jiahai Wang, Zhenzhen Zhang

A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions

Hoonhee Cho, Taewoo Kim, Yuhwan Jeong, Kuk-Jin Yoon

Drago: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimization

Ronak Mehta, Jelena Diakonikolas, Zaïd Harchaoui

To Err Like Human: Affective Bias-Inspired Measures for Visual Emotion Recognition Evaluation

Chenxi Zhao, Jinglei Shi, Liqiang Nie, Jufeng Yang

Can LLMs Solve Molecule Puzzles? A Multimodal Benchmark for Molecular Structure Elucidation

kehan Guo, Bozhao Nan, Yujun Zhou, Taicheng Guo, Zhichun Guo

GV-Rep: A Large-Scale Dataset for Genetic Variant Representation Learning

Zehui Li, Vallijah Subasri, Guy-Bart Stan, Yiren Zhao, Bo Wang

Beating Adversarial Low-Rank MDPs with Unknown Transition and Bandit Feedback

Haolin Liu, Zakaria Mhammedi, Chen-Yu Wei, Julian Zimmert

Understanding Hallucinations in Diffusion Models through Mode Interpolation

Sumukh K Aithal, Pratyush Maini, Zachary C. Lipton, J. Zico Kolter

IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization

Xiaochen Ma, Xuekang Zhu, Lei Su, Bo Du, Zhuohang Jiang

Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps

Benjamin Ellis, Matthew T. Jackson, Andrei Lupu, Alexander D. Goldie, Mattie Fellows

Understanding the Differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks

Jerome Sieber, Carmen Amo Alonso, Alexandre Didier, Melanie N. Zeilinger, Antonio Orvieto

Semantic Density: Uncertainty Quantification for Large Language Models through Confidence Measurement in Semantic Space

Xin Qiu, Risto Miikkulainen

IaC-Eval: A Code Generation Benchmark for Cloud Infrastructure-as-Code Programs

Patrick Tser Jern Kon, Jiachen Liu, Yiming Qiu, Weijun Fan, Ting He

Learning Where to Edit Vision Transformers

Yunqiao Yang, Long-Kai Huang, Shengzhuang Chen, Kede Ma, Ying Wei

Computational Aspects of Bayesian Persuasion under Approximate Best Response

Kunhe Yang, Hanrui Zhang

InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modeling

Yuchun Miao, Sen Zhang, Liang Ding, Rong Bao, Lefei Zhang

Bisimulation Metrics are Optimal Transport Distances, and Can be Computed Efficiently

Sergio Calo, Anders Jonsson, Gergely Neu, Ludovic Schwartz, Javier Segovia-Aguas

Kernel PCA for Out-of-Distribution Detection

Kun Fang, Qinghua Tao, Kexin Lv, Mingzhen He, Xiaolin Huang

ChronoEpilogi: Scalable Time Series Selection with Multiple Solutions

Etienne Vareille, Michele Linardi, Ioannis Tsamardinos, Vassilis Christophides

Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control

Seongwoong Cho, Donggyun Kim, Seunghoon Hong, Jin Woo Lee, Jinwoo Lee

The Benefits of Balance: From Information Projections to Variance Reduction

Lang Liu, Ronak Mehta, Soumik Pal, Zaïd Harchaoui

An Improved Empirical Fisher Approximation for Natural Gradient Descent

Xiaodong Wu, Wenyi Yu, Chao Zhang, Philip Woodland

Certified Adversarial Robustness via Randomized α-Smoothing for Regression Models

Aref Miri Rekavandi, Farhad Farokhi, Olga Ohrimenko, Benjamin I.P. Rubinstein

Hamiltonian Monte Carlo on ReLU Neural Networks is Inefficient

Lam Si Tung Ho, Cuong V. Nguyen, Vu C Dinh, Vu C. Dinh

EDT: An Efficient Diffusion Transformer Framework Inspired by Human-like Sketching

Xinwang Chen, Ning Liu, Yichen Zhu, Feifei Feng, Jian Tang

Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences

Saiyue Lyu, Shadab Shaikh, Frederick Shpilevskiy, Evan Shelhamer, Mathias Lécuyer

SAND: Smooth imputation of sparse and noisy functional data with Transformer networks

Ju-Sheng Hong, Junwen Yao, Jonas Mueller, Jane-Ling Wang

Detecting Bugs with Substantial Monetary Consequences by LLM and Rule-based Reasoning

Brian Zhang, Zhuo Zhang

Exploring the trade-off between deep-learning and explainable models for brain-machine interfaces

Luis H. Cubillos, Guy Revach, Matthew J. Mender, Joseph T. Costello, Hisham Temmar

FedNE: Surrogate-Assisted Federated Neighbor Embedding for Dimensionality Reduction

Ziwei Li, Xiaoqi Wang, Hong-You Chen, Han-Wei Shen, Wei-Lun Chao

Off-policy estimation with adaptively collected data: the power of online learning

Jeonghwan Lee, Cong Ma

Alleviating Distortion in Image Generation via Multi-Resolution Diffusion Models and Time-Dependent Layer Normalization

Qihao Liu, Zhanpeng Zeng, Ju He, Qihang Yu, Xiaohui Shen

DiffuPac: Contextual Mimicry in Adversarial Packets Generation via Diffusion Model

Abdullah Bin Jasni, Akiko Manada, Kohei Watabe

A Practitioner's Guide to Real-World Continual Multimodal Pretraining

Vishaal Udandarao, Karsten Roth, Sebastian Dziadzio, Ameya Prabhu, Mehdi Cherti

Is Multiple Object Tracking a Matter of Specialization?

Gianluca Mancusi, Mattia Bernardi, Aniello Panariello, Angelo Porrello, Rita Cucchiara

Offline Oracle-Efficient Learning for Contextual MDPs via Layerwise Exploration-Exploitation Tradeoff

Jian Qian, Haichen Hu, David Simchi-Levi

Enhancing LLM’s Cognition via Structurization

Kai Liu, Zhihang Fu, Chao Chen, Wei Zhang, Rongxin Jiang

Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity

Haoxuan Chen, Yinuo Ren, Lexing Ying, Grant M. Rotskoff

Uniform Last-Iterate Guarantee for Bandits and Reinforcement Learning

Junyan Liu, Yunfan Li, Ruosong Wang, Lin F. Yang

CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models

Junho Kim, Hyun Jun Kim, Yeon Ju Kim, Yong Man Ro

Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor Generalization

Davide Buffelli, Jamie McGowan, Wangkun Xu, Alexandru Cioba, Da-shan Shiu

Any2Policy: Learning Visuomotor Policy with Any-Modality

Yichen Zhu, Zhicai Ou, Feifei Feng, Jian Tang

EnsIR: An Ensemble Algorithm for Image Restoration via Gaussian Mixture Models

Shangquan Sun, Wenqi Ren, Zikun Liu, Hyunhee Park, Rui Wang

Treatment of Statistical Estimation Problems in Randomized Smoothing for Adversarial Robustness

Václav Voráček

Ex Uno Pluria: Insights on Ensembling in Low Precision Number Systems

Giung Nam, Juho Lee

Large Language Models Play StarCraft II:Benchmarks and A Chain of Summarization Approach

Weiyu Ma, Qirui Mi, Yongcheng Zeng, Xue Yan, Yuqiao Wu

Discrete Flow Matching

Itai Gat, Tal Remez, Neta Shaul, Felix Kreuk, Ricky T. Q. Chen

Classifier-guided Gradient Modulation for Enhanced Multimodal Learning

Zirun Guo, Tao Jin, Jingyuan Chen, Zhou Zhao

3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors

Xi Liu, Chaoyi Zhou, Siyu Huang

Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching

Xinyin Ma, Gongfan Fang, Michael Bi Mi, Xinchao Wang

WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control

Claire Bizon Monroc, Ana Busic, Donatien Dubuc, Jiamin Zhu

Causal Context Adjustment Loss for Learned Image Compression

Minghao Han, Shiyin Jiang, Shengxi Li, Xin Deng, Mai Xu

Benchmarking Counterfactual Image Generation

Thomas Melistas, Nikos Spyrou, Nefeli Gkouti, Pedro Sanchez, Athanasios Vlontzos

Building Timeseries Dataset: Empowering Large-Scale Building Analytics

Arian Prabowo, Xiachong Lin, Imran Razzak, Hao Xue, Emily W. Yap

Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Models

Sujai Hiremath, Jacqueline Maasch, Mengxiao Gao, Promit Ghosal, Kyra Gan

Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation

Anh Bui, Long Vuong, Khanh Doan, Trung Le, Paul Montague

CNCA: Toward Customizable and Natural Generation of Adversarial Camouflage for Vehicle Detectors

Linye Lyu, Jiawei Zhou, Daojing He, Yu Li

Reinforcement Learning Under Latent Dynamics: Toward Statistical and Algorithmic Modularity

Philip Amortila, Nan Jiang, Akshay Krishnamurthy, Zakaria Mhammedi, Dylan J Foster

Entropy testing and its application to testing Bayesian networks

Joy Qiping Yang, Clément L Canonne, Clement L. Canonne

Right this way: Can VLMs Guide Us to See More to Answer Questions?

Li Liu, Diji Yang, Sijia Zhong, Kalyana Suma Sree Tholeti, Lei Ding

FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and Detection

Xinting Liao, Weiming Liu, Pengyang Zhou, Fengyuan Yu, Jiahe Xu

G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering

Xiaoxin He, Yijun Tian, Yifei Sun, Nitesh V. Chawla, Thomas Laurent

Approximating mutual information of high-dimensional variables using learned representations

Gokul Gowri, Xiao-Kang Lun, Allon M. Klein, Peng Yin

MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweeps

Yating Xu, Chen Li, Gim Hee Lee

Near-Minimax-Optimal Distributional Reinforcement Learning with a Generative Model

Mark Rowland, Li Kevin Wenliang, Rémi Munos, Clare Lyle, Yunhao Tang

Towards Understanding Evolving Patterns in Sequential Data

Qiuhao Zeng, Long-Kai Huang, Qi Chen, Charles Ling, Boyu Wang

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

Shuaipeng Li, Penghao Zhao, Hailin Zhang, Xingwu Sun, Hao Wu

EigenVI: score-based variational inference with orthogonal function expansions

Diana Cai, Chirag Modi, Charles C. Margossian, Robert M. Gower, David M. Blei

Nonparametric Evaluation of Noisy ICA Solutions

Syamantak Kumar, Purnamrita Sarkar, Peter Bickel, Derek Bean

DataStealing: Steal Data from Diffusion Models in Federated Learning with Multiple Trojans

Yuan Gan, Jiaxu Miao, Yi Yang

Model Sensitivity Aware Continual Learning

Zhenyi Wang, Heng Huang

Scanning Trojaned Models Using Out-of-Distribution Samples

Hossein Mirzaei, Ali Ansari, Bahar Dibaei Nia, Mojtaba Nafez, Moein Madadi

The iNaturalist Sounds Dataset

Mustafa Chasmai, Alexander Shepard, Subhransu Maji, Grant Van Horn

A Topology-aware Graph Coarsening Framework for Continual Graph Learning

Xiaoxue Han, Zhuo Feng, Yue Ning

Molecule Generation with Fragment Retrieval Augmentation

Seul Lee, Karsten Kreis, Srimukh Prasad Veccham, Meng Liu, Danny Reidenbach

NVRC: Neural Video Representation Compression

Ho Man Kwan, Ge Gao, Fan Zhang, Andrew Gower, David Bull

FUSU: A Multi-temporal-source Land Use Change Segmentation Dataset for Fine-grained Urban Semantic Understanding

Shuai Yuan, Guancong Lin, Lixian Zhang, Runmin Dong, Jinxiao Zhang

Attention boosted Individualized Regression

Guang Yang, Yuan Cao, Long Feng

Fast Graph Sharpness-Aware Minimization for Enhancing and Accelerating Few-Shot Node Classification

Yihong Luo, Yuhan Chen, Siya Qiu, Yiwei Wang, Chen Zhang

Exogenous Matching: Learning Good Proposals for Tractable Counterfactual Estimation

Yikang Chen, Dehui Du, Lili Tian

Universal Sample Coding

Szymon Kobus, Tze-Yang Tung, Deniz Gündüz

Parameter-Inverted Image Pyramid Networks

Xizhou Zhu, Xue Yang, Zhaokai Wang, Hao Li, Wenhan Dou

Scene Graph Generation with Role-Playing Large Language Models

Guikun Chen, Jin Li, Wenguan Wang

Chain of Agents: Large Language Models Collaborating on Long-Context Tasks

Yusen Zhang, Ruoxi Sun, Yanfei Chen, Tomas Pfister, Rui Zhang

Zhicheng Chen, Shibo Feng, Zhong Zhang, Xi Xiao, Xingyu Gao

Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibration

Yuanjie Shi, Subhankar Ghosh, Taha Belkhouja, Janardhan Rao Doppa, Yan Yan

Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution Adaptation

Wenjun Miao, Guansong Pang, Jin Zheng, Xiao Bai

RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees

Xun Xian, Ganghua Wang, Xuan Bi, Jayanth Srinivasa, Ashish Kundu

Hierarchical Object-Aware Dual-Level Contrastive Learning for Domain Generalized Stereo Matching

Yikun Miao, Meiqing Wu, Siew-Kei Lam, Changsheng Li, Thambipillai Srikanthan

Transformers as Game Players: Provable In-context Game-playing Capabilities of Pre-trained Models

Chengshuai Shi, Kun Yang, Jing Yang, Cong Shen

LLaMo: Large Language Model-based Molecular Graph Assistant

Jinyoung Park, Minseong Bae, Dohwan Ko, Hyunwoo J Kim, Hyunwoo J. Kim