NeurIPS 2024

4,493 papers

SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation

Jonathan Roberts, Kai Han, Neil Houlsby, Samuel Albanie

Efficient Reinforcement Learning by Discovering Neural Pathways

Samin Yeasar Arnob, Riyasat Ohib, Sergey Plis, Amy Zhang, Alessandro Sordoni

HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoid

Xinyu Xu, Yizheng Zhang, Yong-Lu Li, Lei Han, Cewu Lu

Auditing Local Explanations is Hard

Robi Bhattacharjee, Ulrike Von Luxburg

Globally Convergent Variational Inference

Declan McNamara, Jackson Loper, Jeffrey Regier

DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception

Xiaotong Li, Fan Zhang, Haiwen Diao, Yueze Wang, Xinlong Wang

Finding Transformer Circuits With Edge Pruning

Adithya Bhaskar, Alexander Wettig, Dan Friedman, Danqi Chen

ReVideo: Remake a Video with Motion and Content Control

Chong Mou, Mingdeng Cao, Xintao Wang, Zhaoyang Zhang, Ying Shan

Ad Auctions for LLMs via Retrieval Augmented Generation

MohammadTaghi Hajiaghayi, Sebastien Lahaie, Keivan Rezaei, Suho Shin

Fairness and Efficiency in Online Class Matching

MohammadTaghi Hajiaghayi, Shayan Chashm Jahan, Mohammad Sharifi, Suho Shin, Max Springer

Communication Efficient Distributed Training with Distributed Lion

Bo Liu, Lemeng Wu, Lizhang Chen, Kaizhao Liang, Jiaxu Zhu

Learning 3D Equivariant Implicit Function with Patch-Level Pose-Invariant Representation

Xin Hu, Xiaole Tang, Ruixuan Yu, Jian Sun

In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization

Ruiqi Zhang, Jingfeng Wu, Peter L. Bartlett

Cardinality-Aware Set Prediction and Top-k Classification

Corinna Cortes, Anqi Mao, Christopher Mohri, Mehryar Mohri, Yutao Zhong

Inferring stochastic low-rank recurrent neural networks from neural data

Matthijs Pals, A Erdem Sağtekin, Felix Pei, Manuel Gloeckler, Jakob H. Macke

Curriculum Fine-tuning of Vision Foundation Model for Medical Image Classification Under Label Noise

Yeonguk Yu, Minhwan Ko, Sungho Shin, Kangmin Kim, Kyoobin Lee

Interpret Your Decision: Logical Reasoning Regularization for Generalization in Visual Classification

Zhaorui Tan, Xi Yang, Qiufeng Wang, Anh Nguyen, Kaizhu Huang

The Representation Landscape of Few-Shot Learning and Fine-Tuning in Large Language Models

Diego Doimo, Alessandro Serra, Alessio Ansuini, Alberto Cazzaniga

FedAvP: Augment Local Data via Shared Policy in Federated Learning

Minui Hong, Junhyeog Yun, Insu Jeon, Gunhee Kim

Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models

Yilun Jin, Zheng Li, Chenwei Zhang, Tianyu Cao, Yifan Gao

Beyond Efficiency: Molecular Data Pruning for Enhanced Generalization

Dingshuo Chen, Zhixun Li, Yuyan Ni, Guibin Zhang, Ding Wang

Towards Learning Group-Equivariant Features for Domain Adaptive 3D Detection

Sangyun Shin, Yuhang He, Madhu Vankadari, Ta-Ying Cheng, Qian Xie

SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations

Sri Harsha Dumpala, Aman Jaiswal, Chandramouli Sastry, Evangelos Milios, Sageev Oore

Recursive PAC-Bayes: A Frequentist Approach to Sequential Prior Updates with No Information Loss

Yi-Shan Wu, Yijie Zhang, Badr-Eddine Chérief-Abdellatif, Yevgeny Seldin

Addressing Spatial-Temporal Heterogeneity: General Mixed Time Series Analysis via Latent Continuity Recovery and Alignment

Jiawei Chen, Chunhui Zhao

Fairness-Aware Estimation of Graphical Models

Zhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou, Qi Long, Li Shen

Mars: Situated Inductive Reasoning in an Open-World Environment

Xiaojuan Tang, Jiaqi Li, Yitao Liang, Song-chun Zhu, Muhan Zhang

Fixed Confidence Best Arm Identification in the Bayesian Setting

Kyoungseok Jang, Junpei Komiyama, Kazutoshi Yamazaki

Multiview Scene Graph

Juexiao Zhang, Gao Zhu, Sihang Li, Xinhao Liu, Haorui Song

From an Image to a Scene: Learning to Imagine the World from a Million 360° Videos

Matthew Wallingford, Anand Bhattad, Aditya Kusupati, Vivek Ramanujan, Matt Deitke

Combining Observational Data and Language for Species Range Estimation

Max Hamilton, Christian Lange, Elijah Cole, Alexander Shepard, Samuel Heinrich

Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model

Haogeng Liu, Quanzeng You, Xiaotian Han, Yongfei Liu, Huaibo Huang

Bayesian-guided Label Mapping for Visual Reprogramming

Chengyi Cai, Zesheng Ye, Lei Feng, Jianzhong Qi, Feng Liu

Banded Square Root Matrix Factorization for Differentially Private Model Training

Nikita Kalinin, Christoph Lampert

CLIPAway: Harmonizing focused embeddings for removing objects via diffusion models

Yiğit Ekin, Ahmet Burak Yildirim, Erdem Eren Caglar, Aykut Erdem, Erkut Erdem

PERIA: Perceive, Reason, Imagine, Act via Holistic Language and Vision Planning for Manipulation

Fei Ni, Jianye Hao, Shiguang Wu, Longxin Kou, Yifu Yuan

Toxicity Detection for Free

Zhanhao Hu, Julien Piet, Geng Zhao, Jiantao Jiao, David Wagner

ESPACE: Dimensionality Reduction of Activations for Model Compression

Charbel Sakr, Brucek Khailany

Locating What You Need: Towards Adapting Diffusion Models to OOD Concepts In-the-Wild

Jianan Yang, Chenchao Gao, Zhiqing Xiao, Junbo Zhao, Sai Wu

The Map Equation Goes Neural: Mapping Network Flows with Graph Neural Networks

Christopher Blöcker, Chester Tan, Ingo Scholtes

Learning Discrete Latent Variable Structures with Tensor Rank Conditions

Zhengming Chen, Ruichu Cai, Feng Xie, Jie Qiao, Anpeng Wu

Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detection

Jiaxu Leng, Zhanjie Wu, Mingpi Tan, Yiran Liu, Ji Gan

Policy Optimization for Robust Average Reward MDPs

Zhongchang Sun, Sihong He, Fei Miao, Shaofeng Zou

Preference-based Pure Exploration

Apurv Shukla, Debabrota Basu

Incremental Learning of Retrievable Skills For Efficient Continual Task Adaptation

Daehee Lee, Minjong Yoo, Woo Kyung Kim, wonje choi, Honguk Woo

Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation

shangding gu, Laixi Shi, Yuhao Ding, Alois Knoll, Costas Spanos

Supra-Laplacian Encoding for Transformer on Dynamic Graphs

Yannis Karmim, Marc Lafon, Raphaël Fournier S'niehotta, Nicolas Thome

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset

Juntao Dai, Tianle Chen, Xuyao Wang, Ziran Yang, Taiye Chen

A Globally Optimal Portfolio for m-Sparse Sharpe Ratio Maximization

Yizun Lin, Zhao-Rong Lai, Cheng Li

Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models

Jiahao Ying, Yixin Cao, Yushi Bai, Qianru Sun, Bo Wang

Abstract Reward Processes: Leveraging State Abstraction for Consistent Off-Policy Evaluation

Shreyas Chaudhari, Ameet Deshpande, Bruno Castro da Silva, Philip S. Thomas

NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples

Baiqi Li, Zhiqiu Lin, WENXUAN PENG, Jean de Dieu Nyandwi, Daniel Jiang

Real-Time Recurrent Learning using Trace Units in Reinforcement Learning

Esraa Elelimy, Adam White, Michael Bowling, Martha White

GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages

Amir Hossein Kargaran, François Yvon, Hinrich Schütze

Ordered Momentum for Asynchronous SGD

Chang-Wei Shi, Yi-Rui Yang, Wu-jun Li

Zero-Shot Reinforcement Learning from Low Quality Data

Scott Jeen, Tom Bewley, Jonathan M. Cullen

Enhancing Preference-based Linear Bandits via Human Response Time

Shen Li, Yuyang Zhang, Zhaolin Ren, Claire Liang, Na Li

Non-asymptotic Global Convergence Analysis of BFGS with the Armijo-Wolfe Line Search

Qiujiang Jin, Ruichen Jiang, Aryan Mokhtari

Non-geodesically-convex optimization in the Wasserstein space

Hoang Phuc Hau Luu, Hanlin Yu, Bernardo Williams, Petrus Mikkola, Marcelo Hartmann

ST$_k$: A Scalable Module for Solving Top-k Problems

Hanchen Xia, Weidong Liu, Xiaojun Mao

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks

Yang Li, Shaobo Han, Shihao Ji

Loki: Low-rank Keys for Efficient Sparse Attention

Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, Abhinav Bhatele

Implicit Regularization of Decentralized Gradient Descent for Sparse Regression

Tongle Wu, Ying Sun

LVD-2M: A Long-take Video Dataset with Temporally Dense Captions

Tianwei Xiong, Yuqing Wang, Daquan Zhou, Zhijie Lin, Jiashi Feng

Mercury: A Code Efficiency Benchmark for Code Large Language Models

Mingzhe Du, Luu Anh Tuan, Bin Ji, Qian Liu, See-Kiong Ng

On the Noise Robustness of In-Context Learning for Text Generation

Hongfu Gao, Feipeng Zhang, Wenyu Jiang, Jun Shu, Feng Zheng

Learning Mixtures of Unknown Causal Interventions

Abhinav Kumar, Kirankumar Shiragur, Caroline Uhler

4+3 Phases of Compute-Optimal Neural Scaling Laws

Elliot Paquette, Courtney Paquette, Lechao Xiao, Jeffrey Pennington

Linear Uncertainty Quantification of Graphical Model Inference

Chenghua Guo, Han Yu, Jiaxin Liu, Chao Chen, Qi Li

Are Large-scale Soft Labels Necessary for Large-scale Dataset Distillation?

Lingao Xiao, Yang He

From Unstructured Data to In-Context Learning: Exploring What Tasks Can Be Learned and When

Kevin Christian Wibisono, Yixin Wang

SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices

Ruslan Svirschevski, Avner May, Zhuoming Chen, Beidi Chen, Zhihao Jia

The Secretary Problem with Predicted Additive Gap

Alexander Braun, Sherry Sarkar

Cryptographic Hardness of Score Estimation

Min Jae Song

Text to Blind Motion

Hee Jae Kim, Kathakoli Sengupta, Masaki Kuribayashi, Hernisa Kacorri, Eshed Ohn-Bar

Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control

Zhengfei Kuang, Shengqu Cai, Hao He, Yinghao Xu, hongsheng Li

Melting Pot Contest: Charting the Future of Generalized Cooperative Intelligence

Rakshit S Trivedi, Akbir Khan, Jesse Clifton, Lewis Hammond, Edgar A. Duéñez-Guzmán

DPIC: Decoupling Prompt and Intrinsic Characteristics for LLM Generated Text Detection

Xiao Yu, Yuang Qi, Kejiang Chen, Guoqiang Chen, Xi Yang

Stability and Generalization of Adversarial Training for Shallow Neural Networks with Smooth Activation

Kaibo Zhang, Yunjuan Wang, Raman Arora

AR-Pro: Counterfactual Explanations for Anomaly Repair with Formal Properties

Xiayan Ji, Anton Xue, Eric Wong, Oleg Sokolsky, Insup Lee

Automated Efficient Estimation using Monte Carlo Efficient Influence Functions

Raj Agrawal, Sam Witty, Andy Zane, Eli Bingham

No Regrets: Investigating and Improving Regret Approximations for Curriculum Discovery

Alex Rutherford, Michael Beukman, Timon Willi, Bruno Lacerda, Nick Hawes

Mixture of Link Predictors on Graphs

Li Ma, Haoyu Han, Juanhui Li, Harry Shomer, Hui LIU

SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Models

Zhaoyang Sun, Shengwu Xiong, Yaxiong Chen, Fei Du, Weihua Chen

Pearls from Pebbles: Improved Confidence Functions for Auto-labeling

Harit Vishwakarma, Yi Chen, Sui Jiet Tay, Satya Sai Srinath Namburi, Frederic Sala

How to Boost Any Loss Function

Richard Nock, Yishay Mansour

Embedding-Aligned Language Models

Guy Tennenholtz, Yinlam Chow, Chih-wei Hsu, Lior Shani, Ethan Liang

Observational Scaling Laws and the Predictability of Langauge Model Performance

Yangjun Ruan, Tatsunori Hashimoto, Chris J Maddison, Chris J. Maddison

Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack

Xiaoyue Xu, Qinyuan Ye, Xiang Ren

Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Joanna Matthiesen, Kevin Smith

EEVR: A Dataset of Paired Physiological Signals and Textual Descriptions for Joint Emotion Representation Learning

Pragya Singh, Ritvik Budhiraja, Ankush Gupta, Anshul Goswami, Mohan Kumar

Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Control

Yuxin Xiao, Chaoqun Wan, Yonggang Zhang, Wenxiao Wang, Binbin Lin

Can Large Language Model Agents Simulate Human Trust Behavior?

Feiran Jia, Ziyu Ye, Shiyang Lai, Kai Shu, Jindong Gu

MTGS: A Novel Framework for Multi-Person Temporal Gaze Following and Social Gaze Prediction

Anshul Gupta, Samy Tafasca, Arya Farkhondeh, Pierre Vuillecard, Jean-Marc Odobez

HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis

Shraddha Barke, Emmanuel Anaya Gonzalez, Saketh Ram Kasibatla, Taylor Berg-Kirkpatrick, Nadia Polikarpova

FasMe: Fast and Sample-efficient Meta Estimator for Precision Matrix Learning in Small Sample Settings

Xiao Tan, Yiqin Wang, Yangyang Shen, Dian Shen, Meng Wang

CoBo: Collaborative Learning via Bilevel Optimization

Diba Hashemi, Lie He, Martin Jaggi

FT-AED: Benchmark Dataset for Early Freeway Traffic Anomalous Event Detection

Austin Coursey, Junyi Ji, Marcos Quinones-Grueiro, William Barbour, Yuhang Zhang

Coevolving with the Other You: Fine-Tuning LLM with Sequential Cooperative Multi-Agent Reinforcement Learning

Hao Ma, Tianyi Hu, Zhiqiang Pu, Boyin Liu, Xiaolin Ai

Improving Linear System Solvers for Hyperparameter Optimisation in Iterative Gaussian Processes

Jihao Andreas Lin, Shreyas Padhy, Bruno Mlodozeniec, Javier Antoran, José Miguel Hernández-Lobato