NeurIPS 2024

4,493 papers

LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings

Duo Wang, Yuan Zuo, Fengzhi Li, Junjie Wu

End-to-end Learnable Clustering for Intent Learning in Recommendation

Yue Liu, Shihao Zhu, Jun Xia, Yingwei Ma, Jian Ma

Trade-Offs of Diagonal Fisher Information Matrix Estimators

Alexander Soen, Ke Sun

3D Gaussian Rendering Can Be Sparser: Efficient Rendering via Learned Fragment Pruning

Zhifan Ye, Chenxi Wan, Chaojian Li, Jihoon Hong, Sixu Li

Towards Scalable and Stable Parallelization of Nonlinear RNNs

Xavier Gonzalez, Andrew Warrington, Jimmy T.H. Smith, Scott W. Linderman

SuperVLAD: Compact and Robust Image Descriptors for Visual Place Recognition

Feng Lu, Xinyao Zhang, Canming Ye, Shuting Dong, Lijun Zhang

Med-Real2Sim: Non-Invasive Medical Digital Twins using Physics-Informed Self-Supervised Learning

Keying Kuang, Frances Dean, Jack B. Jedlicki, David Ouyang, Anthony Philippakis

Multi-Label Open Set Recognition

Jun-Yi Hang, Min-ling Zhang, Yibo Wang, Yi-Bo Wang

TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment

Wei Li, Hehe Fan, Yongkang Wong, Mohan Kankanhalli, Yi Yang

Hardness of Learning Neural Networks under the Manifold Hypothesis

Bobak T. Kiani, Jason Wang, Melanie Weber

Expressive Gaussian Human Avatars from Monocular RGB Video

Hezhen Hu, Zhiwen Fan, Tianhao Wu, Yihan Xi, Seoyoung Lee

Continuous Partitioning for Graph-Based Semi-Supervised Learning

Chester Holtz, Pengwen Chen, Zhengchao Wan, Chung-Kuan Cheng, Gal Mishne

Learning Representations for Hierarchies with Minimal Support

Benjamin Rozonoyer, Michael Boratko, Dhruvesh Patel, Wenlong Zhao, Shib Dasgupta

Visual Fourier Prompt Tuning

Runjia Zeng, Cheng Han, Qifan Wang, Chunshu Wu, Tong Geng

Schur Nets: exploiting local structure for equivariance in higher order graph neural networks

Qingqi Zhang, Ruize Xu, Risi Kondor

Kaleido Diffusion: Improving Conditional Diffusion Models with Autoregressive Latent Modeling

Jiatao Gu, Ying Shen, Shuangfei Zhai, Yizhe Zhang, Navdeep Jaitly

Can Learned Optimization Make Reinforcement Learning Less Difficult?

Alexander D. Goldie, Chris Lu, Matthew T. Jackson, Shimon Whiteson, Jakob N. Foerster

Self-Refining Diffusion Samplers: Enabling Parallelization via Parareal Iterations

Nikil Roashan Selvam, Amil Merchant, Stefano Ermon

Graph Neural Networks and Arithmetic Circuits

Timon Barlag, Vivian Holzapfel, Laura Strieker, Jonni Virtema, Heribert Vollmer

Fully Explicit Dynamic Gaussian Splatting

Junoh Lee, Changyeon Won, Hyunjun Jung, Inhwan Bae, Hae-Gon Jeon

Can Graph Learning Improve Planning in LLM-based Agents?

Xixi Wu, Yifei Shen, Caihua Shan, Kaitao Song, Siwei Wang

Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound

Reuben Adams, John Shawe-Taylor, Benjamin Guedj

SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigation

Hang Yin, Xiuwei Xu, Zhenyu Wu, Jie Zhou, Jiwen Lu

AGILE: A Novel Reinforcement Learning Framework of LLM Agents

Peiyuan Feng, Yichen He, Guanhua Huang, Yuan Lin, Hanchong Zhang

BackdoorAlign: Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment

Jiongxiao Wang, Jiazhao Li, Yiquan Li, Xiangyu Qi, Junjie Hu

SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models

Jianyi Zhang, Da-Cheng Juan, Cyrus Rashtchian, Chun-Sung Ferng, Heinrich Jiang

COLD: Causal reasOning in cLosed Daily activities

Abhinav Joshi, Areeb Ahmad, Ashutosh Modi

Feedback control guides credit assignment in recurrent neural networks

Klara Kaleb, Barbara Feulner, Juan A. Gallego, Claudia Clopath

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

Vladimir Malinovskii, Denis Mazur, Ivan Ilin, Denis Kuznedelev, Konstantin Burlachenko

HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion

Yu Zeng, Yang Zhang, Jiachen Liu, Linlin Shen, Kaijun Deng

Utilizing Human Behavior Modeling to Manipulate Explanations in AI-Assisted Decision Making: The Good, the Bad, and the Scary

Zhuoyan Li, Ming Yin

IRCAN: Mitigating Knowledge Conflicts in LLM Generation via Identifying and Reweighting Context-Aware Neurons

Dan Shi, Renren Jin, Tianhao Shen, Weilong Dong, Xinwei Wu

FindingEmo: An Image Dataset for Emotion Recognition in the Wild

Laurent Mertens, Elahe' Yargholi, Hans Op de Beeck, Jan Van den Stock, Joost Vennekens

ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing

Jun-Kun Chen, Yu-Xiong Wang

TARSS-Net: Temporal-Aware Radar Semantic Segmentation Network

Youcheng Zhang, Liwen Zhang, Zijun Hu, Pengcheng Pi, Teng Li

Segment, Shuffle, and Stitch: A Simple Layer for Improving Time-Series Representations

Shivam Grover, Amin Jalali, Ali Etemad

HORSE: Hierarchical Representation for Large-Scale Neural Subset Selection

Binghui Xie, Yixuan Wang, Yongqiang Chen, Kaiwen Zhou, Yu Li

Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models

Zhanhui Zhou, Zhixuan Liu, Jie Liu, Zhichen Dong, Chao Yang

Topological Generalization Bounds for Discrete-Time Stochastic Optimization Algorithms

Rayna Andreeva, Benjamin Dupuis, Rik Sarkar, Tolga Birdal, Umut Simsekli

Optimizing over Multiple Distributions under Generalized Quasar-Convexity Condition

Shihong Ding, Long Yang, Luo Luo, Cong Fang

Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers

Xiuying Wei, Skander Moalla, Razvan Pascanu, Caglar Gulcehre

Generative Semi-supervised Graph Anomaly Detection

Hezhe Qiao, Qingsong Wen, Xiaoli Li, Ee-Peng Lim, Guansong Pang

Sparse Bayesian Generative Modeling for Compressive Sensing

Benedikt Böck, Sadaf Syed, Wolfgang Utschick

On Neural Networks as Infinite Tree-Structured Probabilistic Graphical Models

Boyao Li, Alexander J. Thomson, houssam nassif, Matthew M. Engelhard, David Page

Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning

Hang Zhou, Yehui Tang, Haochen Qin, Yujie Yang, Renren Jin

TaskBench: Benchmarking Large Language Models for Task Automation

Yongliang Shen, Kaitao Song, Xu Tan, Wenqi Zhang, Kan Ren

Association Pattern-aware Fusion for Biological Entity Relationship Prediction

Lingxiang Jia, Yuchen Ying, Zunlei Feng, Zipeng Zhong, Shaolun Yao

Weight decay induces low-rank attention layers

Seijin Kobayashi, Yassir Akram, Johannes von Oswald

LAM3D: Large Image-Point Clouds Alignment Model for 3D Reconstruction from Single Image

Ruikai Cui, Xibin Song, Weixuan Sun, Senbo Wang, Weizhe Liu

Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization

Haocheng Luo, Tuan Truong, Tung Pham, Mehrtash Harandi, Dinh Phung

Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attribution

Ian Covert, Su-in Lee, James Zou, Tatsunori Hashimoto, Chan Woo Kim

Revisiting Score Propagation in Graph Out-of-Distribution Detection

Longfei Ma, Yiyou Sun, Kaize Ding, Zemin Liu, Fei Wu

Ordering-Based Causal Discovery for Linear and Nonlinear Relations

Zhuopeng Xu, Yujie Li, Cheng Liu, Ning Gui

Verifiably Robust Conformal Prediction

Linus Jeary, Tom Kuipers, Mehran Hosseini, Nicola Paoletti

CLIPCEIL: Domain Generalization through CLIP via Channel rEfinement and Image-text aLignment

Xi Yu, Shinjae Yoo, Yuewei Lin

Data Attribution for Text-to-Image Models by Unlearning Synthesized Images

Sheng-Yu Wang, Aaron Hertzmann, Jun-Yan Zhu, Richard Zhang, Alexei A Efros

Polynomial-Time Computation of Exact Φ-Equilibria in Polyhedral Games

Gabriele Farina, Charilaos Pipis

MADiff: Offline Multi-agent Learning with Diffusion Models

Zhengbang Zhu, Minghuan Liu, Liyuan Mao, Bingyi Kang, Minkai Xu

FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refiner

Wenliang Zhao, Minglei Shi, Xumin Yu, Jie Zhou, Jiwen Lu

DiffPhyCon: A Generative Approach to Control Complex Physical Systems

Long Wei, Peiyan Hu, Ruiqi Feng, Haodong Feng, Yixuan Du

QueST: Self-Supervised Skill Abstractions for Learning Continuous Control

Atharva Mete, Haotian Xue, Albert Wilcox, Yongxin Chen, Animesh Garg

ReGS: Reference-based Controllable Scene Stylization with Gaussian Splatting

Yiqun Mei, Jiacong Xu, Vishal M. Patel

FUG: Feature-Universal Graph Contrastive Pre-training for Graphs with Diverse Node Features

Jitao Zhao, Di Jin, Meng Ge, Lianze Shan, Xin Wang

A Decision-Language Model (DLM) for Dynamic Restless Multi-Armed Bandit Tasks in Public Health

Nikhil Behari, Edwin Zhang, Yunfan Zhao, Aparna Taneja, Dheeraj Nagaraj

ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization

Huayang Huang, Yu Wu, Qian Wang

LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Models

Seyedmorteza Sadat, Jakob Buhmann, Derek Bradley, Otmar Hilliges, Romann M. Weber

Diffusion-Inspired Truncated Sampler for Text-Video Retrieval

Jiamian Wang, Pichao WANG, Dongfang Liu, Qiang Guan, Sohail Dianat

Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices

Andres Potapczynski, Shikai Qiu, Marc Finzi, Christopher Ferri, Zixi Chen

Flexible Context-Driven Sensory Processing in Dynamical Vision Models

Lakshmi Narasimhan Govindarajan, Abhiram Iyer, Valmiki Kothare, Ila Fiete

Testably Learning Polynomial Threshold Functions

Lucas Slot, Stefan Tiegel, Manuel Wiedmer

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity

Alexander Tyurin, Marta Pozzi, Ivan Ilin, Peter Richtarik

Fair Secretaries with Unfair Predictions

Eric Balkanski, Will Ma, Andreas Maggiori

DiGRAF: Diffeomorphic Graph-Adaptive Activation Function

Krishna Sri Ipsit Mantri, Xinzhi (Aurora) Wang, Carola-Bibiane Schönlieb, Bruno Ribeiro, Beatrice Bevilacqua

Optimizing Automatic Differentiation with Deep Reinforcement Learning

Jamie Lohoff, Emre Neftci

CAT: Coordinating Anatomical-Textual Prompts for Multi-Organ and Tumor Segmentation

Zhongzhen Huang, Yankai Jiang, Rongzhao Zhang, Shaoting Zhang, Xiaofan Zhang

HyperLogic: Enhancing Diversity and Accuracy in Rule Learning with HyperNets

Yang Yang, Wendi Ren, Shuang Li

LT-Defense: Searching-free Backdoor Defense via Exploiting the Long-tailed Effect

Yixiao Xu, Binxing Fang, Mohan Li, Keke Tang, Zhihong Tian

Feint Behaviors and Strategies: Formalization, Implementation and Evaluation

Junyu Liu, Xiangjun Peng

SolarCube: An Integrative Benchmark Dataset Harnessing Satellite and In-situ Observations for Large-scale Solar Energy Forecasting

Ruohan Li, Yiqun Xie, Xiaowei Jia, Dongdong Wang, Yanhua Li

NeuralSolver: Learning Algorithms For Consistent and Efficient Extrapolation Across General Tasks

Bernardo Esteves, Miguel Vasco, Francisco S. Melo

Training for Stable Explanation for Free

Chao Chen, Chenghua Guo, Rufeng Chen, Guixiang Ma, Ming Zeng

Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models

Chengzhengxu Li, Xiaoming Liu, Zhaohan Zhang, Yichen Wang, Chen Liu

Optimal Private and Communication Constraint Distributed Goodness-of-Fit Testing for Discrete Distributions in the Large Sample Regime

Lasse Vuursteen

Unified Insights: Harnessing Multi-modal Data for Phenotype Imputation via View Decoupling

Qiannan Zhang, Weishen Pan, Zilong Bai, Chang Su, Fei Wang

KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization

Tianyi Zhang, Jonah Yi, Zhaozhuo Xu, Anshumali Shrivastava

Warm-up Free Policy Optimization: Improved Regret in Linear Markov Decision Processes

Asaf Cassel, Aviv Rosenberg

Disentangling and mitigating the impact of task similarity for continual learning

Naoki Hiratani

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding

Xiang Li, Jian Ding, Mohamed Elhoseiny

QBB: Quantization with Binary Bases for LLMs

Adrian Bulat, Yassine Ouali, Georgios Tzimiropoulos

Goal Reduction with Loop-Removal Accelerates RL and Models Human Brain Activity in Goal-Directed Learning

Huzi Cheng, Joshua W. Brown

UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflections

Fangjinhua Wang, Marie-Julie Rakotosaona, Michael Niemeyer, Richard Szeliski, Marc Pollefeys

Few-Shot Adversarial Prompt Learning on Vision-Language Models

Yiwei Zhou, Xiaobo Xia, Zhiwei Lin, Bo Han, Tongliang Liu

CARE: a Benchmark Suite for the Classification and Retrieval of Enzymes

Jason Yang, Ariane Mora, Shengchao Liu, Bruce J. Wittmann, Anima Anandkumar

UltraEdit: Instruction-based Fine-Grained Image Editing at Scale

Haozhe Zhao, Xiaojian Ma, Liang Chen, Shuzheng Si, Rujie Wu

Mutual Information Estimation via Normalizing Flows

Butakov I. D., Tolmachev A. D., Malanchuk S. V., Neopryatnaya A. M., Frolov A. A.

Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator

Siyuan Xu, Minghui Zhu

A Hitchhiker's Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning

Niki Maria Foteinopoulou, Enjie Ghorbel, Djamila Aouada

Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training

Atli Kosson, Bettina Messmer, Martin Jaggi

ReMoDetect: Reward Models Recognize Aligned LLM's Generations

Hyunseok Lee, Jihoon Tack, Jinwoo Shin

BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling

Lin Gui, Cristina Gârbacea, Victor Veitch