Papers
World Model on Million-Length Video And Language With Blockwise RingAttention
Hao Liu, Wilson Yan, Matei Zaharia et al.
Homomorphism Expressivity of Spectral Invariant Graph Neural Networks
Jingchu Gai, Yiheng Du, Bohang Zhang et al.
Fast unsupervised ground metric learning with tree-Wasserstein distance
Kira Michaela Düsterwald, Samo Hromadka, Makoto Yamada
Harnessing Webpage UIs for Text-Rich Visual Understanding
Junpeng Liu, Tianyue Ou, Yifan Song et al.
DEPT: Decoupled Embeddings for Pre-training Language Models
Alex Iacob, Lorenzo Sani, Meghdad Kurmanji et al.
Data Taggants: Dataset Ownership Verification Via Harmless Targeted Data Poisoning
Wassim Bouaziz, Nicolas Usunier, El-Mahdi El-Mhamdi
AnalogGenie: A Generative Engine for Automatic Discovery of Analog Circuit Topologies
Jian Gao, Weidong Cao, Junyi Yang et al.
Learning Chaos In A Linear Way
Xiaoyuan Cheng, Yi He, Yiming Yang et al.
Provably Safeguarding a Classifier from OOD and Adversarial Samples
Nicolas Atienza, Johanne Cohen, Christophe Labreuche et al.
AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attribution
Fengyuan Liu, Nikhil Kandpal, Colin Raffel
MAESTRO: Masked Encoding Set Transformer with Self-Distillation
Matthew Eric Lee, Jaesik Kim, Matei Ionita et al.
MAPS: Advancing Multi-Modal Reasoning in Expert-Level Physical Science
Erle Zhu, Yadi Liu, Zhe Zhang et al.
OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data
Shubham Toshniwal, Wei Du, Ivan Moshkov et al.
Consistency Models Made Easy
Zhengyang Geng, Ashwini Pokle, Weijian Luo et al.
State Space Models are Provably Comparable to Transformers in Dynamic Token Selection
Naoki Nishikawa, Taiji Suzuki
Limits to scalable evaluation at the frontier: LLM as judge won’t beat twice the data
Florian E. Dorner, Vivian Yvonne Nastl, Moritz Hardt
Beyond single neurons: population response geometry in digital twins of mouse visual cortex
Dario Liscai, Emanuele Luconi, Alessandro Marin Vargas et al.
Revisiting Large-Scale Non-convex Distributionally Robust Optimization
Qi Zhang, Yi Zhou, Simon Khan et al.
Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models
Angela Lopez-Cardona, Carlos Segura, Alexandros Karatzoglou et al.
Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
Zeman Li, Xinwei Zhang, Peilin Zhong et al.
Standard Gaussian Process is All You Need for High-Dimensional Bayesian Optimization
Zhitong Xu, Haitao Wang, Jeff M. Phillips et al.
Nesterov acceleration in benignly non-convex landscapes
Kanan Gupta, Stephan Wojtowytsch
Balancing Bias in Two-sided Markets for Fair Stable Matchings
Siyuan Wu, Leong Hou U, Panagiotis Karras
Fugatto 1: Foundational Generative Audio Transformer Opus 1
Rafael Valle, Rohan Badlani, Zhifeng Kong et al.