Optimization & Theory

LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models EMNLP 2023 LLM-FP4: 4-Bit Floating-Point Quantized Transformers EMNLP 2023 Local Intrinsic Dimensional Entropy AAAI 2023 Location-Aware Visual Question Generation with Lightweight Models EMNLP 2023 LOFT: Finding Lottery Tickets through Filter-wise Training AISTATS 2023 Log-linear Guardedness and its Implications ACL 2023 Long Horizon Temperature Scaling ICML 2023 Long-Range Language Modeling with Selective Cache EMNLP 2023 LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation ICML 2023 Loss-Curvature Matching for Dataset Selection and Condensation AISTATS 2023 Lossless 4-bit Quantization of Architecture Compressed Conformer ASR Systems on the 300-hr Switchboard Corpus Interspeech 2023 Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost AAAI 2023 Lottery Tickets in Evolutionary Optimization: On Sparse Backpropagation-Free Trainability ICML 2023 Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes ICLR 2023 Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit ICML 2023 Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single ICML 2023 LVMT: An Efficient Authenticated Storage for Blockchain OSDI 2023 Machines of Finite Depth: Towards a Formalization of Neural Networks AAAI 2023 Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA EMNLP 2023 Making Pre-trained Language Models both Task-solvers and Self-calibrators ACL 2023 Making Vision Transformers Efficient From a Token Sparsification View CVPR 2023 Manifold-Preserving Transformers are Effective for Short-Long Range Encoding EMNLP 2023 Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023 MathNAS: If Blocks Have a Role in Mathematical Architecture Design NeurIPS 2023 Maximal Initial Learning Rates in Deep ReLU Networks ICML 2023