Optimization & Theory

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NeurIPS 2024 How does Gradient Descent Learn Features --- A Local Analysis for Regularized Two-Layer Neural Networks NeurIPS 2024 How Does Quantization Affect Multilingual LLMs? EMNLP 2024 How Far Can We Compress Instant-NGP-Based NeRF? CVPR 2024 How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks NeurIPS 2024 How many classifiers do we need? NeurIPS 2024 How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective NeurIPS 2024 HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models NeurIPS 2024 HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces CVPR 2024 Hybrid-Supervised Dual-Search: Leveraging Automatic Learning for Loss-Free Multi-Exposure Image Fusion AAAI 2024 HydraViT: Stacking Heads for a Scalable ViT NeurIPS 2024 Hyperbolic Optimizer as a Dynamical System ICML 2024 Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding ACL 2024 Hypothesis Testing the Circuit Hypothesis in LLMs NeurIPS 2024 IAPT: Instance-Aware Prompt Tuning for Large Language Models ACL 2024 IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs ICLR 2024 Identifying Equivalent Training Dynamics NeurIPS 2024 Identifying Important Group of Pixels using Interactions CVPR 2024 Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias AISTATS 2024 IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation NeurIPS 2024 If You Want to Be Robust, Be Wary of Initialization NeurIPS 2024 ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object CVPR 2024 Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment NeurIPS 2024 Immunization against harmful fine-tuning attacks EMNLP 2024 Impact of Decoding Methods on Human Alignment of Conversational LLMs ACL 2024