conftrace_

Optimization & Theory

7,804 papers (27 classified directly here)

Subtopics · a paper can sit in several, so these overlap

Optimization (1,960) Model Compression (1,896) Efficient Computing (1,780) Theory (1,239) Neural Network Optimization (1,004) Evaluation (533) Regularization (177) Loss Functions (157) Interpretability (128) Stochastic Methods (119) Generalization (115) Sparse Optimization (25)

Papers per year

8

7

12

6

16

9

25

48

45

60

94

150

295

436

675

803

1,010

944

1,346

1,352

463

'10

'15

'20

'25

Papers (including subtopics)

SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers CVPR 2024 Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models CVPR 2024 SMR: State Memory Replay for Long Sequence Modeling ACL 2024 SnapKV: LLM Knows What You are Looking for Before Generation NeurIPS 2024 Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future ACL 2024 Soft ascent-descent as a stable and flexible alternative to flooding NeurIPS 2024 SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training ACL 2024 SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NeurIPS 2024 Solving Attention Kernel Regression Problem via Pre-conditioner AISTATS 2024 Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference EACL 2024 SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning EMNLP 2024 Space-Time Continuous PDE Forecasting using Equivariant Neural Fields NeurIPS 2024 SpaFL: Communication-Efficient Federated Learning With Sparse Models And Low Computational Overhead NeurIPS 2024 SparseFit: Few-shot Prompting with Sparse Fine-tuning for Jointly Generating Predictions and Natural Language Explanations ACL 2024 SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024 SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers EMNLP 2024 Sparse High Rank Adapters NeurIPS 2024 SparseLLM: Towards Global Pruning of Pre-trained Language Models NeurIPS 2024 Sparse maximal update parameterization: A holistic approach to sparse training dynamics NeurIPS 2024 Spear: Evaluate the Adversarial Robustness of Compressed Neural Models IJCAI 2024 SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding EMNLP 2024 Spectrum Extraction and Clipping for Implicitly Linear Layers AISTATS 2024 Speculative Contrastive Decoding ACL 2024 Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism ACL 2024 Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NeurIPS 2024