conftrace_

Optimization & Theory

7,804 papers (27 classified directly here)

Subtopics · a paper can sit in several, so these overlap

Optimization (1,960) Model Compression (1,896) Efficient Computing (1,780) Theory (1,239) Neural Network Optimization (1,004) Evaluation (533) Regularization (177) Loss Functions (157) Interpretability (128) Stochastic Methods (119) Generalization (115) Sparse Optimization (25)

Papers per year

8

7

12

6

16

9

25

48

45

60

94

150

295

436

675

803

1,010

944

1,346

1,352

463

'10

'15

'20

'25

Papers (including subtopics)

LION: Implicit Vision Prompt Tuning AAAI 2024 LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning NeurIPS 2024 LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization IJCAI 2024 LLMBox: A Comprehensive Library for Large Language Models ACL 2024 LLM can Achieve Self-Regulation via Hyperparameter Aware Generation ACL 2024 LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment NeurIPS 2024 LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit EMNLP 2024 LLM-Check: Investigating Detection of Hallucinations in Large Language Models NeurIPS 2024 LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 LLM Performance Predictors are good initializers for Architecture Search ACL 2024 LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024 LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores ACL 2024 LM-Cocktail: Resilient Tuning of Language Models via Model Merging ACL 2024 LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units ICLR 2024 Local Curvature Smoothing with Stein's Identity for Efficient Score Matching NeurIPS 2024 Localizing Task Information for Improved Model Merging and Compression ICML 2024 Local to Global: Learning Dynamics and Effect of Initialization for Transformers NeurIPS 2024 LocMoE: A Low-overhead MoE for Large Language Model Training IJCAI 2024 Log-concave Sampling from a Convex Body with a Barrier: a Robust and Unified Dikin Walk NeurIPS 2024 Loki: Low-rank Keys for Efficient Sparse Attention NeurIPS 2024 LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024 LongHeads: Multi-Head Attention is Secretly a Long Context Processor EMNLP 2024 LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory IJCAI 2024 LooGLE: Can Long-Context Language Models Understand Long Contexts? ACL 2024