Skip to content
conftrace_

parameter efficiency

452 papers

Papers

FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NeurIPS 2024 From Sparse to Soft Mixtures of Experts ICLR 2024 Geometry-aware training of factorized layers in tensor Tucker format NeurIPS 2024 Group and Shuffle: Efficient Structured Orthogonal Parametrization NeurIPS 2024 HALSIE: Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalities WACV 2024 Harnessing small projectors and multiple views for efficient vision pretraining NeurIPS 2024 Improving Neural ODE Training with Temporal Adaptive Batch Normalization NeurIPS 2024 Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors NeurIPS 2024 KernelWarehouse: Rethinking the Design of Dynamic Convolution ICML 2024 LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation EMNLP 2024 Learning New Tasks from a Few Examples with Soft-Label Prototypes ACL 2024 Learn it or Leave it: Module Composition and Pruning for Continual Learning ACL 2024 LION: Implicit Vision Prompt Tuning AAAI 2024 LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR Interspeech 2024 LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking CVPR 2024 Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends ACL 2024 MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning EMNLP 2024 Memory Augmented Language Models through Mixture of Word Experts NAACL 2024 MEND: Meta Demonstration Distillation for Efficient and Effective In-Context Learning ICLR 2024 MindMerger: Efficiently Boosting LLM Reasoning in non-English Languages NeurIPS 2024 Mixture of Diverse Size Experts EMNLP 2024 Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models ICLR 2024 Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules EMNLP 2024 MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NeurIPS 2024 MULTI-CONVFORMER: Extending Conformer with Multiple Convolution Kernels Interspeech 2024