parameter efficiency

MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning CVPR 2024 Multi-Head Mixture-of-Experts NeurIPS 2024 Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NeurIPS 2024 Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection Interspeech 2024 Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024 Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024 Not Everything is All You Need: Toward Low-Redundant Optimization for Large Language Model Alignment EMNLP 2024 Overcoming Generic Knowledge Loss with Selective Parameter Update CVPR 2024 Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation ICML 2024 ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks CVPR 2024 Parsimony or Capability? Decomposition Delivers Both in Long-term Time Series Forecasting NeurIPS 2024 PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024 PeLK: Parameter-efficient Large Kernel ConvNets with Peripheral Convolution CVPR 2024 Plug-and-Play: An Efficient Post-training Pruning Method for Large Language Models ICLR 2024 PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning EMNLP 2024 Recurrent Partial Kernel Network for Efficient Optical Flow Estimation AAAI 2024 ReFACT: Updating Text-to-Image Models by Editing the Text Encoder NAACL 2024 Relationship Prompt Learning is Enough for Open-Vocabulary Semantic Segmentation NeurIPS 2024 Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024 Scaling Laws for Sparsely-Connected Foundation Models ICLR 2024 SDNet: An Extremely Efficient Portrait Matting Model via Self-Distillation WACV 2024 Small Language Models Are Good Too: An Empirical Study of Zero-Shot Classification COLING 2024 Structured Optimal Brain Pruning for Large Language Models EMNLP 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying NAACL 2024