conftrace_

parameter efficient

173 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) large language model (13587) knowledge distillation (3725) parameter efficiency (417) domain adaptation (4595) language model (4599) mixture of expert (640) vision transformer (1106) parameter-efficient fine-tuning (736)

Papers

MetaISP: Efficient RAW-to-sRGB Mappings with Merely 1M Parameters IJCAI 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024
Convolutional Prompting meets Language Models for Continual Learning CVPR 2024
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models EMNLP 2024
Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial Literacy EMNLP 2024
PAELLA: Parameter-Efficient Lightweight Language-Agnostic Captioning Model NAACL 2024
TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models COLING 2024
FedLFC: Towards Efficient Federated Multilingual Modeling with LoRA-based Language Family Clustering NAACL 2024
MACP: Efficient Model Adaptation for Cooperative Perception WACV 2024
PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment WACV 2024
Quantization of Large Language Models with an Overdetermined Basis UAI 2024
LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking CVPR 2024
Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less SEMEVAL 2024
S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NIPS 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024
LungAdapter: Efficient Adapting Audio Spectrogram Transformer for Lung Sound Classification INTERSPEECH 2024
$\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild NIPS 2024
Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024
LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training EMNLP 2024
Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledge ACL 2024
PartialFormer: Modeling Part Instead of Whole for Machine Translation ACL 2024
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models ACL 2024
Selective Prefix Tuning for Pre-trained Language Models ACL 2024
Audio Generation with Multiple Conditional Diffusion Model AAAI 2024
DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval AAAI 2024