conftrace_

parameter efficient

173 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) large language model (13587) knowledge distillation (3725) parameter efficiency (417) domain adaptation (4595) language model (4599) mixture of expert (640) vision transformer (1106) parameter-efficient fine-tuning (736)

Papers

Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledge ACL 2024
PartialFormer: Modeling Part Instead of Whole for Machine Translation ACL 2024
PeLK: Parameter-efficient Large Kernel ConvNets with Peripheral Convolution CVPR 2024
LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking CVPR 2024
Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models EMNLP 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024
Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial Literacy EMNLP 2024
Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model EMNLP 2024
MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models NIPS 2024
QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation NIPS 2024
Meta-Adapter for Self-Supervised Speech Models: A Solution to Low-Resource Speech Recognition Challenges COLING 2024
Style Vectors for Steering Generative Large Language Models EACL 2024
Learn more, but bother less: parameter efficient continual learning NIPS 2024
SLTrain: a sparse plus low rank approach for parameter and memory efficient pretraining NIPS 2024
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model ACL 2023
DRAFT: Dense Retrieval Augmented Few-shot Topic classifier Framework EMNLP 2023
Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models ACL 2023
Parameter Efficient Multi-task Fine-tuning by Learning to Transfer Token-wise Prompts EMNLP 2023
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023
G-SPEED: General SParse Efficient Editing MoDel EMNLP 2023
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
Dual-Path Adaptation From Image to Video Transformers CVPR 2023