conftrace_

model merging

234 papers

Explore in graph

Co-occurring keywords

large language model (13587) transfer learning (5449) multi-task learning (2575) knowledge distillation (3725) model compression (3302) language model (4599) low-rank adaptation (560) parameter-efficient fine-tuning (736) domain adaptation (4595) task vector (25)

Papers

Fisher Mask Nodes for Language Model Merging COLING 2024
Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging EMNLP 2024
3-in-1: 2D Rotary Adaptation for Efficient Finetuning, Efficient Batching and Composability NIPS 2024
Small Language Models Improve Giants by Rewriting Their Outputs EACL 2024
SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data NIPS 2024
Orthogonal Adaptation for Modular Customization of Diffusion Models CVPR 2024
AM-RADIO: Agglomerative Vision Foundation Model Reduce All Domains Into One CVPR 2024
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models ACL 2024
LM-Cocktail: Resilient Tuning of Language Models via Model Merging ACL 2024
Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction ACL 2024
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains ACL 2024
e-Health CSIRO at “Discharge Me!” 2024: Generating Discharge Summary Sections with Fine-tuned Language Models ACL 2024
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts EMNLP 2023
Structured Federated Learning through Clustered Additive Modeling NIPS 2023
Gemel: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge NSDI 2023
TIES-Merging: Resolving Interference When Merging Models NIPS 2023
MAS: Towards Resource-Efficient Federated Multiple-Task Learning ICCV 2023
Recyclable Tuning for Continual Pre-training ACL 2023
An Empirical Study of Multimodal Model Merging EMNLP 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning NIPS 2023
Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization ICML 2023
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time ICML 2022
Merging Models with Fisher-Weighted Averaging NIPS 2022
From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models EMNLP 2022
Patching open-vocabulary models by interpolating weights NIPS 2022