conftrace_

model compression

3,562 papers

Explore in graph

Also known as

MC

Co-occurring keywords · papers mentioning both

knowledge distillation (1,124) large language model (422) neural network (322) neural network optimization (297) efficient computing (297) convolutional neural network (240) transfer learning (234) neural network pruning (200) parameter-efficient fine-tuning (168) language model (158)

Papers

Stepping Forward on the Last Mile NeurIPS 2024 Streamlining Speech Enhancement DNNs: an Automated Pruning Method Based on Dependency Graph with Advanced Regularized Loss Strategies Interspeech 2024 Structured Optimal Brain Pruning for Large Language Models EMNLP 2024 Structured Pruning for Large Language Models Using Coupled Components Elimination and Minor Fine-tuning NAACL 2024 Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning NeurIPS 2024 STTATTS: Unified Speech-To-Text And Text-To-Speech Model EMNLP 2024 Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification Interspeech 2024 Surgical Feature-Space Decomposition of LLMs: Why, When and How? ACL 2024 SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NeurIPS 2024 SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 Taming Binarized Neural Networks and Mixed-Integer Programs AAAI 2024 Task-agnostic Distillation of Encoder-Decoder Language Models COLING 2024 Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion EMNLP 2024 Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024 Teaching Tiny Minds: Exploring Methods to Enhance Knowledge Distillation for Small Language Models CoNLL 2024 Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation EMNLP 2024 TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024 The Cost of Scaling Down Large Language Models: Reducing Model Size Affects Memory before In-context Learning ICLR 2024 The False Promise of Imitating Proprietary Language Models ICLR 2024 The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry ICLR 2024 The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information NeurIPS 2024 The LLM Surgeon ICLR 2024 The Mamba in the Llama: Distilling and Accelerating Hybrid Models NeurIPS 2024 The Need for Speed: Pruning Transformers with One Recipe ICLR 2024