conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024
Progressively Knowledge Distillation via Re-parameterizing Diffusion Reverse Process AAAI 2024
PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models NIPS 2024
CHESS: Optimizing LLM Inference via Channel-Wise Thresholding and Selective Sparsification EMNLP 2024
BiPFT: Binary Pre-trained Foundation Transformer with Low-Rank Estimation of Binarization Residual Polynomials AAAI 2024
AQ-DETR: Low-Bit Quantized Detection Transformer with Auxiliary Queries AAAI 2024
Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying NAACL 2024
Practical Privacy-Preserving MLaaS: When Compressive Sensing Meets Generative Networks AAAI 2024
Generative Model-Based Feature Knowledge Distillation for Action Recognition AAAI 2024
Even Sparser Graph Transformers NIPS 2024
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models EMNLP 2024
FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models EMNLP 2024
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation EMNLP 2024
Building Variable-Sized Models via Learngene Pool AAAI 2024
Integer Is Enough: When Vertical Federated Learning Meets Rounding AAAI 2024
Learning Performance Maximizing Ensembles with Explainability Guarantees AAAI 2024
REPrune: Channel Pruning via Kernel Representative Selection AAAI 2024
UniADS: Universal Architecture-Distiller Search for Distillation Gap AAAI 2024
Cooperative Knowledge Distillation: A Learner Agnostic Approach AAAI 2024
UPDP: A Unified Progressive Depth Pruner for CNN and Vision Transformer AAAI 2024
Towards Effective and General Graph Unlearning via Mutual Evolution AAAI 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NIPS 2024
Structured Optimal Brain Pruning for Large Language Models EMNLP 2024