model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Mitigating Bias in Machine Learning: A Comprehensive Review and Novel Approaches AAAI 2025

Iterative Structured Knowledge Distillation: Optimizing Language Models Through Layer-by-Layer Distillation COLING 2025

DP-FROST: Differentially Private Fine-tuning of Pre-trained Models with Freezing Model Parameters COLING 2025

AAIG at GenAI Detection Task 1: Exploring Syntactically-Aware, Resource-Efficient Small Autoregressive Decoders for AI Content Detection COLING 2025

When Every Token Counts: Optimal Segmentation for Low-Resource Language Models COLING 2025

DiTFastAttnV2: Head-wise Attention Compression for Multi-Modality Diffusion Transformers ICCV 2025

On the Analysis and Distillation of Emergent Outlier Properties in Pre-trained Language Models NAACL 2025

Numerical Pruning for Efficient Autoregressive Models AAAI 2025

Octopus: On-device language model for function calling of software APIs NAACL 2025

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025

Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models NAACL 2025

UNLEARN Efficient Removal of Knowledge in Large Language Models NAACL 2025

Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025

Heuristic-free Knowledge Distillation for Streaming ASR via Multi-modal Training AAAI 2025

Block Circulant Adapter for Large Language Models IJCAI 2025

Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference AAAI 2025

RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations IJCAI 2025

AtomNet: Designing Tiny Models from Operators Under Extreme MCU Constraints AAAI 2025

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting ICCV 2025

Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025

Growing a Twig to Accelerate Large Vision-Language Models ICCV 2025

Powerformer: Efficient and High-Accuracy Privacy-Preserving Language Model with Homomorphic Encryption ACL 2025

Flipping Knowledge Distillation: Leveraging Small Models’ Expertise to Enhance LLMs in Text Matching ACL 2025

500xCompressor: Generalized Prompt Compression for Large Language Models ACL 2025

As easy as PIE: understanding when pruning causes language models to disagree NAACL 2025