Artificial Intelligence › Core AI ›

Model Compression

1928 directly classified papers

Papers per year

Papers

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity EMNLP 2024

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models NIPS 2024

In-Context Former: Lightning-fast Compressing Context for Large Language Model EMNLP 2024

Divide-or-Conquer? Which Part Should You Distill Your LLM? EMNLP 2024

USM RNN-T model weights binarization INTERSPEECH 2024

Visual Editing with LLM-based Tool Chaining: An Efficient Distillation Approach for Real-Time Applications EMNLP 2024

One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model INTERSPEECH 2024

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models EMNLP 2024

LoRAN: Improved Low-Rank Adaptation by a Non-Linear Transformation EMNLP 2024

DisCEdit: Model Editing by Identifying Discriminative Components NIPS 2024

Knowledge boosting during low-latency inference INTERSPEECH 2024

What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024

X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model CVPR 2024

PARA: Parameter-Efficient Fine-tuning with Prompt-Aware Representation Adjustment EMNLP 2024

KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches EMNLP 2024

Boosting Hybrid Autoregressive Transducer-based ASR with Internal Acoustic Model Training and Dual Blank Thresholding INTERSPEECH 2024

Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024

SAM-PARSER: Fine-Tuning SAM Efficiently by Parameter Space Reconstruction AAAI 2024

SEER: Backdoor Detection for Vision-Language Models through Searching Target Text and Image Trigger Jointly AAAI 2024

Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models NIPS 2024

Bootstrapping SparseFormers from Vision Foundation Models CVPR 2024

SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training NIPS 2024

Finding Transformer Circuits With Edge Pruning NIPS 2024

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024

FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024