Model Compression

Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit ICML 2023 Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA EMNLP 2023 Making Pre-trained Language Models both Task-solvers and Self-calibrators ACL 2023 Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023 Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model ACL 2023 Memory-Friendly Scalable Super-Resolution via Rewinding Lottery Ticket Hypothesis CVPR 2023 Mem-Rec: Memory Efficient Recommendation System using Alternative Representation ACML 2023 miniStreamer: Enhancing Small Conformer with Chunked-Context Masking for Streaming ASR Applications on the Edge Interspeech 2023 Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models’ Memories ACL 2023 Model Compression for DNN-based Speaker Verification Using Weight Quantization Interspeech 2023 MODeL: Memory Optimizations for Deep Learning ICML 2023 Modular and On-demand Bias Mitigation with Attribute-Removal Subnetworks ACL 2023 Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference ACL 2023 MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023 Multilingual Lottery Tickets to Pretrain Language Models EMNLP 2023 MUX-PLMs: Data Multiplexing for High-throughput Language Models EMNLP 2023 MUX-PLMs: Pre-training Language Models with Data Multiplexing ACL 2023 Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models ACL 2023 NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers CVPR 2023 Not All Neighbors Matter: Point Distribution-Aware Pruning for 3D Point Cloud AAAI 2023 OMPQ: Orthogonal Mixed Precision Quantization AAAI 2023 One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning ACL 2023 One-Shot Model for Mixed-Precision Quantization CVPR 2023 One-Step Diffusion Distillation via Deep Equilibrium Models NeurIPS 2023 On the Dimensionality of Sentence Embeddings EMNLP 2023