conftrace_

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Distilling from Similar Tasks for Transfer Learning on a Budget ICCV 2023

Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing NIPS 2023

Knowledge Distillation Performs Partial Variance Reduction NIPS 2023

Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference? EMNLP 2023

Mem-Rec: Memory Efficient Recommendation System using Alternative Representation ACML 2023

Efficient Training of Large-Scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout AAAI 2023

Representation Disparity-aware Distillation for 3D Object Detection ICCV 2023

ViM: Vision Middleware for Unified Downstream Transferring ICCV 2023

Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy ICCV 2023

Safety Aware Neural Pruning for Deep Reinforcement Learning (Student Abstract) AAAI 2023

Efficient Controllable Multi-Task Architectures ICCV 2023

Stable and low-precision training for large-scale vision-language models NIPS 2023

UniKD: Universal Knowledge Distillation for Mimicking Homogeneous or Heterogeneous Object Detectors ICCV 2023

From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels ICCV 2023

Efficient On-Device Training via Gradient Filtering CVPR 2023

Efficient Distributed Inference of Deep Neural Networks via Restructuring and Pruning AAAI 2023

Recasting Self-Attention with Holographic Reduced Representations ICML 2023

Compressing Context to Enhance Inference Efficiency of Large Language Models EMNLP 2023

HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts EMNLP 2023

Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023

MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices ICCV 2023

I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference ICCV 2023

DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-efficient Fine-Tuning ICCV 2023

Boosting Graph Neural Networks via Adaptive Knowledge Distillation AAAI 2023