conftrace_

parameter efficiency

417 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) convolutional neural network (4226) large language model (13587) mixture of expert (640) knowledge distillation (3725) neural network (6616) language model (4599) neural network optimization (1293) efficient computing (781)

Papers

Overcoming Generic Knowledge Loss with Selective Parameter Update CVPR 2024
Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis CVPR 2024
Exploring compressibility of transformer based text-to-music (TTM) models INTERSPEECH 2024
DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detection NIPS 2024
Improving Neural ODE Training with Temporal Adaptive Batch Normalization NIPS 2024
Harnessing small projectors and multiple views for efficient vision pretraining NIPS 2024
WaveMixSR: Resource-Efficient Neural Network for Image Super-Resolution WACV 2024
MindMerger: Efficiently Boosting LLM Reasoning in non-English Languages NIPS 2024
Group and Shuffle: Efficient Structured Orthogonal Parametrization NIPS 2024
MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning CVPR 2024
LORS: Low-rank Residual Structure for Parameter-Efficient Network Stacking CVPR 2024
Adapters Strike Back CVPR 2024
Parsimony or Capability? Decomposition Delivers Both in Long-term Time Series Forecasting NIPS 2024
TroL: Traversal of Layers for Large Language and Vision Models EMNLP 2024
ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers EMNLP 2024
Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models EMNLP 2024
Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NIPS 2024
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models EMNLP 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024
HALSIE: Hybrid Approach to Learning Segmentation by Simultaneously Exploiting Image and Event Modalities WACV 2024
Small Language Models Are Good Too: An Empirical Study of Zero-Shot Classification COLING 2024
Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors NIPS 2024
Unveiling The Matthew Effect Across Channels: Assessing Layer Width Sufficiency via Weight Norm Variance NIPS 2024
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models ACL 2024