conftrace_

transformer compression

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (3) parameter reduction (2) multi-head attention (2) parameter redundancy (1) group constraint (1) few-shot compression (1) structural weight pruning (1) self-supervised grouping (1) embedding dimension reduction (1) attention compression (1)

Papers

Numerical Pruning for Efficient Autoregressive Models AAAI 2025 EFTNAS: Searching for Efficient Language Models in First-Order Weight-Reordered Super-Networks COLING 2024 SliceGPT: Compress Large Language Models by Deleting Rows and Columns ICLR 2024 Compressing Transformers: Features Are Low-Rank, but Weights Are Not! AAAI 2023 Finding the Pillars of Strength for Multi-Head Attention ACL 2023 Deeply Tensor Compressed Transformers for End-to-End Object Detection AAAI 2022