conftrace_

sparse language model

3 papers

Explore in graph

Co-occurring keywords

model compression (3302) one-shot pruning (6) operator splitting (16) conjugate gradient method (10) perplexity reduction (7) nucleus sampling (26) temperature sampling (12) large language model (13587) sparse pruning (9) sparse language modeling (1)

Papers

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models NIPS 2024
UltraSparseBERT: 99% Conditionally Sparse Language Modelling ACL 2024
Sparse Text Generation EMNLP 2020