conftrace_

sub-quadratic architecture

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

monarch matrix (1) general matrix multiplication (1) sub-quadratic complexity (1) sequence length scaling (1) monarch matrice (1) language model (1) recurrent neural network (1) model architecture (1) language modeling (1) knowledge distillation (1)

Papers

BabyHGRN: Exploring RNNs for Sample-Efficient Language Modeling CoNLL 2024 Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture NeurIPS 2023