model architecture

324 papers

Explore in graph

Co-occurring keywords

neural network (6616) convolutional neural network (4216) vision transformer (1091) image classification (1943) neural architecture search (665) neural network optimization (1293) efficient computing (779) model compression (3283) attention mechanism (3975) deep learning (2111)

Papers

DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models NAACL 2025

SparX: A Sparse Cross-Layer Connection Mechanism for Hierarchical Vision Mamba and Transformer Networks AAAI 2025

Enhancing Long-range Dependency with State Space Model and Kolmogorov-Arnold Networks for Aspect-based Sentiment Analysis COLING 2025

MobileMamba: Lightweight Multi-Receptive Visual Mamba Network CVPR 2025

LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation ACL 2025

Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning EMNLP 2025

From Parameters to Performance: A Data-Driven Study on LLM Structure and Development EMNLP 2025

Pico: A Modular Framework for Hypothesis-Driven Small Language Model Research EMNLP 2025

Less, but Better: Efficient Multilingual Expansion for LLMs via Layer-wise Mixture-of-Experts ACL 2025

StitchLLM: Serving LLMs, One Block at a Time ACL 2025

SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design CVPR 2024

Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models IJCAI 2024

Puer at SemEval-2024 Task 2: A BioLinkBERT Approach to Biomedical Natural Language Inference NAACL 2024

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models EMNLP 2024

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NIPS 2024

Linear-Complexity Self-Supervised Learning for Speech Processing INTERSPEECH 2024

Rewiring the Transformer with Depth-Wise LSTMs COLING 2024

VISPool: Enhancing Transformer Encoders with Vector Visibility Graph Neural Networks ACL 2024

Deep Neural Networks via Complex Network Theory: A Perspective IJCAI 2024

One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion Schedule Flaws and Enhancing Low-Frequency Controls CVPR 2024

Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives ACL 2024

You Only Need Less Attention at Each Stage in Vision Transformers CVPR 2024

HydraViT: Stacking Heads for a Scalable ViT NIPS 2024

MM-LLMs: Recent Advances in MultiModal Large Language Models ACL 2024

Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers ACL 2024