model architecture

324 papers

Explore in graph

Co-occurring keywords

neural network (6616) convolutional neural network (4216) vision transformer (1091) image classification (1943) neural architecture search (665) neural network optimization (1293) efficient computing (779) model compression (3283) attention mechanism (3975) deep learning (2111)

Papers

Grafting Vision Transformers WACV 2024

Understanding the Gains from Repeated Self-Distillation NIPS 2024

START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformation NIPS 2024

Improving Adversarial Robustness in Vision-Language Models with Architecture and Prompt Design EMNLP 2024

Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning? NIPS 2024

Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers ACL 2024

AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation NIPS 2024

LeMeViT: Efficient Vision Transformer with Learnable Meta Tokens for Remote Sensing Image Interpretation IJCAI 2024

Memory-Efficient Reversible Spiking Neural Networks AAAI 2024

Linearly Decomposing and Recomposing Vision Transformers for Diverse-Scale Models NIPS 2024

Graph Neural Networks Need Cluster-Normalize-Activate Modules NIPS 2024

VISPool: Enhancing Transformer Encoders with Vector Visibility Graph Neural Networks ACL 2024

PerFedRLNAS: One-for-All Personalized Federated Neural Architecture Search AAAI 2024

MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024

Non-convolutional graph neural networks. NIPS 2024

GradTree: Learning Axis-Aligned Decision Trees with Gradient Descent AAAI 2024

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models ACL 2024

RMT: Retentive Networks Meet Vision Transformers CVPR 2024

Leveraging Adapter for Parameter-Efficient ASR Encoder INTERSPEECH 2024

Harder Task Needs More Experts: Dynamic Routing in MoE Models ACL 2024

HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms NAACL 2024

EAN: An Efficient Attention Module Guided by Normalization for Deep Neural Networks AAAI 2024

Puer at SemEval-2024 Task 2: A BioLinkBERT Approach to Biomedical Natural Language Inference NAACL 2024

Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement INTERSPEECH 2024

Linear-Complexity Self-Supervised Learning for Speech Processing INTERSPEECH 2024