Skip to content
conftrace_

model depth

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model width (4) neural machine translation (3) parameter efficiency (2) vision transformer (2) representation learning (2) classification objective (1) neural sequence model (1) input-adaptive computation (1) layer analysis (1) deep transformer (1)

Papers

A Study on Transformer Configuration and Training Objective ICML 2023 Grokking of Hierarchical Structure in Vanilla Transformers ACL 2023 MIA-Former: Efficient and Robust Vision Transformers via Multi-Grained Input-Adaptation AAAI 2022 Multi-Path Transformer is Better: A Case Study on Neural Machine Translation EMNLP 2022 Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth ICLR 2021 Fast and Accurate Model Scaling CVPR 2021 Going Deeper With Image Transformers ICCV 2021 How Many Layers and Why? An Analysis of the Model Depth in Transformers ACL 2021 Multi-Unit Transformers for Neural Machine Translation EMNLP 2020 Towards Adaptive Residual Network Training: A Neural-ODE Perspective ICML 2020 Depth Growing for Neural Machine Translation ACL 2019