conftrace_

inductive bia

272 papers

Explore in graph

Co-occurring keywords

representation learning (6206) neural network (6616) transfer learning (5449) convolutional neural network (4226) language model (4599) graph neural network (3962) large language model (13587) transformer architecture (1560) attention mechanism (4001) vision transformer (1106)

Papers

Neural Utility Functions AAAI 2021
On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies NAACL 2021
PACOH: Bayes-Optimal Meta-Learning with PAC-Guarantees ICML 2021
Transfer-Based Semantic Anomaly Detection ICML 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning ICML 2021
Attention is not all you need: pure attention loses rank doubly exponentially with depth ICML 2021
Self-Supervised Attention-Aware Reinforcement Learning AAAI 2021
Optimally Encoding Inductive Biases into the Transformer Improves End-to-End Speech Translation INTERSPEECH 2021
G-Transformer for Document-Level Machine Translation ACL 2021
A Cognitive Regularizer for Language Modeling ACL 2021
Rate-Regularization and Generalization in Variational Autoencoders AISTATS 2021
On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent ICML 2021
Taming Transformers for High-Resolution Image Synthesis CVPR 2021
Multiple Descent: Design Your Own Generalization Curve NIPS 2021
The Inductive Bias of Quantum Kernels NIPS 2021
Capacity and Bias of Learned Geometric Embeddings for Directed Graphs NIPS 2021
Towards Sample-efficient Overparameterized Meta-learning NIPS 2021
Periodic Activation Functions Induce Stationarity NIPS 2021
Self-Instantiated Recurrent Units with Dynamic Soft Recursion NIPS 2021
Learning to Learn Dense Gaussian Processes for Few-Shot Learning NIPS 2021
A Theoretical Analysis of Fine-tuning with Linear Teachers NIPS 2021
On Inductive Biases for Heterogeneous Treatment Effect Estimation NIPS 2021
Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication NIPS 2021
Tailoring: encoding inductive biases by optimizing unsupervised objectives at prediction time NIPS 2021
Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains NIPS 2021