Pretraining

GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networks NeurIPS 2023 GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs EMNLP 2023 Guiding Local Feature Matching with Surface Curvature ICCV 2023 Harnessing the Power of BERT in the Turkish Clinical Domain: Pretraining Approaches for Limited Data Scenarios ACL 2023 HiCLIP: Contrastive Language-Image Pretraining with Hierarchy-aware Attention ICLR 2023 Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles ICML 2023 Hint-Aug: Drawing Hints From Foundation Vision Transformers Towards Boosted Few-Shot Parameter-Efficient Tuning CVPR 2023 HiViT: A Simpler and More Efficient Design of Hierarchical Vision Transformer ICLR 2023 HiVLP: Hierarchical Interactive Video-Language Pre-Training ICCV 2023 HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers ICLR 2023 HOMO-MEX: A Mexican Spanish Annotated Corpus for LGBT+phobia Detection on Twitter ACL 2023 HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Science EMNLP 2023 How does the task complexity of masked pretraining objectives affect downstream performance? ACL 2023 How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning Interspeech 2023 How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives ACL 2023 I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task ACL 2023 Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks CVPR 2023 Image Captioners Are Scalable Vision Learners Too NeurIPS 2023 ImageNet Pre-training Also Transfers Non-robustness AAAI 2023 Improved Distribution Matching for Dataset Condensation CVPR 2023 Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting ICCV 2023 Improving Pixel-based MIM by Reducing Wasted Modeling Capability ICCV 2023 Improving Sign Recognition with Phonology EACL 2023 Improving Training and Inference of Face Recognition Models via Random Temperature Scaling AAAI 2023 Improving Visual Prompt Tuning for Self-supervised Vision Transformers ICML 2023