pre-trained transformer

Adaptive Pruning of Pretrained Transformer via Differential Inclusions ICLR 2025 Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion ICML 2025 Exploring Graph Representations of Logical Forms for Language Modeling ACL 2025 Rethinking Leveraging Pre-Trained Multi-Layer Representations for Speaker Verification Interspeech 2025 When can in-context learning generalize out of task distribution? ICML 2025 AraMed: Arabic Medical Question Answering using Pretrained Transformer Language Models COLING 2024 Can Transformers Smell Like Humans? NeurIPS 2024 Concept-aware Data Construction Improves In-context Learning of Language Models ACL 2024 FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic Model NeurIPS 2024 Getting The Most Out of Your Training Data: Exploring Unsupervised Tasks for Morphological Inflection EMNLP 2024 Position: Do pretrained Transformers Learn In-Context by Gradient Descent? ICML 2024 Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context NeurIPS 2024 Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers NeurIPS 2024 Timer: Generative Pre-trained Transformers Are Large Time Series Models ICML 2024 Unlocking Emergent Modularity in Large Language Models NAACL 2024 3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment ICCV 2023 A Meta-dataset of German Medical Corpora: Harmonization of Annotations and Cross-corpus NER Evaluation ACL 2023 Automatically Predicting Perceived Conversation Quality in a Pediatric Sample Enriched for Autism Interspeech 2023 Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations ACL 2023 Detecting Syntactic Change with Pre-trained Transformer Models EMNLP 2023 Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? ACL 2023 Downstream Datasets Make Surprisingly Good Pretraining Corpora ACL 2023 Graphix-T5: Mixing Pre-trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing AAAI 2023 IMBERT: Making BERT Immune to Insertion-based Backdoor Attacks ACL 2023 One Fits All: Power General Time Series Analysis by Pretrained LM NeurIPS 2023