conftrace_

downstream performance

31 papers

Explore in graph

Co-occurring keywords

language model (4599) large language model (13587) representation learning (6206) scaling law (120) transfer learning (5449) masked language modeling (316) self-supervised learning (3777) pretrained model (292) pretrained language model (1030) text compression (27)

Papers

Comparative Analysis of the Intrinsic Metrics for Tokenizers and their effect on Downstream Tasks for Hindi and Marathi ACL 2026
Hierarchical Dataset Selection for High-Quality Data Sharing AAAI 2026
RoSE: Round-robin Synthetic Data Evaluation for Selecting LLM Generators without Human Test Sets EACL 2026
Generate but Verify: Answering with Faithfulness in RAG-based Question Answering IJCNLP 2025
Tokenization is Sensitive to Language Variation ACL 2025
Beyond Text Compression: Evaluating Tokenizers Across Scales ACL 2025
Accelerating Large Language Model Pretraining via LFR Pedagogy: Learn, Focus, and Review ACL 2025
Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders NAACL 2025
Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions EMNLP 2025
Mechanisms vs. Outcomes: Probing for Syntax Fails to Explain Performance on Targeted Syntactic Evaluations EMNLP 2025
Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text ACL 2025
Instability in Downstream Task Performance During LLM Pretraining EMNLP 2025
Downstream Trade-offs of a Family of Text Watermarks EMNLP 2024
Applying Intrinsic Debiasing on Downstream Tasks: Challenges and Considerations for Machine Translation EMNLP 2024
D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models NIPS 2024
Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance ACL 2024
Delving into the Reversal Curse: How Far Can Large Language Models Generalize? NIPS 2024
Accelerating Augmentation Invariance Pretraining NIPS 2024
Honey, I Shrunk the Language: Language Model Behavior at Reduced Scale. ACL 2023
How does the task complexity of masked pretraining objectives affect downstream performance? ACL 2023
Does the Correctness of Factual Knowledge Matter for Factual Knowledge-Enhanced Pre-trained Language Models? EMNLP 2023
On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training NIPS 2023
RankMe: Assessing the Downstream Performance of Pretrained Self-Supervised Representations by Their Rank ICML 2023
Will Large-scale Generative Models Corrupt Future Datasets? ICCV 2023
Do More Negative Samples Necessarily Hurt In Contrastive Learning? ICML 2022