embedding layer

Efficient Vocabulary Reduction for Small Language Models COLING 2025 (How) Can Transformers Predict Pseudo-Random Numbers? ICML 2025 KS-Lottery: Finding Certified Lottery Tickets for Multilingual Transfer in Large Language Models NAACL 2025 Language Models Can be Efficiently Steered via Minimal Embedding Layer Transformations EMNLP 2025 R-BPE: Improving BPE-Tokenizers with Token Reuse EMNLP 2025 Spelling-out is not Straightforward: LLMs’ Capability of Tokenization from Token to Characters EMNLP 2025 Time Series Representations with Hard-Coded Invariances ICML 2025 How to Fine-Tune Vision Models with SGD ICLR 2024 Privacy-Preserving Embedding via Look-up Table Evaluation with Fully Homomorphic Encryption ICML 2024 SEED: Semantic Knowledge Transfer for Language Model Adaptation to Materials Science EMNLP 2024 Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains ICML 2024 How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding ICML 2023 Federated Model Decomposition with Private Vocabulary for Text Classification EMNLP 2022 Federated Submodel Optimization for Hot and Cold Data Features NeurIPS 2022 Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens NAACL 2022 Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification AACL 2022 Game-theoretic Vocabulary Selection via the Shapley Value and Banzhaf Index NAACL 2021 Differentiable Product Quantization for End-to-End Embedding Compression ICML 2020 Tensorized Embedding Layers EMNLP 2020 Understanding and Improving Information Transfer in Multi-Task Learning ICLR 2020 Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers NeurIPS 2019 Neural Response Generation via GAN with an Approximate Embedding Layer EMNLP 2017