Large Language Models

LomonosovMSU at SemEval-2024 Task 4: Comparing LLMs and embedder models to identifying propaganda techniques in the content of memes in English for subtasks No1, No2a, and No2b SemEval 2024 LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding ACL 2024 Long-Context Language Modeling with Parallel Context Encoding ACL 2024 Long-form factuality in large language models NeurIPS 2024 Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments NeurIPS 2024 Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning ICML 2024 LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression ACL 2024 LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens ICML 2024 LooGLE: Can Long-Context Language Models Understand Long Contexts? ACL 2024 Look Who’s Talking Now: Covert Channels From Biased LLMs EMNLP 2024 LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024 LoRA-GA: Low-Rank Adaptation with Gradient Approximation NeurIPS 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 LoRA Meets Dropout under a Unified Framework ACL 2024 LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024 LoRAP: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models ICML 2024 LoRA Training in the NTK Regime has No Spurious Local Minima ICML 2024 Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024 LQER: Low-Rank Quantization Error Reconstruction for LLMs ICML 2024 LRQuant: Learnable and Robust Post-Training Quantization for Large Language Models ACL 2024 LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Prompting ACL 2024 LumberChunker: Long-Form Narrative Document Segmentation EMNLP 2024 LUQ: Long-text Uncertainty Quantification for LLMs EMNLP 2024 M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought EMNLP 2024 M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models ACL 2024