Information Theory

Generalization in Federated Learning: A Conditional Mutual Information Framework ICML 2025 How Well Does First-Token Entropy Approximate Word Entropy as a Psycholinguistic Predictor? IJCNLP 2025 InfoBridge: Balanced Multimodal Integration through Conditional Dependency Modeling ICCV 2025 Information-Theoretic Causal Discovery in Topological Order AISTATS 2025 Information-Theoretic Measures on Lattices for Higher-Order Interactions AISTATS 2025 Information Theory and Linguistic Variation: A Study of Brazilian and European Portuguese COLING 2025 MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space ACL 2025 Modeling Bottom-up Information Quality during Language Processing EMNLP 2025 Noise May Drown Out Words but Foster Compositionality: The Advantage of the Erasure and Deletion Noisy Channels on Emergent Communication IJCNLP 2025 Non-parametric Conditional Independence Testing for Mixed Continuous-Categorical Variables: A Novel Method and Numerical Evaluation CLeaR 2025 On Information-Theoretic Measures of Predictive Uncertainty UAI 2025 On the Correspondence between the Squared Norm and Information Content in Text Embeddings EMNLP 2025 Open Political Corpora: Structuring, Searching, and Analyzing Political Text Collections with PoliCorp EMNLP 2025 Optimal Viewpoint Selection for Autonomous Photography Using Reinforcement Learning AAAI 2025 Optimization Over a Probability Simplex JMLR 2025 Ordered V-information Growth: A Fresh Perspective on Shared Information AISTATS 2025 Quantifying Overfitting along the Regularization Path for Two-Part-Code MDL in Supervised Classification COLT 2025 Searching for and Avoiding Hidden Sets Using Queries with Local Feedback AAAI 2025 SECodec: Structural Entropy-based Compressive Speech Representation Codec for Speech Language Models AAAI 2025 Sharp Optimality of Simple, Plug-in Estimation of the Fisher Information of a Smoothed Density ICML 2025 SUMI-IFL: An Information-Theoretic Framework for Image Forgery Localization with Sufficiency and Minimality Constraints AAAI 2025 Synonymity-Based Semantic Coding for Efficient Speech Compression Interspeech 2025 Testing (Conditional) Mutual Information - Extended Abstract COLT 2025 The Harmonic Structure of Information Contours ACL 2025 The Z-Gromov-Wasserstein Distance JMLR 2025