Information Theory

Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methods NeurIPS 2024 Mitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Information NAACL 2024 Online Estimation via Offline Estimation: An Information-Theoretic Framework NeurIPS 2024 Online Sampling and Decision Making with Low Entropy IJCAI 2024 Prediction from compression for models with infinite memory, with applications to hidden Markov and renewal processes COLT 2024 Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Method EMNLP 2024 Revisiting the Information Capacity of Neural Network Watermarks: Upper Bound Estimation and Beyond AAAI 2024 Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Data NeurIPS 2024 Sourcerer: Sample-based Maximum Entropy Source Distribution Estimation NeurIPS 2024 Studying the Interplay between Information Loss and Operation Loss in Representations for Classification JMLR 2024 To Believe or Not to Believe Your LLM: Iterative Prompting for Estimating Epistemic Uncertainty NeurIPS 2024 Towards Explainable Joint Models via Information Theory for Multiple Intent Detection and Slot Filling AAAI 2024 Universal Exact Compression of Differentially Private Mechanisms NeurIPS 2024 Alignment via Mutual Information CoNLL 2023 An Information-Theoretic Analysis of Nonstationary Bandit Learning ICML 2023 An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech Interspeech 2023 An Information Theory Perspective on Variance-Invariance-Covariance Regularization NeurIPS 2023 A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective NeurIPS 2023 A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition JMLR 2023 Communication-Constrained Bandits under Additive Gaussian Noise ICML 2023 DIET: Conditional independence testing with marginal dependence measures of residual information AISTATS 2023 Diffeomorphic Information Neural Estimation AAAI 2023 Enhancing Multiple Reliability Measures via Nuisance-Extended Information Bottleneck CVPR 2023 FACE: Evaluating Natural Language Generation with Fourier Analysis of Cross-Entropy NeurIPS 2023 Finite-Sample Symmetric Mean Estimation with Fisher Information Rate COLT 2023