information theory

Studying the Interplay between Information Loss and Operation Loss in Representations for Classification JMLR 2024 Surprise! Uniform Information Density Isn’t the Whole Story: Predicting Surprisal Contours in Long-form Discourse EMNLP 2024 Temperature-scaling surprisal estimates improve fit to human reading times – but does it do so for the “right reasons”? ACL 2024 The Sample Complexity of Simple Binary Hypothesis Testing COLT 2024 The Semantic Relations in LLMs: An Information-theoretic Compression Approach COLING 2024 To Believe or Not to Believe Your LLM: Iterative Prompting for Estimating Epistemic Uncertainty NeurIPS 2024 Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning NeurIPS 2024 Towards a Similarity-adjusted Surprisal Theory EMNLP 2024 Towards Exact Computation of Inductive Bias IJCAI 2024 Towards Explainable Joint Models via Information Theory for Multiple Intent Detection and Slot Filling AAAI 2024 An Information-Theoretic Analysis of Nonstationary Bandit Learning ICML 2023 An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech Interspeech 2023 An information-theoretic quantification of the content of communication between brain regions NeurIPS 2023 An Information Theory Perspective on Variance-Invariance-Covariance Regularization NeurIPS 2023 A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective NeurIPS 2023 A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition JMLR 2023 A unified framework for information-theoretic generalization bounds NeurIPS 2023 Beyond Normal: On the Evaluation of Mutual Information Estimators NeurIPS 2023 Bridging Information-Theoretic and Geometric Compression in Language Models EMNLP 2023 Causal Entropy Optimization AISTATS 2023 Causal information splitting: Engineering proxy features for robustness to distribution shifts UAI 2023 Characterizing the Optimal $0-1$ Loss for Multi-class Classification with a Test-time Attacker NeurIPS 2023 CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design ICML 2023 Compressing Tabular Data via Latent Variable Estimation ICML 2023 Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words EMNLP 2023