← Keywords

information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Data NIPS 2024
On Causality in Domain Adaptation and Semi-Supervised Learning: an Information-Theoretic Analysis for Parametric Models JMLR 2024
Information-theoretic generalization bounds for learning from quantum data COLT 2024
A Twist for Graph Classification: Optimizing Causal Information Flow in Graph Neural Networks AAAI 2024
H-ensemble: An Information Theoretic Approach to Reliable Few-Shot Multi-Source-Free Transfer AAAI 2024
Studying the Interplay between Information Loss and Operation Loss in Representations for Classification JMLR 2024
Improving the Fairness of the Min-Max Game in GANs Training WACV 2024
Diffusion PID: Interpreting Diffusion via Partial Information Decomposition NIPS 2024
A Two-Stage Information Extraction Network for Incomplete Multi-View Multi-Label Classification AAAI 2024
Generalized Measures of Anticipation and Responsivity in Online Language Processing EMNLP 2024
Towards a Similarity-adjusted Surprisal Theory EMNLP 2024
An Information-Theoretic Approach to Analyze NLP Classification Tasks ACL 2024
Information-theoretic Generalization Analysis for Expected Calibration Error NIPS 2024
Temperature-scaling surprisal estimates improve fit to human reading times – but does it do so for the “right reasons”? ACL 2024
Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability NIPS 2024
Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning NIPS 2024
Efficiently Computing Susceptibility to Context in Language Models EMNLP 2024
Information-theoretic Analysis of Bayesian Test Data Sensitivity AISTATS 2024
BVT-IMA: Binary Vision Transformer with Information-Modified Attention AAAI 2024
Surprise! Uniform Information Density Isn’t the Whole Story: Predicting Surprisal Contours in Long-form Discourse EMNLP 2024
An Interactive Toolkit for Approachable NLP ACL 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications JMLR 2024
Mutual Information Estimation via Normalizing Flows NIPS 2024
Information Capacity Regret Bounds for Bandits with Mediator Feedback JMLR 2024
Are Female Carpenters like Blue Bananas? A Corpus Investigation of Occupation Gender Typicality ACL 2024