← Keywords

information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

An Information-Theoretic Justification for Model Pruning AISTATS 2022
Generalized Group Testing AISTATS 2022
Information-Theoretic Analysis of Epistemic Uncertainty in Bayesian Meta-learning AISTATS 2022
Fundamental Limits and Tradeoffs in Invariant Representation Learning JMLR 2022
Information-theoretic Classification Accuracy: A Criterion that Guides Data-driven Combination of Ambiguous Outcome Labels in Multi-class Classification JMLR 2022
Investigating Information-Theoretic Properties of the Typology of Spatial Demonstratives NAACL 2022
On the Learning of Non-Autoregressive Transformers ICML 2022
A Functional Information Perspective on Model Interpretation ICML 2022
Adaptive Data Analysis with Correlated Observations ICML 2022
Adaptive Information Belief Space Planning IJCAI 2022
SoFaiR: Single Shot Fair Representation Learning IJCAI 2022
Better Embedding and More Shots for Few-shot Learning IJCAI 2022
Gradual (In)Compatibility of Fairness Criteria AAAI 2022
Graph Structure Learning with Variational Information Bottleneck AAAI 2022
An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels ACL 2022
Evaluating Extreme Hierarchical Multi-label Classification ACL 2022
Estimating the Entropy of Linguistic Distributions ACL 2022
On the probability–quality paradox in language generation ACL 2022
Analyzing Wrap-Up Effects through an Information-Theoretic Lens ACL 2022
ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons ACL 2022
What Has Been Enhanced in my Knowledge-Enhanced Language Model? EMNLP 2022
ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networks CVPR 2022
An Analysis of Ensemble Sampling NIPS 2022
Information-Theoretic Safe Exploration with Gaussian Processes NIPS 2022
An Information-Theoretic Framework for Deep Learning NIPS 2022