← Keywords

information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm? AISTATS 2023
Which Shortcut Solution Do Question Answering Models Prefer to Learn? AAAI 2023
Self-Organization Preserved Graph Structure Learning with Principle of Relevant Information AAAI 2023
Time Series Contrastive Learning with Information-Aware Augmentations AAAI 2023
The Analysis of Deep Neural Networks by Information Theory: From Explainability to Generalization AAAI 2023
Model-agnostic Measure of Generalization Difficulty ICML 2023
Compressing Tabular Data via Latent Variable Estimation ICML 2023
Estimating Total Correlation with Mutual Information Estimators AISTATS 2023
Revisiting the Optimality of Word Lengths EMNLP 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples ICML 2023
CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design ICML 2023
Information Value: Measuring Utterance Predictability as Distance from Plausible Alternatives EMNLP 2023
Bridging Information-Theoretic and Geometric Compression in Language Models EMNLP 2023
Local Intrinsic Dimensional Entropy AAAI 2023
On Best-Arm Identification with a Fixed Budget in Non-Parametric Multi-Armed Bandits ALT 2023
Rethinking Fano’s Inequality in Ensemble Learning ICML 2022
Gestures Are Used Rationally: Information Theoretic Evidence from Neural Sequential Models COLING 2022
Better Embedding and More Shots for Few-shot Learning IJCAI 2022
On the Interplay between Information Loss and Operation Loss in Representations for Classification AISTATS 2022
Learning from an Exploring Demonstrator: Optimal Reward Estimation for Bandits AISTATS 2022
PEAF: Learnable Power Efficient Analog Acoustic Features for Audio Recognition INTERSPEECH 2022
Generalized Group Testing AISTATS 2022
On the Learning of Non-Autoregressive Transformers ICML 2022
ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons ACL 2022
Entropic Causal Inference: Graph Identifiability ICML 2022