information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Information bottleneck theory of high-dimensional regression: relevancy, efficiency and optimality NIPS 2022

Learning General World Models in a Handful of Reward-Free Deployments NIPS 2022

Optimizing Information Theory Based Bitwise Bottlenecks for Efficient Mixed-Precision Activation Quantization AAAI 2021

Finding Relevant Information via a Discrete Fourier Expansion ICML 2021

Whitening and Second Order Optimization Both Make Information in the Dataset Unusable During Training, and Can Reduce or Prevent Generalization ICML 2021

Precise Minimax Regret for Logistic Regression with Categorical Feature Values ALT 2021

Finding Concept-specific Biases in Form–Meaning Associations NAACL 2021

Analysing Human Strategies of Information Transmission as a Function of Discourse Context EMNLP 2021

Measuring Dependence with Matrix-based Entropy Functional AAAI 2021

Adversarial Training Reduces Information and Improves Transferability AAAI 2021

Hilbert Sinkhorn Divergence for Optimal Transport CVPR 2021

Conditional probing: measuring usable information beyond a baseline EMNLP 2021

On Robust Mean Estimation under Coordinate-level Corruption ICML 2021

An Information-Theoretic Characterization of Morphological Fusion EMNLP 2021

Rate-Distortion Analysis of Minimum Excess Risk in Bayesian Learning ICML 2021

Deciding What to Learn: A Rate-Distortion Approach ICML 2021

Decomposed Mutual Information Estimation for Contrastive Representation Learning ICML 2021

Complementary Patch for Weakly Supervised Semantic Segmentation ICCV 2021

Domain Divergences: A Survey and Empirical Analysis NAACL 2021

Analyzing the Generalization Capability of SGLD Using Properties of Gaussian Channels NIPS 2021

Tighter Expected Generalization Error Bounds via Wasserstein Distance NIPS 2021

Explaining by Removing: A Unified Framework for Model Explanation JMLR 2021

An Information-theoretic Approach to Distribution Shifts NIPS 2021

Phonetic Distance and Surprisal in Multilingual Priming: Evidence from Slavic INTERSPEECH 2021

Universal Rate-Distortion-Perception Representations for Lossy Compression NIPS 2021