← Keywords

information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Information-Theoretic Understanding of Population Risk Improvement with Model Compression AAAI 2020
Profile Entropy: A Fundamental Measure for the Learnability and Compressibility of Distributions NIPS 2020
Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction NIPS 2020
Limits on Testing Structural Changes in Ising Models NIPS 2020
Improving Disentangled Text Representation Learning with Information-Theoretic Guidance ACL 2020
Spread Divergence ICML 2020
A Free-Energy Principle for Representation Learning ICML 2020
Explore, Discover and Learn: Unsupervised Discovery of State-Covering Skills ICML 2020
Information Theoretic Model Predictive Q-Learning L4DC 2020
Localized active learning of Gaussian process state space models L4DC 2020
An Unsupervised Information-Theoretic Perceptual Quality Metric NIPS 2020
The Fast Loaded Dice Roller: A Near-Optimal Exact Sampler for Discrete Probability Distributions AISTATS 2020
Information-theoretic Task Selection for Meta-Reinforcement Learning NIPS 2020
RATQ: A Universal Fixed-Length Quantizer for Stochastic Optimization AISTATS 2020
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Networks JMLR 2020
Optimal Query Complexity of Secure Stochastic Convex Optimization NIPS 2020
Applications of Common Entropy for Causal Inference NIPS 2020
GAIT: A Geometric Approach to Information Theory AISTATS 2020
Optimal Group Testing COLT 2020
Less is Better: A cognitively inspired unsupervised model for language segmentation COLING 2020
Tree Sampling Divergence: An Information-Theoretic Metric for Hierarchical Graph Clustering IJCAI 2019
Invariant Information Clustering for Unsupervised Image Classification and Segmentation ICCV 2019
Correspondence Analysis Using Neural Networks AISTATS 2019
Efficient Near-Optimal Testing of Community Changes in Balanced Stochastic Block Models NIPS 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates NIPS 2019