← Keywords

information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

MIM4DD: Mutual Information Maximization for Dataset Distillation NIPS 2023
Labels, Information, and Computation: Efficient Learning Using Sufficient Labels JMLR 2023
An information-theoretic quantification of the content of communication between brain regions NIPS 2023
Local Intrinsic Dimensional Entropy AAAI 2023
Tokenization and the Noiseless Channel ACL 2023
Compressing Tabular Data via Latent Variable Estimation ICML 2023
Hierarchical State Abstraction based on Structural Information Principles IJCAI 2023
Syntax and Geometry of Information ACL 2023
Revisiting Entropy Rate Constancy in Text EMNLP 2023
Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words EMNLP 2023
A unified framework for information-theoretic generalization bounds NIPS 2023
Reinforcement Learning with Simple Sequence Priors NIPS 2023
An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech INTERSPEECH 2023
Feature Selection in the Contrastive Analysis Setting NIPS 2023
Beyond Normal: On the Evaluation of Mutual Information Estimators NIPS 2023
A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective NIPS 2023
Learning Distributions over Quantum Measurement Outcomes ICML 2023
Time Series Contrastive Learning with Information-Aware Augmentations AAAI 2023
Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study ACL 2023
Causal Entropy Optimization AISTATS 2023
The communication cost of security and privacy in federated frequency estimation AISTATS 2023
Characterizing the Optimal $0-1$ Loss for Multi-class Classification with a Test-time Attacker NIPS 2023
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition ACL 2023
Learning Non-linguistic Skills without Sacrificing Linguistic Proficiency ACL 2023
How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm? AISTATS 2023