information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Differentially Private Set Representations NIPS 2024

Extending Context Window of Large Language Models via Semantic Compression ACL 2024

Towards Exact Computation of Inductive Bias IJCAI 2024

RashomonGB: Analyzing the Rashomon Effect and Mitigating Predictive Multiplicity in Gradient Boosting NIPS 2024

Estimating Total Correlation with Mutual Information Estimators AISTATS 2023

A Novel Approach for Effective Multi-View Clustering with Information-Theoretic Perspective NIPS 2023

Implications of Annotation Artifacts in Edge Probing Test Datasets CONLL 2023

Reinforcement Learning with Simple Sequence Priors NIPS 2023

Beyond Normal: On the Evaluation of Mutual Information Estimators NIPS 2023

MIM4DD: Mutual Information Maximization for Dataset Distillation NIPS 2023

An information-theoretic quantification of the content of communication between brain regions NIPS 2023

“World Knowledge” in Multiple Choice Reading Comprehension EACL 2023

Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words EMNLP 2023

KECOR: Kernel Coding Rate Maximization for Active 3D Object Detection ICCV 2023

Feature Selection in the Contrastive Analysis Setting NIPS 2023

A unified framework for information-theoretic generalization bounds NIPS 2023

The communication cost of security and privacy in federated frequency estimation AISTATS 2023

Explaining Predictive Uncertainty with Information Theoretic Shapley Values NIPS 2023

Entropy-driven Unsupervised Keypoint Representation Learning in Videos ICML 2023

Information Theoretic Lower Bounds for Information Theoretic Upper Bounds NIPS 2023

Exact Optimality of Communication-Privacy-Utility Tradeoffs in Distributed Mean Estimation NIPS 2023

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training EMNLP 2023

Macedon: Minimizing Representation Coding Rate Reduction for Cross-Lingual Natural Language Understanding EMNLP 2023

Characterizing the Optimal $0-1$ Loss for Multi-class Classification with a Test-time Attacker NIPS 2023

Local Intrinsic Dimensional Entropy AAAI 2023