Information Theory

A surprisal–duration trade-off across and within the world’s languages EMNLP 2021 Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ACL 2021 Breaking The Dimension Dependence in Sparse Distribution Estimation under Communication Constraints COLT 2021 Dimension-free empirical entropy estimation NeurIPS 2021 Disentangled Information Bottleneck AAAI 2021 Entropic Inequality Constraints from e-separation Relations in Directed Acyclic Graphs with Hidden Variables UAI 2021 Estimating the Unique Information of Continuous Variables NeurIPS 2021 Estimating α-Rank by Maximizing Information Gain AAAI 2021 Fabula Entropy Indexing: Objective Measures of Story Coherence NAACL 2021 Finding Relevant Information via a Discrete Fourier Expansion ICML 2021 From characters to words: the turning point of BPE merges EACL 2021 Hierarchical probabilistic model for blind source separation via Legendre transformation UAI 2021 Hilbert Sinkhorn Divergence for Optimal Transport CVPR 2021 Human-like informative conversations: Better acknowledgements using conditional mutual information NAACL 2021 Hyperdimensional Computing as a Framework for Systematic Aggregation of Image Descriptors CVPR 2021 Improved Mutual Information Estimation AAAI 2021 Improving Lossless Compression Rates via Monte Carlo Bits-Back Coding ICML 2021 Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis EMNLP 2021 Inductive Mutual Information Estimation: A Convex Maximum-Entropy Copula Approach AISTATS 2021 Information-Theoretic Generalization Bounds for Stochastic Gradient Descent COLT 2021 Is Information Density Uniform in Task-Oriented Dialogues? EMNLP 2021 It was “all” for “nothing”: sharp phase transitions for noiseless discrete channels COLT 2021 Layer-wise Model Pruning based on Mutual Information EMNLP 2021 Light RUMs ICML 2021 Lossy Compression for Lossless Prediction NeurIPS 2021