Information Theory

Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accent ACL 2025 Word boundaries and the morphology-syntax trade-off COLING 2025 A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets NeurIPS 2024 A connection between Tempering and Entropic Mirror Descent ICML 2024 Adjust Pearson's r to Measure Arbitrary Monotone Dependence NeurIPS 2024 Analysing and Validating Language Complexity Metrics Across South American Indigenous Languages ACL 2024 Analytically deriving Partial Information Decomposition for affine systems of stable and convolution-closed distributions NeurIPS 2024 An Information-Theoretic Approach to Analyze NLP Classification Tasks ACL 2024 An information-theoretic lower bound in time-uniform estimation COLT 2024 Applying Information-theoretic Notions to Measure Effects of the Plain English Movement on English Law Reports and Scientific Articles EACL 2024 Approximate Information Tests on Statistical Submanifolds JMLR 2024 Are Female Carpenters like Blue Bananas? A Corpus Investigation of Occupation Gender Typicality ACL 2024 Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability NeurIPS 2024 A Study on the Information Mechanism of the 3rd Tone Sandhi Rule in Mandarin Disyllabic Words Interspeech 2024 BANF: Band-Limited Neural Fields for Levels of Detail Reconstruction CVPR 2024 Computing Low-Entropy Couplings for Large-Support Distributions UAI 2024 Conditions for parameter unidentifiability of linear ARX systems for enhancing security L4DC 2024 Differentiable Information Bottleneck for Deterministic Multi-view Clustering CVPR 2024 Effective Exploration Based on the Structural Information Principles NeurIPS 2024 Entropic Gromov-Wasserstein Distances: Stability and Algorithms JMLR 2024 Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization AAAI 2024 Generalization Bounds via Conditional f-Information NeurIPS 2024 Gibbs-Based Information Criteria and the Over-Parameterized Regime AISTATS 2024 H-ensemble: An Information Theoretic Approach to Reliable Few-Shot Multi-Source-Free Transfer AAAI 2024 How Much Does Nonverbal Communication Conform to Entropy Rate Constancy?: A Case Study on Listener Gaze in Interaction ACL 2024