Information Theory

Measuring Dependence with Matrix-based Entropy Functional AAAI 2021 Mirror Descent and the Information Ratio COLT 2021 Non-asymptotic Performance Guarantees for Neural Estimation of f-Divergences AISTATS 2021 One-Sketch-for-All: Non-linear Random Features from Compressed Linear Measurements AISTATS 2021 On Homophony and Rényi Entropy EMNLP 2021 On the High Accuracy Limitation of Adaptive Property Estimation AISTATS 2021 Optimal Bounds between f-Divergences and Integral Probability Metrics JMLR 2021 Optimal Quantisation of Probability Measures Using Maximum Mean Discrepancy AISTATS 2021 Optimal Rates for Nonparametric Density Estimation under Communication Constraints NeurIPS 2021 Optimizing Information Theory Based Bitwise Bottlenecks for Efficient Mixed-Precision Activation Quantization AAAI 2021 Perturbation Theory for the Information Bottleneck NeurIPS 2021 Phonetic Distance and Surprisal in Multilingual Priming: Evidence from Slavic Interspeech 2021 Pointwise Bounds for Distribution Estimation under Communication Constraints NeurIPS 2021 Precise Minimax Regret for Logistic Regression with Categorical Feature Values ALT 2021 Principal Bit Analysis: Autoencoding with Schur-Concave Loss ICML 2021 Rate-Distortion Analysis of Minimum Excess Risk in Bayesian Learning ICML 2021 Relationships Between Perceptual Distinctiveness, Articulatory Complexity and Functional Load in Speech Communication Interspeech 2021 Revisiting the Uniform Information Density Hypothesis EMNLP 2021 Sequential prediction under log-loss and misspecification COLT 2021 Sequential prediction under log-loss with side information ALT 2021 Sliced Mutual Information: A Scalable Measure of Statistical Dependence NeurIPS 2021 SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysis ACL 2021 Stochastic block model entropy and broadcasting on trees with survey COLT 2021 The Value of Information When Deciding What to Learn NeurIPS 2021 Top-k Ranking Bayesian Optimization AAAI 2021