Information Theory

Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability NeurIPS 2024 Binary Search with Distributional Predictions NeurIPS 2024 Demystifying Local & Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition ICLR 2024 Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NeurIPS 2024 Differentially Private Set Representations NeurIPS 2024 Domain Adaptation with Cauchy-Schwarz Divergence UAI 2024 Efficiently Computing Susceptibility to Context in Language Models EMNLP 2024 Efficient Multitask Dense Predictor via Binarization CVPR 2024 EmotionArcs: Emotion Arcs for 9,000 Literary Texts EACL 2024 Enhancing Evolving Domain Generalization through Dynamic Latent Representations AAAI 2024 Fundamental Limits of Non-Linear Low-Rank Matrix Estimation COLT 2024 Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models NeurIPS 2024 Generalization Bounds via Conditional f-Information NeurIPS 2024 Generalized Measures of Anticipation and Responsivity in Online Language Processing EMNLP 2024 Gibbs-Based Information Criteria and the Over-Parameterized Regime AISTATS 2024 Information Capacity Regret Bounds for Bandits with Mediator Feedback JMLR 2024 Information-theoretic Analysis of Bayesian Test Data Sensitivity AISTATS 2024 Information-theoretic Generalization Analysis for Expected Calibration Error NeurIPS 2024 Information-theoretic generalization bounds for learning from quantum data COLT 2024 Information-Theoretic Generalization Bounds for Transductive Learning and its Applications JMLR 2024 Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis COLING 2024 Learning to Write Rationally: How Information Is Distributed in Non-native Speakers’ Essays EMNLP 2024 Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization Bounds with Complexity Measures AISTATS 2024 Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models NeurIPS 2024 Lower Bounds on the Bayesian Risk via Information Measures JMLR 2024