information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Learning Embeddings for Sequential Tasks Using Population of Agents IJCAI 2024

Analyzing Chain-of-thought Prompting in Black-Box Large Language Models via Estimated V-information COLING 2024

Minimum Entropy Coupling with Bottleneck NIPS 2024

Optimal Zero-Shot Detector for Multi-Armed Attacks AISTATS 2024

Increasing information for model predictive control with semi-Markov decision processes L4DC 2024

Perplexing Canon: A study on GPT-based perplexity of canonical and non-canonical literary works EACL 2024

Applying Information-theoretic Notions to Measure Effects of the Plain English Movement on English Law Reports and Scientific Articles EACL 2024

An information-theoretic lower bound in time-uniform estimation COLT 2024

Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning NAACL 2024

Harnessing Multiple Correlated Networks for Exact Community Recovery NIPS 2024

Efficiently Computing Susceptibility to Context in Language Models EMNLP 2024

The Semantic Relations in LLMs: An Information-theoretic Compression Approach COLING 2024

Generalized Measures of Anticipation and Responsivity in Online Language Processing EMNLP 2024

Approximate Information Tests on Statistical Submanifolds JMLR 2024

Exploring Word Formation Trends in Written, Spoken, Translated and Interpreted European Parliament Data – A Case Study on Initialisms in English and German COLING 2024

SaGE: Evaluating Moral Consistency in Large Language Models COLING 2024

Surprise! Uniform Information Density Isn’t the Whole Story: Predicting Surprisal Contours in Long-form Discourse EMNLP 2024

Did You Get It? A Zero-Shot Approach to Locate Information Transfers in Conversations COLING 2024

Differentially Private Set Representations NIPS 2024

Information-Theoretic Opacity-Enforcement in Markov Decision Processes IJCAI 2024

Towards a Similarity-adjusted Surprisal Theory EMNLP 2024

Diffusion PID: Interpreting Diffusion via Partial Information Decomposition NIPS 2024

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models NIPS 2024

Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning NIPS 2024

Information-theoretic Limits of Online Classification with Noisy Labels NIPS 2024