information theory

489 papers

Explore in graph

Also known as

IP IT

Co-occurring keywords

mutual information (717) representation learning (6174) sample complexity (1158) language model (4573) generalization bound (649) learning theory (518) large language model (12755) causal inference (1619) statistical learning (350) unsupervised learning (3255)

Papers

Searching for and Avoiding Hidden Sets Using Queries with Local Feedback AAAI 2025

Speculative Sampling via Exponential Races ACL 2025

Semantic Geometry of Sentence Embeddings EMNLP 2025

Can LLMs Obfuscate Code? A Systematic Analysis of Large Language Models into Assembly Code Obfuscation AAAI 2025

A Grounded Typology of Word Classes NAACL 2025

Entrospect: Information-Theoretic Self-Reflection Elicits Better Response Refinement of Small Language Models ACL 2025

Information Theoretic Pruning of Coupled Channels in Deep Neural Networks WACV 2025

Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accent ACL 2025

Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages ACL 2025

Optimization Over a Probability Simplex JMLR 2025

Optimal Viewpoint Selection for Autonomous Photography Using Reinforcement Learning AAAI 2025

Disentangling Biased Representations: A Causal Intervention Framework for Fairer NLP Models ACL 2025

Trade-Offs Between Information and Crowding in Sequential Decisions (Student Abstract) AAAI 2025

Noise May Drown Out Words but Foster Compositionality: The Advantage of the Erasure and Deletion Noisy Channels on Emergent Communication IJCNLP 2025

Sequence Complementor: Complementing Transformers for Time Series Forecasting with Learnable Sequences AAAI 2025

Can information theory unravel the subtext in a Chekhovian short story? ACL 2025

Information Locality as an Inductive Bias for Neural Language Models ACL 2025

Information-Theoretic Generative Clustering of Documents AAAI 2025

West Germanic noun-noun compounds and the morphology-syntax trade-off NAACL 2025

Information Theory and Linguistic Variation: A Study of Brazilian and European Portuguese COLING 2025

On the Correspondence between the Squared Norm and Information Content in Text Embeddings EMNLP 2025

An Information-theoretic Multi-task Representation Learning Framework for Natural Language Understanding AAAI 2025

Learning Robust and Privacy-Preserving Representations via Information Theory AAAI 2025

What Makes for Good Image Captions? EMNLP 2025

Evaluating Sequence Labeling on the basis of Information Theory ACL 2025