← Keywords

kl divergence

195 papers

Explore in graph

Also known as

KULLBACK-LEIBLER KL

Co-occurring keywords

variational inference (2069) bayesian inference (1904) kullback-leibler divergence (179) language model (4573) variational autoencoder (1282) knowledge distillation (3680) large language model (12755) reinforcement learning (4122) markov chain monte carlo (724) mutual information (717)

Papers

Entropic characterization of optimal rates for learning Gaussian mixtures COLT 2023
Convergence of Stein Variational Gradient Descent under a Weaker Smoothness Condition AISTATS 2023
Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks NIPS 2023
Entropy Regularization for Population Estimation AAAI 2023
An Homogeneous Unbalanced Regularized Optimal Transport Model with Applications to Optimal Transport with Boundary AISTATS 2023
Utilising the CLT Structure in Stochastic Gradient based Sampling : Improved Analysis and Faster Algorithms COLT 2023
Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark ACL 2023
Adaptive Annealed Importance Sampling with Constant Rate Progress ICML 2023
Exploring a classification approach using quantised articulatory movements for acoustic to articulatory inversion INTERSPEECH 2023
How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm? AISTATS 2023
On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting NIPS 2022
Fast Rank-1 NMF for Missing Data with KL Divergence AISTATS 2022
Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithm AISTATS 2022
Learning Proposals for Practical Energy-Based Regression AISTATS 2022
On the Robustness to Misspecification of α-posteriors and Their Variational Approximations JMLR 2022
Fast Relative Entropy Coding with A* coding ICML 2022
Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling ICML 2022
EPro-PnP: Generalized End-to-End Probabilistic Perspective-N-Points for Monocular Object Pose Estimation CVPR 2022
Greedification Operators for Policy Optimization: Investigating Forward and Reverse KL Divergences JMLR 2022
RL with KL penalties is better viewed as Bayesian inference EMNLP 2022
Markov Chain Score Ascent: A Unifying Framework of Variational Inference with Markovian Gradients NIPS 2022
Sampling in Constrained Domains with Orthogonal-Space Variational Gradient Descent NIPS 2022
Are GANs overkill for NLP? NIPS 2022
Split-kl and PAC-Bayes-split-kl Inequalities for Ternary Random Variables NIPS 2022
Probabilistic Fusion of Neural Networks that Incorporates Global Information ACML 2022