conftrace_

hessian estimation

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

gradient annealing (1) gradient learning (1) second-order optimizer (1) second-order approximation (1) source-free unlearning (1) large language model (1) stein's lemma (1) language model pretraining (1) relu network (1) evolutionary algorithm (1)

Papers

EvoGrad: Evolutionary-Weighted Gradient and Hessian Learning for Black-Box Optimization AAAI 2026 HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization EMNLP 2025 Towards Source-Free Machine Unlearning CVPR 2025 Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training ICLR 2024 SmoothHess: ReLU Network Feature Interactions via Stein's Lemma NeurIPS 2023 Unifying Gradient Estimators for Meta-Reinforcement Learning via Off-Policy Evaluation NeurIPS 2021