2024
NeurIPS
NeurIPS 2024
Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
Abstract
Despite their spectacular progress, language models still struggle on complex reasoning tasks, such as advanced mathematics.We consider a long-standing open problem in mathematics: discovering a Lyapunov function that ensures the global stability of a dynamical system. This problem has no known general solution, and algorithmic solvers only exist for some small polynomial systems.We propose a new method for generating synthetic training samples from random solutions, and show that sequence-to-sequence transformers trained on such datasets perform better than algorithmic solvers and humans on polynomial systems, and can discover new Lyapunov functions for non-polynomial systems.
🌉
Interdisciplinary Bridge
- Artificial Intelligence and Mathematics & Optimization
Authors
Topics
Artificial Intelligence > Core AI > Causal Inference
Artificial Intelligence > Core AI > Foundation Models
Machine Learning > Core Methods > Representation Learning
Machine Learning > Learning Types > Self-Supervised Learning
Deep Learning > Architectures > Transformers
Mathematics & Optimization > Mathematics
Artificial Intelligence > Core AI > Reasoning
Mathematics & Optimization > Optimization > Theory