2024
NIPS
NeurIPS 2024
Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
Abstract
Despite their spectacular progress, language models still struggle on complex reasoning tasks, such as advanced mathematics.We consider a long-standing open problem in mathematics: discovering a Lyapunov function that ensures the global stability of a dynamical system. This problem has no known general solution, and algorithmic solvers only exist for some small polynomial systems.We propose a new method for generating synthetic training samples from random solutions, and show that sequence-to-sequence transformers trained on such datasets perform better than algorithmic solvers and humans on polynomial systems, and can discover new Lyapunov functions for non-polynomial systems.
🌉
Interdisciplinary Bridge
— Artificial Intelligence and Machine Learning
🧭
Keyword Pioneer
— symbolic transformer
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Reinforcement Learning, Robotics, Speech & Audio
Authors
Topics
Artificial Intelligence > Core AI > Causal Inference
Artificial Intelligence > Core AI > Foundation Models
Machine Learning > Core Methods > Representation Learning
Machine Learning > Learning Types > Self-Supervised Learning
Mathematics & Optimization > Mathematics
Artificial Intelligence > Core AI > Reasoning
Deep Learning > Models > Transformers
Mathematics & Optimization > Optimization > Theory