How PINNs cheat: Predicting chaotic motion of a double pendulum

Sophie Steger, Franz Martin Rohrhofer, Bernhard Geiger

Publikation: KonferenzbeitragAbstractBegutachtung

Abstract

Despite extensive research, physics-informed neural networks (PINNs) are still difficult to train, especially when the optimization relies heavily on the physics loss term. Convergence problems frequently occur when simulating dynamical systems with high-frequency components, chaotic or turbulent behavior. In this work, we discuss whether the traditional PINN framework is able to predict chaotic motion by conducting experiments on the undamped double pendulum. Our results demonstrate that PINNs do not exhibit any sensitivity to perturbations in the initial condition. Instead, the PINN optimization consistently converges to physically correct solutions that violate the initial condition only marginally, but diverge significantly from the desired solution due to the chaotic nature of the system. In fact, the PINN predictions primarily exhibit low-frequency components with a smaller magnitude of higher-order derivatives, which favors lower physics loss values compared to the desired solution. We thus hypothesize that the PINNs "cheat" by shifting the initial conditions to values that correspond to physically correct solutions that are easier to learn. Initial experiments suggest that domain decomposition combined with an appropriate loss weighting scheme mitigates this effect and allows convergence to the desired solution.
Originalspracheenglisch
PublikationsstatusVeröffentlicht - 2022
VeranstaltungThe Symbiosis of Deep Learning and Differential Equations II @ the 36th Neural Information Processing Systems (NeurIPS) Conference - Hybrid Conference, Hybrider Event, New Orleans, USA / Vereinigte Staaten
Dauer: 9 Dez. 2022 → …

Workshop

WorkshopThe Symbiosis of Deep Learning and Differential Equations II @ the 36th Neural Information Processing Systems (NeurIPS) Conference
Land/GebietUSA / Vereinigte Staaten
OrtHybrider Event, New Orleans
Zeitraum9/12/22 → …

Fingerprint

Untersuchen Sie die Forschungsthemen von „How PINNs cheat: Predicting chaotic motion of a double pendulum“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren