Your paper timeline
Scroll AI takes the way you would scroll a great paper aggregator: quick signal first, deeper critique when something earns your attention, and challenges when a claim feels off.
3 papers in nlin.CD
Trending mixes fresh papers with community signal.
0
cs.LGcs.AInlin.CD Tobias G\"obel, Miranda C.N. Cheng · Oct 22, 2026

Parametric dynamical systems supply a rare benchmark with analytic ground truth for weight-space methods, because bifurcation locations are known exactly. The paper extends JEPAWG—a joint-embedding hypernetwork originally developed for lattice field theories—to populations of forecasters trained across a grid of control parameters. Its core idea is to decode weights at unseen parameters and measure their parameter derivative $G(p) = \|\nabla_p \hat{\theta}(p)\|_F$, treating this response as an interpretable probe of local and global bifurcations. The work matters because it offers a falsifiable testbed for reading physical structure directly from the geometry of trained network weights.

Trained network weights are increasingly treated as data, but there is rarely ground truth about what a population of models should encode, which hampers systematic validation of weight-space methods. This makes parametric dynamical systems a natural test-bed: the dynamics change qualitatively at submanifolds of parameter space that are, in well-studied families, known analytically or numerically. Fine-tuning a forecasting network at each point of a parameter grid yields a model zoo indexed by a physical parameter, against which weight-space diagnostics can be checked. We build such model zoos for four dynamical systems and analyse them with JEPAWG, a recently proposed joint-embedding hypernetwork built around a learned parameter--weight representation. It was first introduced for neural samplers for lattice field theories, where its latent geometry located the phase transition and estimated the 2D Ising critical exponent. Applied to dynamical systems, JEPAWG is competitive on forecasting with a hypernetwork trained directly for that task, despite being supervised on the parameter--weight correspondence rather than on forecasts. Beyond forecasting, the norm of the parameter-derivative of the decoded weights locates Hopf points and curves, tracks a period-doubling cascade closely enough to give a qualitative estimate of the Feigenbaum constant, and detects a global bifurcation, which has no eigenvalue signature and is therefore invisible to linearisation. As such, JEPAWG provides interpretable insight into the dynamics that is not available from other hypernetworks. Together, these results indicate that JEPAWG is a workable instrument for reading physical structure off a population of trained networks.
0
cs.LGcs.SYeess.SY Luka Todorovic, Kaushal Gianchandani, Sai Ravela · Oct 14, 2026

Neural emulation need not require learning a substitute for known physics. This paper investigates PolyNets that compile continuous-time polynomial dynamics and discrete-time RK4 integration into a single tensor graph, benchmarking the approach on the 1D Korteweg–de Vries equation against classical CPU/GPU solvers and three trained neural models. The central finding is that when governing coefficients are known, the resulting network requires no training yet preserves numerical fidelity while achieving competitive GPU throughput.

Neural emulation need not require learning a substitute for known physics. We investigate PolyNets that couple a continuous-time neural representation of polynomial dynamics with a simple recurrent network for discrete-time integration. When the governing coefficients are known, the resulting tensor graph requires no training and preserves the prescribed numerical scheme while enabling efficient hardware execution and parallel simulation. Using the one-dimensional Korteweg-de Vries equation, we compare PolyNet with CPU and GPU finite-difference Runge-Kutta solvers and three trained neural models: a state-map emulator, a physics-informed predictor, and a learned-tendency integrator. Analytical soliton solutions provide a reference for amplitude and phase errors across grid resolutions, 10^6 dispersively scaled time steps, ensembles of up to 10^4 trajectories, and varying initial amplitudes. PolyNet achieves accuracy comparable to the numerical solvers, including at amplitudes outside the learned models' training conditions. It combines this fidelity with high GPU throughput, approximately constant over the tested resolution range, and favorable ensemble scaling.
0
cs.LGnlin.CD Hiroto Tamura, Gouhei Tanaka · Oct 1, 2026

This paper addresses the challenge of learning minimal, interpretable piecewise-linear representations of unknown nonlinear dynamical systems from time-series data. The authors propose training a higher-capacity almost-linear RNN first, then hierarchically reducing it via a fixed-point-guided procedure that linearizes redundant ReLU units while preserving distinct fixed-point symbols, and finally retraining the compact model from the parent initialization. The central insight is that redundant nonlinear capacity can act as a structural and optimization scaffold for discovering reliable minimal models, which matters because directly training at the theoretical minimal capacity often fails catastrophically.

Understanding a nonlinear dynamical system from time series requires not only reproducing its trajectories, but also identifying a simple representation that preserves its essential dynamical structure. Almost-linear recurrent neural networks (AL-RNNs) are piecewise-linear RNNs in which only a subset of units use ReLU nonlinearities, so that nonlinear capacity is explicitly controlled by the number of ReLU units. Their activation patterns define linear regions, represented as symbols, whose observed transitions form a symbolic transition graph. However, directly training AL-RNNs with few ReLU units to realize minimal dynamical representations can be unreliable. We ask whether an AL-RNN with more ReLU units can instead be trained first and systematically reduced to a minimal dynamical representation. We introduce a fixed-point-guided hierarchical reduction procedure that progressively linearizes selected ReLU units, merging neighboring linear regions and graph nodes while preserving distinct symbols containing fixed points (FPs). The resulting reduction tree defines a hierarchy of progressively simpler candidates. Each reduced candidate is initialized from the parent parameters and retrained under guidance from the parent dynamics. We also prove that reproducing $Q$ distinct fixed points requires at least $Q$ FP-containing symbols, providing a certificate of symbol-level minimality when this bound is attained. On the 3-scroll Chua system, direct training with the theoretical minimum of three ReLU units achieves high-fidelity minimal realizations in only 20% of seeds, whereas our learn-reduce-retrain strategy increases the seed-macro success rate to approximately 71% at the same final nonlinear capacity. These results show that redundant nonlinear capacity can serve as a scaffold for discovering and realizing minimal dynamical representations.