A Robust In-Context Model for Conservation Laws: Injecting Context into Flux Neural Operators via Recurrent Vision Transformers
Research paper by Taeyoung Kim and collaborators. arXiv record dated 2026-08-20. Research area: Machine learning.
Resource information
- Authors
- Taeyoung Kim, Joon-Hyuk Ko
- Research area
- Machine learning
- Application domain
- General AI research
- AI methods
- Transformers
- Research topics
- cs.LG
- arXiv record date
- 2026-08-20
- Publication
- arXiv
- Upstream last modified
- Aug 21, 2026
- Last record update
- Nov 4, 2026
Abstract
We propose an architecture that augments the Flux Neural Operator (Flux NO), which combines the classical finite volume method (FVM) with neural operators, with ViT-based context injection. Our model is formulated as a hypernetwork: it extracts solution dynamics over a finite temporal window, encodes them with a recurrent Vision Transformer, and generates the parameters of a context-conditioned neural operator. This enables the model to infer and solve conservation laws without explicit access to the governing equation or PDE coefficients. Experimentally, we show that the proposed method preserves the robustness, generalization ability, and long-time prediction advantages of Flux NO over standard neural operators, while delivering reliable numerical solutions across a broad range of conservative systems, including previously unseen fluxes. Our code is available at https://github.com/xx257xx/CONTEXT_FLUX_NO.