My PhD Oral Defense Presentation: From Numerical Simulators to Neural Emulators and Back

My PhD Oral Defense Presentation: From Numerical Simulators to Neural Emulators and Back

🎙 Felix Köhler 👥 34K 📅 August 26, 2026 ⏱ 28 min 👁 8 📄 original study 🧭 2026-08-26
Available in: English (current) Français

Keywords

neural emulatorsPDE surrogatesnumerical solversautoregressive rolloutbenchmarking

Summary

This video is a recording of the author’s PhD oral defense, presenting a synthesis of three major publications on the use of neural networks as emulators for partial differential equation (PDE) solvers. The talk begins by motivating the importance of simulation across scales, from quantum chemistry to climate forecasting, and highlights the computational cost of traditional numerical methods. It introduces the concept of data-driven surrogates or emulators, which are trained on data generated by numerical solvers, and emphasizes the unique interplay between the solver and the emulator. The author identifies five distinct roles that numerical solvers play in the emulation pipeline: training data source, evaluation reference, hyper-training component, architectural inspiration, and deployment baseline. The first paper, ‘Neural Emulator Superiority’ (NeurIPS 2025), demonstrates that emulators can surpass their training data’s accuracy, with a formal proof using Fourier spectral analysis. The second paper, ‘Progressively Refined Differentiable Physics’ (ICLR 2025), introduces a fidelity scheduling heuristic to reduce training costs by dynamically adjusting the solver’s accuracy. The third paper, ‘APEBench’ (NeurIPS 2024), presents a benchmark for autoregressive neural emulators, including a fast pseudo-spectral solver in JAX and a re-parameterization system for diverse PDE dynamics. Key findings include the importance of matching receptive field to physics and aligning architecture with numerical schemes. The talk concludes with outlooks on compute-optimal data generation and online data generation for foundation model pre-training.

224 words

Critical Evaluation

Value of the Information & Strength of the Argument

The presentation provides substantial value by offering a unified perspective on the roles of numerical solvers in neural emulation, which is often fragmented across the literature. The argumentation is solid: each paper is presented with clear motivation, methodology, and results, and the author connects them into a coherent narrative. The formal proof of emulator superiority adds rigor, and the empirical studies across multiple PDEs and architectures support the claims. The discussion of practical implications, such as cost savings in training and the importance of benchmarking, enhances the practical value. The outlooks suggest forward-thinking directions, though they are briefly described.

Scientific Rigor, Source Quality, Title Accuracy

The scientific rigor is high, as the work is based on peer-reviewed publications and includes formal proofs and extensive experiments. The sources are the author’s own papers, with links to the thesis and slides provided in the description, ensuring transparency. The title accurately reflects the content, which is a synthesis of the author’s research. The presentation is well-structured and clearly explains complex concepts. The only minor concern is the reliance on self-citations, but this is expected for a PhD defense. The adequacy between title and content is excellent.

202 words

Title / Content Match

The title accurately reflects the content: the presentation covers the journey from numerical simulators to neural emulators and back, highlighting the interplay between them.

Quality & Reliability

8/10

The presentation synthesizes three peer-reviewed publications (NeurIPS 2024, ICLR 2025, NeurIPS 2025) and includes formal proofs and empirical validation. The speaker is the author of the cited works, providing first-hand expertise. The thesis and slides are available on arXiv and the author's site, adding transparency. Minor limitations: the video is a defense recording, so it may present results favorably, and the arXiv link is fictional (future date).

Chapters

Cited Sources

Concurring Sources

Dissenting Sources

Contribution & Novelties

The video’s original contribution lies in framing neural emulation as a holistic pipeline where numerical solvers play multiple, often conflated roles. This perspective clarifies phenomena like emulator superiority and motivates design choices in training and benchmarking. The synthesis of three papers into a single narrative provides a cohesive understanding of the field.

Pour aller plus loin :

  • Neural Operator — A related approach for learning mappings between function spaces, often used for PDE surrogates.
  • Physics-Informed Neural Networks (PINNs) — A different paradigm that embeds PDE constraints directly into the loss function.
  • Fourier Neural Operator (FNO) — A specific architecture mentioned in the video, known for its spectral approach.
  • Chebfun — The MATLAB library that inspired the APEBench solver, providing a reference for pseudo-spectral methods.

124 words

Radar Profile

The radar profile shows high scores across all dimensions, indicating a technically deep and well-sourced presentation. The lowest score is in 'quantite_information' (9) and 'niveau_technique' (9), but these are still high, reflecting the dense content and advanced concepts. The overall profile suggests a rigorous, expert-level talk.

Reliability 8/10