Ep.6 How to fine tune a weather foundation model to hydrological variables?
From AI Extreme Weather and Climate by Zhi Li
June 30, 2025 · 10 min · Season 1 · Episode 6
About this episode
This episode evaluates the performance of the Aurora weather foundation model using lightweight decoders to predict hydrological and energy variables.
This research evaluates the performance of the Aurora weather foundation model by using lightweight decoders to predict hydrological and energy variables not included in its original training. The study highlights that this decoder-based approach significantly reduces training time and memory requirements compared to fine-tuning the entire model, while still achieving strong accuracy. A key finding is that decoder accuracy is influenced by the physical correlation between the new variables and those initially used for pretraining , suggesting that Aurora's latent space effectively captures meaningful physical relationships. The authors argue that the ability to extend foundation models to new variables without full fine-tuning is an important quality metric for Earth sciences , promoting accessibility for communities with limited computational resources. They conclude that rich latent space representations allow for accurate predictions of new variables using lightweight extensions , advocating for future foundation models that encompass a broad range of physical processes. Reference: Lehmann, F., Ozdemir, F., Soja, B., Hoefler, T., Mishra, S., & Schemm, S. (2025). Finetuning…
Topics covered
- weather foundation model
- hydrological variables
- decoder-based approach
- Earth sciences
- machine learning
Keywords
- Aurora
- fine-tuning
- training time
- memory requirements
- latent space
Mentioned in this episode
Products: Aurora weather foundation model
Places: Aurora, Earth
More episodes of AI Extreme Weather and Climate
- Target Concept Tuning: Solving the AI Blindspot in Extreme Weather Forecasting · March 24, 2026 · 0 min
- NeuralGCM: Observation-Based Hybrid Modeling for Global Precipitation Forecasting · January 15, 2026 · 15 min
- Flow-Matched Neural Operators for Continuous PDE Dynamics · December 9, 2025 · 12 min
- Ep. 11: Principals of Diffusion Models · November 5, 2025 · 18 min
- Ep 10. RainSeer: Physics-Guided Fine-Grained Rainfall Reconstruction · October 9, 2025 · 19 min
- Ep. 9: FlowCast-ODE Cntinuous Hourly Weather Forecasting with Dynamic Flow Matching and ODE Integration · September 21, 2025 · 16 min
Explore listener stats, chart rankings, contacts and more on the AI Extreme Weather and Climate podcast page.