How Forecasting Builds on Both Weather and Climate Research

How Forecasting Builds on Both Weather and Climate Research

Sharing is caring!

Hannah Frey, M.Sc. Agriculture

The Revolutionary AI-Powered Forecasting Models Transform Traditional Weather Prediction

The Revolutionary AI-Powered Forecasting Models Transform Traditional Weather Prediction (image credits: unsplash)
The Revolutionary AI-Powered Forecasting Models Transform Traditional Weather Prediction (image credits: unsplash)

The meteorological world is undergoing a massive transformation right before our eyes. In January, the European Centre for Medium-Range Weather Forecasts (ECMWF) – a world leader in forecasting global weather conditions up to a few weeks out – quietly went live with the planet’s first fully operational weather forecast system powered by artificial intelligence. These new AI systems aren’t just slightly better – they’re game-changers. The new A.I. forecasts are, by leaps and bounds, easier, faster, and cheaper to produce than the non-A.I. variety, using 1,000 times less computational energy.

What makes this development absolutely mind-blowing is the accuracy improvements. The ECMWF says that for some weather phenomena, the AIFS is 20 percent better than its state-of-the-art physics-based models. Think about that – we’re talking about systems that have been refined for decades suddenly being outperformed by machines that learn from historical weather patterns.

How Modern AI Systems Beat Supercomputers at Their Own Game

How Modern AI Systems Beat Supercomputers at Their Own Game (image credits: unsplash)
How Modern AI Systems Beat Supercomputers at Their Own Game (image credits: unsplash)

Starting in 2022, several major technology companies and academics released A.I.-based weather forecasting systems: Notably, Google Deepmind released GraphCast; CalTech researchers published a system called FourCast; and the Chinese company Huawei developed Pangu-Weather. The competition has been fierce, and the results are stunning. One September 2024 study looked at five stand-out A.I.-based weather forecasting systems that are “comparable, and in some cases, superior” to the ECMWF’s numerical prediction system – while being orders of magnitude more computationally efficient.

The speed difference is almost hard to believe. Data-driven models trained on reanalysis data can provide effective forecasts with an accuracy (ACC) greater than 0.6 for up to 15 days at a spatial resolution of 0.25°. These models outperform or match the most advanced NWP methods for 90% of variables, reducing forecast generation time from hours to seconds. This isn’t just an incremental improvement – it’s like comparing a horse-drawn carriage to a Ferrari.

Emerging AI Weather Systems Show Promise

Emerging AI Weather Systems Show Promise (image credits: wikimedia)
Emerging AI Weather Systems Show Promise (image credits: wikimedia)

Researchers continue to develop new AI-driven weather forecasting systems that aim to combine observations from satellites, weather stations, ships and other sensors into unified models. Some experimental systems are being designed to yield high-resolution global and local forecasts using purely AI-driven approaches from start to finish.

These emerging systems aim to provide specially tailored forecasts while requiring less computational power than traditional models, with results potentially available within minutes. Early research suggests that with reduced input data requirements, such systems could compete with established forecasting models, though widespread implementation remains in development stages.

Climate Research Data Feeds the AI Revolution

Climate Research Data Feeds the AI Revolution (image credits: flickr)
Climate Research Data Feeds the AI Revolution (image credits: flickr)

The foundation of these remarkable AI systems lies in decades of climate research and data collection. Groundbreaking data-driven models showed that machine learning (ML) emulators trained on the ERA5 reanalysis are capable of achieving the skill of the flagship deterministic weather forecast from the European Centre for Medium-Range Weather Forecasts (ECMWF) at ∼1/1000 cost of the traditional model. The ERA5 reanalysis represents one of the most comprehensive climate datasets ever assembled, combining historical observations with advanced modeling techniques.

This marriage between historical climate data and modern AI techniques creates something extraordinary. The AIFS uses the same initial conditions for its forecasts as the IFS. These are based on the combination of a previous short-term forecast with around 60 million quality-controlled observations from satellites as well as many other streams, including from planes, boats, sea buoys and many other Earth-based measurement stations. Every six hours, this massive data stream feeds into systems that have learned from decades of weather patterns.

Ensemble Forecasting Meets Machine Learning Innovation

Ensemble Forecasting Meets Machine Learning Innovation (image credits: pixabay)
Ensemble Forecasting Meets Machine Learning Innovation (image credits: pixabay)

Traditional weather forecasting relies heavily on ensemble methods – running multiple simulations with slightly different starting conditions to capture uncertainty. Advanced AI systems are being developed to accurately generate ensemble forecasts (i.e. a range of likely future weather scenarios), better than current ensemble models most widely used today. This helps decision-makers better understand weather uncertainties and risks of extreme conditions. Google’s GraphCast represents a massive leap forward in probabilistic forecasting.

ECMWF is pushing this model to create a collection of 50 different forecasts with slight variations at any given time to provide the full range of possible scenarios. This is known as ensemble modelling, a technique developed and implemented by ECMWF more than thirty years ago. The combination of traditional ensemble techniques with AI-powered speed creates unprecedented forecasting capabilities.

Extreme Weather Forecasting Gets a Major Upgrade

Extreme Weather Forecasting Gets a Major Upgrade (image credits: pixabay)
Extreme Weather Forecasting Gets a Major Upgrade (image credits: pixabay)

One of the most exciting developments is how AI systems are improving extreme weather prediction. Early results also show enhanced skill of the new data-driven models in predicting extreme life-threatening events like hurricanes, winter storms, and heatwaves. This improvement could literally save thousands of lives by providing more accurate advance warnings.

The first available is our new experimental cyclone prediction model. It can predict where cyclones will form, and their likely path, up to 15 days in advance. The model can also forecast cyclone intensity, size, and structure. Imagine being able to track a hurricane’s path and intensity two full weeks before it makes landfall – that’s the kind of advance warning that allows for proper evacuation and preparation.

Data-Driven Models Bridge the Gap Between Observation and Prediction

Data-Driven Models Bridge the Gap Between Observation and Prediction (image credits: pixabay)
Data-Driven Models Bridge the Gap Between Observation and Prediction (image credits: pixabay)

The integration of climate research data with modern forecasting represents a fundamental shift in methodology. The authors present FuXi Weather, a machine learning-based global forecasting system that cycles data assimilation and forecasting, delivering accurate 10-day forecasts and outperforming numerical weather prediction models in observation-sparse regions like central Africa. This is particularly important for regions that have historically lacked adequate weather monitoring infrastructure.

However, forecast accuracy tends to be lower in low-income countries, largely due to limited investment in weather observation infrastructure. This issue is especially concerning for many low-income countries, where agriculture is a major economic sector that relies heavily on accurate weather forecasts. AI-driven systems offer hope for democratizing accurate weather forecasting worldwide.

Machine Learning Transforms Computational Weather Science

Machine Learning Transforms Computational Weather Science (image credits: wikimedia)
Machine Learning Transforms Computational Weather Science (image credits: wikimedia)

The computational advantages of AI systems are reshaping the entire field of meteorology. While Numerical Weather Prediction (NWP) remains the gold standard, it faces challenges like inherent atmospheric uncertainties and computational costs, especially in the post-Moore era. With the advent of deep learning, the field has been revolutionized through data-driven models. We’re witnessing the end of the era where only nations with massive supercomputers could produce high-quality weather forecasts.

Faster and cheaper forecast production means that poorer countries should be able to produce their own custom forecasts. This democratization of forecasting capability could transform how weather information reaches vulnerable populations worldwide, potentially saving countless lives and improving economic outcomes in developing regions.

NOAA Embraces the AI Revolution in Weather Prediction

NOAA Embraces the AI Revolution in Weather Prediction (image credits: pixabay)
NOAA Embraces the AI Revolution in Weather Prediction (image credits: pixabay)

Government agencies are rapidly adapting to incorporate these revolutionary technologies. To respond to the emergence of the data-driven models for numerical weather prediction, NOAA Research, NOAA’s National Weather Service, and NOAA Cooperative Institutes convened a 2-day hybrid workshop in Boulder, Colorado. Participants discussed the following: Opportunities and barriers for incorporating emerging data-driven models into the NOAA research-to-operations pipeline.

By embracing this opportunity and establishing collaborations across government agencies and with the private and academic sectors, NOAA can play a key role in what could be a once-in-a-generation innovation in numerical weather prediction. Seizing this opportunity will ensure that the nation’s people and commerce have access to accurate and timely weather forecasts and are prepared for emerging threats from changing climate and extreme weather conditions. The integration of public and private sector capabilities is creating unprecedented opportunities for advancement.

Future Weather Prediction Blends Physics with AI Innovation

Future Weather Prediction Blends Physics with AI Innovation (image credits: unsplash)
Future Weather Prediction Blends Physics with AI Innovation (image credits: unsplash)

The future of forecasting isn’t about replacing traditional physics-based models entirely, but rather creating powerful hybrid systems. Overall, A.I. is just one more tool that will help make the forecast data ever better and easier to produce, opening the door for nations that can’t afford their own supercomputers. But A.I. is unlikely to replace physical models in the near future, says Ramsdale and, he says, it will never replace human expertise and accountability: “We still need people to turn the data into a usable piece of advice.”

The rapid pace of development is staggering. Andrew Charlton-Perez, a meteorologist at the University of Reading who also heads up that institution’s school of computational sciences, expects plenty more operational A.I. forecasts to follow – from both national weather agencies and companies like Google. “This field is just moving at a ridiculous speed,” he says. We’re living through a golden age of meteorological innovation that’s transforming how we understand and predict our planet’s weather systems.

Conclusion

Conclusion (image credits: flickr)
Conclusion (image credits: flickr)

The convergence of climate research data, artificial intelligence, and traditional forecasting methods is creating a revolution in weather prediction that seemed impossible just a few years ago. From AI systems that can run on desktop computers to ensemble forecasts that provide unprecedented accuracy, we’re witnessing the birth of a new era in meteorology. These advances aren’t just technological marvels – they’re practical tools that will help society adapt to an increasingly unpredictable climate, protect vulnerable populations, and make better decisions about everything from agriculture to energy production. The marriage of decades of climate research with cutting-edge machine learning is proving that sometimes the most powerful innovations come from combining the wisdom of the past with the possibilities of the future. What other impossible-seeming advances await us in the next decade?

About the author
Hannah Frey, M.Sc. Agriculture
Hannah Frey is a climate and sustainable agriculture expert dedicated to developing innovative solutions for a greener future. With a strong background in agricultural science, she specializes in climate-resilient farming, soil health, and sustainable resource management.

Leave a Comment