journal article Open Access Apr 01, 2022

Non‐Gaussian Detection Using Machine Learning With Data Assimilation Applications

View at Publisher Save 10.1029/2021ea001908
Abstract
Abstract
In most data assimilation and numerical weather prediction systems, the Gaussian assumption is prevalent for the behavior of the random variables/errors that are involved. At the Cooperative Institute for Research in the Atmosphere theory has been developed for different forms of variational data assimilation schemes that enables the Gaussian assumption to be relaxed. For certain variable types, a lognormally distributed random variable can be combined in a mixed Gaussian‐lognormal distribution to better capture the interactions of the errors of different distributions. However, assuming that a distribution can change in time, then developing techniques to know when to switch between different versions of the data assimilation schemes becomes very important. By dynamically changing the formulation of the data assimilation system we are able to assimilate observations in a way that reflects the flow‐dependent variability of their distribution.

In this paper, we present results with a machine learning technique (the support vector machine) to switch between data assimilation methods based on the detection of a change in the Lorenz 1963 model's
z
component's probability distribution. Given the machine learning technique's detection/prediction of a change in the distribution, then either a Gaussian or a mixed Gaussian‐lognormal 3DVar based cost function is used to minimize the errors in this period of time. It is shown that switching from a Gaussian 3DVar to a lognormal 3DVar at lognormally distributed parts of the attractor improves the data assimilation analysis error compared to using one distribution type for the entire attractor.
Topics

No keywords indexed for this article. Browse by subject →

References
36
[13]
Non‐Gaussian Detection Using Machine Learning With Data Assimilation Applications

Michael R. Goodliff, Steven J. Fletcher, Anton J. Kliewer et al.

Earth and Space Science 10.1029/2021ea001908
[19]
Deterministic Nonperiodic Flow

Edward N. Lorenz

Journal of the Atmospheric Sciences 10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2
[20]
Nello C. (2000)
[22]
Pasini A. "External forcings and predictability in Lorenz model: An analysis via neural network modelling" Nuovo Cimento Della Societa Italiana di Fisica C‐Colloquia on Physics (2008)
[35]
Can Machines Learn to Predict Weather? Using Deep Learning to Predict Gridded 500‐hPa Geopotential Height From Historical Weather Data

Jonathan A. Weyn, Dale R. Durran, Rich Caruana

Journal of Advances in Modeling Earth Systems 10.1029/2019ms001705
Cited By
12
Earth and Space Science
Related

You May Also Like