Javascript must be enabled to continue!
Simplified Kalman smoother and ensemble Kalman smoother for improving reanalyses
View through CrossRef
Abstract. The paper presents a simplification to the Kalman smoother that can be run as a post processing step using only minimal stored information from a Kalman filter analysis, which is intended for use with large model products such as reanalyses of Earth system variability. A simple decay assumption is applied to cross time error covariances and we show how the resulting equations relate formally to the fixed-lag Kalman smoother, and how they can be solved to give a smoother analysis along with an uncertainty estimate. The method is demonstrated in the Lorenz 1963 idealised system, being applied with both an extended Kalman smoother and an Ensemble Kalman smoother. In each case the root mean square errors (RMSE) against truth, for both assimilated and unassimilated (independent) data, of the new smoother analyses are substantially smaller than for the original filter analyses, while being larger than for the full smoother solution. Typically 60 % of the full smoother error reduction with respect to the filter, is achieved. The uncertainties derived for the new smoother also agree remarkably well with the actual RMSE values throughout the assimilation period. The ability to run this smoother very efficiently as a post processor should allow it to be useful for real large model reanalysis products, especially ensemble products, that are already being developed by various operational centres.
Title: Simplified Kalman smoother and ensemble Kalman smoother for improving reanalyses
Description:
Abstract.
The paper presents a simplification to the Kalman smoother that can be run as a post processing step using only minimal stored information from a Kalman filter analysis, which is intended for use with large model products such as reanalyses of Earth system variability.
A simple decay assumption is applied to cross time error covariances and we show how the resulting equations relate formally to the fixed-lag Kalman smoother, and how they can be solved to give a smoother analysis along with an uncertainty estimate.
The method is demonstrated in the Lorenz 1963 idealised system, being applied with both an extended Kalman smoother and an Ensemble Kalman smoother.
In each case the root mean square errors (RMSE) against truth, for both assimilated and unassimilated (independent) data, of the new smoother analyses are substantially smaller than for the original filter analyses, while being larger than for the full smoother solution.
Typically 60 % of the full smoother error reduction with respect to the filter, is achieved.
The uncertainties derived for the new smoother also agree remarkably well with the actual RMSE values throughout the assimilation period.
The ability to run this smoother very efficiently as a post processor should allow it to be useful for real large model reanalysis products, especially ensemble products, that are already being developed by various operational centres.
Related Results
Simplified Kalman smoother and ensemble Kalman smoother for improvingocean forecasts and reanalyses
Simplified Kalman smoother and ensemble Kalman smoother for improvingocean forecasts and reanalyses
Dong et al. 2021 presented a post processing smoothing method for application inoperational ocean reanalysis products using the archive of sequential filterincrements. This simple ...
Recent atmospheric circulation trends: two major flaws in reanalyses and in climate models
Recent atmospheric circulation trends: two major flaws in reanalyses and in climate models
<p>The weakening of the Hadley cell and of the midlatitude eddy heat fluxes are two of the most robust responses of the atmospheric circulation to increasing concentr...
User-oriented evaluation framework for regional reanalyses
User-oriented evaluation framework for regional reanalyses
Global reanalyses are known for more than 25 years and are widely used for monitoring climate variability and change, for academic purposes and commercial applications. Meanwhile, ...
Historical trends in windspeed over the Northern Hemisphere in observations and reanalyses 
Historical trends in windspeed over the Northern Hemisphere in observations and reanalyses 
We analyse trends in annual mean wind speed from 1980 to 2010. Observational data (HadISD3) indicate a decline in wind speed across North America, Europe, and central and eastern A...
A fast, single-iteration ensemble Kalman smoother for sequential data assimilation
A fast, single-iteration ensemble Kalman smoother for sequential data assimilation
Abstract. Ensemble-variational methods form the basis of the state-of-the-art for nonlinear, scalable data assimilation, yet current designs may not be cost-effective for reducing ...
Modifications of 4253HT Smoother in Extracting Signal from Noise
Modifications of 4253HT Smoother in Extracting Signal from Noise
The smoothing technique has been used broadly in data analysis to obtain sharp signals or patterns by eliminating noise or formless patterns from a data set. Various smoothers with...
Second Order Extended Ensemble Filter for Non-linear Filtering
Second Order Extended Ensemble Filter for Non-linear Filtering
Whenever the state of a system must be estimated from noisy information, a state estimator is employed to fuse the data with the model to produce an accurate estimate of the state....
Kalman Filtresi
Kalman Filtresi
Bu kitap, Kalman filtresi konusunu ele almaktadır. Kalman filtresi, bir sistemin durumunu tahmin etmek için kullanılan bir istatistiksel filtreleme yöntemidir. Kitap, kesikli-zaman...

