 FULL PAPER
 Open Access
 Published:
Stochastic forecasting of the geomagnetic field from the COVOBS.x1 geomagnetic field model, and candidate models for IGRF12
Earth, Planets and Space volume 67, Article number: 71 (2015)
Abstract
We present the geomagnetic field model COVOBS.x1, covering 1840 to 2020, from which have been derived candidate models for the IGRF12. Towards the most recent epochs, it is primarily constrained by first differences of observatory annual means and measurements from the Oersted, Champ, and Swarm satellite missions. Stochastic information derived from the temporal spectra of geomagnetic series is used to construct the a priori model covariance matrix that complements the constraint brought by the data. This approach makes it possible the use of a posteriori model errors, for instance, to measure the ‘observations’ uncertainties in data assimilation schemes for the study of the outer core dynamics.
We also present and illustrate a stochastic algorithm designed to forecast the geomagnetic field. The radial field at the outer core surface is advected by core motions governed by an autoregressive process of order 1. This particular choice is motivated by the slope observed for the power spectral density of geomagnetic series. Accounting for timecorrelated model errors (subgrid processes associated with the unresolved magnetic field) is made possible thanks to the use of an augmented state ensemble Kalman filter algorithm. We show that the envelope of forecasts includes the observed secular variation of the geomagnetic field over 5year intervals, even in the case of rapid changes. In a purpose of testing hypotheses about the core dynamics, this prototype method could be implemented to build the ‘state zero’ of the ability to forecast the geomagnetic field, by measuring what can be predicted when no deterministic physics is incorporated into the dynamical model.
Background
The 12th generation of the IGRF has been computed from several candidates by different institutes, all submitted in September 2014 for evaluation by the IGRF working group (Thébault et al. 2015). We present here our proposed candidates for the main field (MF) DGRF model in 2010, IGRF in 2015, and the time average secular variation (SV) prediction over 2015 to 2020, together with their associated uncertainties. These are derived from the COVOBS.x1 field model and its posterior model error covariance matrix. This model, that covers the observatory era since 1840, is primarily constrained at recent epochs by first differences of observatory annual means (OAM) and by satellite observations, including data from the Swarm constellation (Olsen et al. 2013). It differs from regularized field models in the sense that the information contained into observations is complemented with a stochastic a priori information derived from temporal spectra of geomagnetic series, following Gillet et al. (2013). The a priori information integrated in the construction of COVOBStype models makes it possible to use the model errors, as estimated from the posterior covariance matrix, in data assimilation algorithms designed to reanalyze or forecast the outer core dynamics (Fournier et al. 2010). However, being derived over a long timespan, it cannot contain a detailed description of external magnetic signals (as in the comprehensive approach, see Sabaka et al. 2015). This leads to a compromise where external sources are handled in a simple way in comparison with models built exclusively from the most recent observations (e.g., Lesur et al. 2010; Olsen et al. 2014).
We also present a test SV prediction (time average over 2015 to 2020) based on a stochastic model of the flow at the coremantle boundary, using an augmented state ensemble Kalman filter (EnKF, see Evensen 2003). This prototype method is presented as a proof of concept study. It should be considered as an attempt to produce a ‘state zero’ of the ability to forecast the geomagnetic field, i.e., a measure of our ignorance when we have no deterministic knowledge about the core physics and only have access to statistical information. It may be used in the future for the purpose of validating geomagnetic data assimilation algorithms (Fournier et al. 2010). Possibilities for future improvements are listed in the ‘Conclusions’ section.
Methods
Derivation of the COVOBS.x1 field model
Data selection
Our data selection process follows closely that used to construct the original COVOBS field model. Full details can be found in Gillet et al. (2013) ; here, we only briefly describe the new or updated aspects of the datasets. Again, the most important data sources are satellite data, as measured by highprecision magnetometers on low Earthorbiting missions (in particular, CHAMP, Oersted, and Swarm) and observatory annual means.
Regarding satellite data, we used data from ESA’s Swarm satellite trio (FriisChristensen et al. 2006) and also reselected data from CHAMP, Oersted, and SACC, taking as a basis the dataset employed for a recent update of the CHAOS4 field model (CHAOS4plus_V4, Olsen et al. 2014). Most importantly for our IGRF12 candidate models, the Swarm data used were ESA Level 1B operational data from 26th November 2013 to 17th August 2014 (baseline 0302 until 4th July 2014, baseline 0301 thereafter). Only quiettime, nightside data were selected according to the CHAOS4 criteria, and vector data were used only up to 55° degrees quasidipole latitude; at high latitudes, scalar intensity data were used. Following the procedure previously introduced for the COVOBS model, the CHAOS4plus_V4 dataset was then subsampled onto a grid of 72 cells in longitude by 36 cells in cosine latitude, with each cell refilled each year using random sampling from the data falling within that cell during the year. This provided a geographical and temporal coverage sufficient for studying the main field up to degree 14 and its secular variation up to degree 8, as required for IGRF, while avoiding problems due to alongtrack correlated errors. Vector data were selected where possible (preferentially CHAMP data when two star cameras were available) or later from SwarmB (which is slightly further from the disturbing ionosphere than SwarmA or SwarmC); otherwise, scalar data was used. In particular, during the gap from the end of the CHAMP mission in September 2010 and the start of the Swarm mission in November 2013, only Oersted scalar data were available.
All satellite vector data were rotated from the instrument frame to the NorthEastCenter frame using Euler angles determined during the derivation of the CHAOS4plus_V4 model (see also Finlay et al. 2015). The CHAOS4 estimate of the crustal field (for degrees 15 to 85) was removed from all data, but no correction was applied for the external field since, in COVOBS type models, a simple external field model is coestimated. In addition, following Finlay et al. (2015), all Swarm vector (VFM) data are scaled so that the magnetic field norm obtained from the vector data matches the intensity recorded by the absolute (ASM) scalar field instrument. Note that it is not the true vector field correction of the ASMVFM difference, which was not available at the time of model construction. Data uncertainty estimates σ were allocated as described in Gillet et al. (2013): for the scalar and isotropic component of vector data, σ varies with geomagnetic latitude, taking its maximum value within 25° of the geomagnetic pole and its minimum value within 45° of the geomagnetic equator, with a cosine taper for the intervening 20°. The range for each dataset is given in Table 1. Swarm data uncertainties are allocated in the same manner as for the CHAMP data.
An update of the OAM dataset previously used to derive the COVOBS model was also carried out. This was based on the worldwide OAM database from the World Data Centre for Geomagnetism, BGS Edinburgh (pers. comm. S. Macmillan, September 2014). It involved 13 new observatories compared to the previous dataset used by Gillet et al. (2013) and comprises annual means up to 2013.5 where available. First differences of OAM thus provide constraints on the secular variation up until 2013.0 that are not sensitive to the crustal field. Uncertainty estimates were recalculated for each updated observatory time series using a generalized cross validation approach as in Bloxham and Jackson (1992), Gillet et al. (2013), and Jackson et al. (2000). No corrections for external field variations, beyond the averaging inherent in the annual means, were applied.
Parameterization and prior information for the COVOBS.x1 model
We refer to Gillet et al. (2013) for the details concerning the construction of the COVOBS field model. Here, we recall only the main points. We use a spherical harmonic expansion of the internal field up to degree N=14. A single coefficient, the axial dipole in geomagnetic dipole coordinates, is used for the spherical harmonic expansion of the external field (with a 20nT background value). All coefficients are projected onto order 4 cubic Bsplines, with knots every 2 years, spanning the period 1838 to 2022.
The main difference with the more commonly employed regularization procedures (penalizing second or third time derivatives plus a spatial norm involving damping parameters, see Finlay et al. 2012) is that we try to define an a priori covariance matrix on the model coefficients that is as realistic as possible, in order to be able to use the information contained in the a posteriori model errors’ covariance matrix. For each Gauss coefficient \({g_{n}^{m}}\) of degree n and order m (and similarly for \({h_{n}^{m}}\)), we choose a time covariance function:
τ is the time lag between two epochs, \(E(\dots)\) means the statistical expectation. For each coefficient, the a priori distribution is centered on zero. We consider that coefficients of different orders or degrees are a priori independent (\({h_{n}^{m}}\) and \({g_{n}^{m}}\) are also independent). For the sake of simplicity, the \({\mathcal {C}}_{n}^{m}\) do not vary with the spherical harmonic order m. The main field variances σ _{ g }(n)^{2} are estimated from the variances of satellite MF model coefficients in 2005, averaged over all orders. Given Equation (1), the relevant timescales are by definition \(\tau _{c}(n)=\sqrt {3}\sigma _{g}(n) / \sigma _{\dot {g}}(n)\), with \(\sigma _{\dot {g}}(n)\) the secular variation variances, estimated from the variances of satellite SV model coefficients in 2005, averaged over all orders (see Gillet et al. 2013).
Equation (1) corresponds to stationary, autoregressive processes φ of order 2 governed by a stochastic differential equation of the form (e.g. Yaglom 1962)
with ε a white noise process^{a}. This description is chosen since it is consistent with the slope close to −4 found for the power spectrum density (PSD) of observatory series at periods from 5 to 70 years (De Santis et al. 2003). The continuation of such a slope for the PSD of the internal field at periods shorter than a few years is unsure given the domination of the external signal towards high frequencies (see Figure two in Ou et al. 2015), but there is no need either for a steeper slope given the current estimate of the mantle conductivity (Velímský and Finlay 2011).
Since D,I, and F data are involved, model estimation is a nonlinear optimization problem. We solve it with a Newton algorithm, using a L2 measure of the data misfit together with a rejection criterion. We first build, starting from COVOBS, an intermediate model rejecting data for which the residual magnitude is above 10 σ _{ e } (σ _{ e } is the a priori data error). Next, from this model we obtain within six iterations (typically a few iterations are enough for convergence) the COVOBS.x1 field model together with its a posteriori model errors’ covariance matrix using a 3σ _{ e } rejection criterion.
Stochastic forecast of the geomagnetic field
We present below how we derive our test SV model for IGRF12. It results from the integration of a stochastic core flow model into an augmented state ensemble Kalman filter (Evensen 2003).
Stochastic core flow modeling
In the frozenflux approximation, core surface motions u are related to changes in the radial geomagnetic main field B _{ r } through the diffusiveless induction equation at the coremantle boundary (e.g., Holme 2007):
We consider the simplest stationary, stochastic model compatible with the −4 slope obtained for the temporal PSD of geomagnetic field series at groundbased observatories for periods 5≤T≤70 years (De Santis et al. 2003). It consists of an order 1 stochastic differential equation, of the form^{b}
with z a white noise process (see Gillet et al. 2015). Equation (4) defines the time correlation function for u:
For the sake of simplicity, a single value of τ _{ u }=100 years is assumed for all the flow coefficients (see Gillet et al. 2015).
We consider here flow models calculated under the compressible quasigeostrophic (QG) constraint, i.e., (Pais and Jault 2008):
The flow model, decomposed into toroidal (\({t_{n}^{m}}\)) and poloidal (\({s_{n}^{m}}\)) components, is described up to spherical harmonic degree N _{ u }=20. Relatively large flow variances are assumed:
which is equivalent to assuming a flat CMB flow power spectrum with a tapper \({\mathcal {T}}(n)=\min \left \{1,10^{14n}\right \}\) imposed to ensure the convergence of the scheme. Under the constraint (6), variances for the poloidal coefficients derive from those of the toroidal ones through the geostrophic chains (Le Mouël et al. 1985). Variances for z are directly deduced from those for u (e.g., Papoulis and Pillai 2002):
From (8), we construct the covariance matrix C _{ z } for z. The linear set of constraints (6) is transformed into matrix form, L z=0 (if z satisfies the constraints, then it is also the case for u). We generate the random vectors z by multiplying the Choleski decomposition of \(\mu {\sf L}^{T}{\sf L}+{\sf C}_{\sf z}\) (with μ a very large scalar, we use μ=10^{9}) to a random unit vector normally distributed. Then, flow models u derived from z satisfy the constraints (6) and present the variances of Equation (7).
Augmented state ensemble Kalman filter
The main source of errors, when imaging the flow from models of the secular variation ∂ _{ t } B _{ r } using Equation (3), comes from nonlinear interactions involving the unresolved parts of the flow and of the magnetic field (Baerenzung et al. 2014; Eymin and Hulot 2005; Pais and Jault 2008). The projection of Equation (3) onto large lengthscales (denoted by overlines) gives
with \({\mathcal {E}}=\overline {\nabla _{H} \cdot \left (\mathbf {u} \tilde {B}_{r} \right)}\) referred to as the SV model errors. The unresolved field \(\tilde {B}_{r}\) at small lengthscales being correlated over decades, is also correlated in time (Gillet et al. 2015). We model it through the stochastic equation
with a white noise process. This defines the correlation function for , \(\rho _{\mathcal {E}}(\tau)=\exp \left (\tau /\tau _{\mathcal {E}}\right)\). This choice, with \(\tau _{\mathcal {E}}=10\) years, builds on the investigations of Gillet et al. (2015) who constructed flow models from COVOBS over 1940 to 2010 (see their Figure one). Variances for the SV model error coefficients, which depend only on the degree n, are also estimated from their results.
Equations (4), (9), and (10) are timestepped to forecast the (augmented) model state:
We use an EulerMaruyama scheme (e.g., Kloeden and Platen 1992) to timestep the stochastic equations. We consider here as observations snapshots of the MF and SV coefficients of the COVOBS.x1 field model, obtained from the continuous parameterization (through Bsplines) of the field model. Observations fall on a subset of the discrete timesteps involved when integrating the forward problem, so there is no need for interpolating in time the stochastic model.
For the sake of simplicity, the MF and SV data error covariance matrices R _{ MF }(t) and R _{ SV }(t) are here assumed to be diagonal. Variances are obtained from the dispersion within 50 realizations of the COVOBS.x1 model (an ensemble large enough to give a converged estimate of the diagonal elements), derived from the COVOBS.x1 posterior model error covariance matrix (see Gillet et al. 2013). By ignoring crosscovariances, we avoid the issues related to rankdeficient matrices. Predictions for geomagnetic field observations y ^{o} are related to the model state x through the forward equation:
(e ^{o} the observation errors, H the forward operator, see below). The state x(t) is obtained using an ensemble Kalman filter (Evensen 2003), composed of a succession of forecast and analysis steps:
with ∇H the linear tangent of the forward operator and R the observation error covariance matrix. The model covariance matrix P ^{f} is obtained from an ensemble of K=50 realizations of the model as:
with \(\left <\textbf {x}^{f}\right >\) the ensemble average of the models. Given the small ensemble size compared to the model dimension, crosscovariances in P ^{f} are ignored to ensure a positivedefinite matrix (one may consider reduced rank filters or localization techniques to address this issue, while conserving the information carried by offdiagonal elements). All quantities are represented in the spherical harmonic domain.
We proceed to the analysis step every 5 years. Because the forecast field \(\overline {B}_{r}^{f}\) can deviate significantly from the exact largelengthscale field \(\overline {B}_{r}\) after 5 years, each analysis is proceeded in two steps (following Aubert 2014):

we first perform an analysis of \(\textbf {x}_{1}=\overline {B}_{r}\) from K noisy realizations of the COVOBS.x1 field model, which involves \(\textbf {y}^{o}_{1}=\overline {B}_{r}^{o}\), R=R _{ MF }, and \({\sf H}_{1}(\textbf {x})=\overline {B}_{r}\) (i.e., ∇H _{1}=I _{ P } the identity matrix of size P=N(N+2));

next, we compute an analysis of \(\textbf {x}_{2}=\left [\textbf {u},\mathcal {E}\right ]\), with \(\textbf {y}^{o}_{2}=\partial _{t}\overline {B}_{r}^{o}\), R=R _{ SV } and:
$$\begin{array}{@{}rcl@{}} \nabla{\sf H}_{2} = \left[ \begin{array}{cc} {\sf A}(\overline{B}_{r}^{a}) & {\sf 0} \\ {\sf 0} & {\sf I}_{P} \end{array} \right]\,, \end{array} $$where \({\sf A}(\overline {B}_{r}^{a})\textbf {u}=\overline {\nabla _{H}\cdot \left (\textbf {u}\overline {B}_{r}^{a}\right)}\).
We perform an analysis of the observations every 5 years, starting from 1985 (except the last analysis, performed in 2014.5 instead of 2015). Several (at least two) analysis steps are required in order to eliminate the initial condition memory on the covariances that enter the EnKF.
Results and discussion
The COVOBS.x1 field model
Statistics on the COVOBS.x1 prediction errors
We now provide some statistics concerning the COVOBS.x1 misfit to observatory and satellite observations, focusing on the period spanning 1990 to 2015. We present in Figure 1 the time evolution of the OAM normalized (i.e., weighted by the a priori data errors) data misfit and bias, together with the number of available (X,Y,Z) observations (standing for the northward, eastward, and downward components). We observe no particular change in the statistics with the advent of continuous satellite records in 1999, indicating a global compatibility between groundbased and satellite data.
The unweighted and weighted misfit and bias for various satellites are summarized in Table 1 for intensity data and in Table 2 for vector data. (B _{ b },B _{⊥},B _{3}) stand for the magnetic field components rotated in the frame appropriate for describing anisotropic attitude errors (see Holme and Bloxham 1996; Olsen 2002),. For each of the satellites, the weighted bias is reasonably close to zero when a large enough number of data is available. Normalized misfits are close to unity for all subsets of data, except for Swarm F data for which a priori error estimates seem to be overestimated. We do not use any iterative scheme to reweight the observation errors (e.g., Olsen 2002). Unweighted residuals to CHAMP F data are relatively large because with our selection process (see the ‘Data selection’ section), all these data are located at high geomagnetic latitudes (see also Figure 2). Large misfit values obtained for Oersted B _{⊥} data are to be associated with the availability of a single star camera to determine Euler angles (see Olsen et al. 2014). We show in Figure 3 the time evolution of the satellite data weighted misfit and bias for all three components of the field in the frame aligned with the magnetic field vector. We see slightly larger residuals during the most active solar periods (2002 to 2005) and note some relatively large biases, for instance, on F data in 2002 and 2004.
The dependence of the unweighted residuals on the geomagnetic latitude is shown in Figure 2 for various satellites. As expected, larger prediction errors on F data are observed above 60° latitude. The envelope of the residuals shows a minimum around 35° latitude and a local maximum at the equator for both F and B _{ b } data for all three satellites. This indicates some unmodelled contributions from the ring current (see the discussion of Figure two in Olsen 2002). It may at least partly be due to the inability of our model to fit highfrequency external sources due to the choice of a 2year knot spacing also for the external field. As in Olsen (2002), B _{ p } Oersted data and B _{3} Oersted and CHAMP data are associated with lower residuals towards the geomagnetic equator. This trend is less obvious with Swarm data, which present on average lower residuals for both scalar and vector data.
Description of COVOBS.x1 and its uncertainties
We now provide details concerning the characteristics of the COVOBS.x1 field model. We present in Figure 4 MF and SV spectra at the Earth’s surface for epochs 2010, 2015, and 2020, for both the average model and the estimated model errors (derived from the posterior covariance matrix). Uncertainties are relatively larger at higher degrees. Starting from epoch 2010 to 2015 then 2020, uncertainties gradually increase, illustrating the weakening of the constraint from the data (and thus the increasing importance of the a priori covariances) towards the future. We also notice a significant decrease of the SV power in 2020 compared to 2010 (see below).
We show in Figure 5 examples of the MF and SV COVOBS.x1 model coefficients, in comparison with those from the CHAOS4plus_v4 model (Olsen et al. 2014). A reasonable agreement is found between the two models, COVOBS.x1 presenting sharper SV variations at high degrees, due to the strong damping used when building the CHAOS model. Indeed, regularized field models tend to provide a smoothed estimate (i.e., weighted time average) of the SV coefficient series towards high degrees. An almost constant bias of 4 nT between the two models is found for coefficient \({g_{1}^{0}}\), COVOBS.x1 showing more negative values. This may be associated with several factors, among which (see Gillet et al. 2013) a possible aliasing in time due to the projection of \({q_{1}^{0}}\) onto splines with a 2year knot spacing, the use of a 20nT background value for the parameterization of \({q_{1}^{0}}\), or the simple description of the induced response to external fields (COVOBS.x1 being designed to model field changes on interannual periods and longer, we simply assume an infinitely conducting outer core, with no consideration of induced currents in the mantle). Some rapid SV fluctuations observed on several lowdegree CHAOS4plus_v4 coefficients are also absent in COVOBS.x1 (see, for instance, \(\dot {g}_{2}^{1}\)). These are possibly due to the filtering of rapid SV changes by the projection onto splines with 2year knot spacing and/or to some leakage of highfrequency external sources into the CHAOS internal model.
We obtain relatively larger error bars at higher degrees. In comparison with the period prior to 1999, where the SV is mainly constrained by OAM, we find smaller uncertainties during the satellite era. These increase after 2014.6, when the control imposed by a priori covariances gradually takes over from that of the observations. The ensemble average SV prediction after 2014.6 becomes almost flat. This behavior is in agreement with our assumed prior information. Indeed, the correlation function in Equation (1) is that of an autoregressive process of order 2 for the MF, i.e., approximately a random walk for the SV on short periods, characterized by an envelope of possible solutions \(\propto \sqrt {t}\).
We present in Figure 6 the prediction of an ensemble of 20 realizations of the COVOBS.x1 (internal plus external) field model at several groundbased observatories. These reflect the behavior described above on the field coefficients. Note that because both internal and external coefficients are projected onto splines, fluctuations at periods much shorter than the (2year) knot spacing are not modeled, also after 2014.6. This is particularly obvious on the X series, because (i) Y data are less affected by auroral electrojets and the equatorial ring current and (ii) the magnitude of decadal (mainly from internal origin) SV changes is larger on Z than on X for the two sites presented here.
Results of the MF and SV stochastic forecast
We now present predictions of the geomagnetic field obtained with the stochastic core flow modeling and the augmented state EnKF method. We show in Figure 7 SV and MF spectra for the forecast and analysis errors in 2014.5. These provide a measure of the forecast uncertainties for the upcoming 5year intervals. The analysis errors being below the observation error, our algorithm produces solutions able to fit the MF and SV data within the error bars provided by COVOBS.x1.
We present in Figure 8 some examples of MF and SV coefficient predictions for several cycles of analysis and forecast steps, spanning 1990 to 2020. Please note that the stochastic forecast is discrete (contrary to the continuous spline model COVOBS.x1), with a timestep of 0.5 years and that it has not been filtered in time. The dispersion within the ensemble of stochastic SV forecasts is comparable to that obtained directly from the COVOBS.x1 posterior covariance matrix (the latter being sometimes a bit less, as for instance with \(\dot {g}_{1}^{0}\)).
For most coefficients, observations are accounted for by one standard deviation σ ^{f} estimated from our ensemble of forecasts. This indicates that the statistics of our stochastic model are fairly realistic, although this diagnostic is imperfect: COVOBS.x1 coefficients at two different epochs are not independent. Thus, the forecast at a given epoch is not independent from the observation at this epoch. To obtain an independent diagnostic, forecasts produced from COVOBStype field models constructed from datasets without data from the forecast era would be required. For some coefficients, there exists a systematic bias (see, for instance, the positive trend taken by the average \(\dot {h}_{2}^{1}\) forecast) : even though the observed series usually lies within the ensemble of forecast realizations, it sometimes lies in an area of lower probability, as measured by the pdf of the forecast. Initial investigations of this problem suggest it is not related to our choice of topological constraint (6) but probably to our use of stochastic models for u and that are centered around zero (we use no background model).
We also make a comparison of the EnKF forecast with the IGRF11 predictions for 2010 to 2015 (Finlay et al. 2010). We find that the IGRF11 SV predictions are accounted for by one standard deviation σ ^{f} estimated from our ensemble of forecasts. The results presented in this section should be considered as a proof of concept study; possible future applications or modifications are presented in the ‘Conclusions’ section.
Our IGRF12 candidate models
Candidate models for IGRF12 have been derived from an ensemble of K=50 realizations of the COVOBS.x1 MF and SV field coefficients, \(\displaystyle \left \{\textbf {g}_{k}(t),\dot {\mathbf { g}}_{k}(t)\right \}_{k\in [1,K]}\). Our DGRF MF candidate is the COVOBS.x1 ensemble average MF model evaluated in 2010:
The associated error bars are estimated as the dispersion relative to the ensemble average within the K realizations of the MF model:
Similarly, we estimate the IGRF MF candidate, and its associated error bars, from the ensemble average of the COVOBS.x1 realizations, and the dispersion within the ensemble, evaluated in 2015. Our IGRF SV candidate is the COVOBS.x1 ensemble average SV model, averaged in time over 2015 to 2020:
The associated error bars are estimated as the dispersion relative to the ensemble average within the K realizations of the SV model:
Additionally, we presented a test IGRF SV candidate as the ensemble average of SV forecast resulting from the stochastic EnKF, averaged in time over 2015 to 2020 (its associated error bars are estimated from the dispersion relative to the ensemble average within the ensemble of SV forecast realizations).
Conclusions
Beyond the ‘state zero’ forecast of the geomagnetic field
Forecasting the geomagnetic field requires, upon accurate observations at or above the Earth’s surface, understanding the physics occurring within the Earth’s outer core over millennial to interannual timescales. The knowledge of the field behavior on long timescales can be inferred from field models derived from archeomagnetic and lake sediment data bases (e.g., Korte et al. 2011; Licht et al. 2013; Nilsson et al. 2014; PavónCarrasco et al. 2014). Since the turnover time is of the order of a few hundreds of years, the reanalysis of such models may help define a background flow above which a flow perturbation could be described (equivalent of a climatic mean in oceanic studies). This may reduce systematic biases observed in the SV predictions. One may think, for instance, of the coupledEarth dynamo scenario by Aubert et al. (2013), where a slowly evolving westward drift naturally arises from the coupling between the inner core and the mantle.
In this study, the evolution of the geomagnetic field is constrained by statistical properties inferred from the temporal PSD recovered for magnetic series. There exists dynamical interpretations associated with the observed slopes of the spectra (Tanriverdi and Tilgner 2011) (see also Buffett and Matsui 2015; Buffett et al. 2014; Olson et al. 2012, for studies focused on the analysis of the dipole moment in geodynamo simulations). Nevertheless, the method derived in the ‘Stochastic forecast of the geomagnetic field’ section does not contain any deterministic equation for advecting the magnetic field and the flow inside the outer core. As a consequence, it provides an envelope of possible states, and its average prediction can only be marginally better than those obtained from a stationary flow hypothesis (Beggan and Whaler 2009; Waddington et al. 1995). To go further, still accounting for unresolved processes, one may introduce random forcings such as those of Equations (4) and (10) into prognostic models of the core dynamics used for the reanalysis of the core state – for instance, into geodynamo (Fournier et al. 2011) or quasigeostrophic (Canet et al. 2009) equations. With this in mind, the development of smoother algorithms may also be envisioned (see Evensen and Van Leeuwen 2000).
The model presented in this study aims to produce, as far as possible, an unbiased estimate of the core state, considering SV model error covariances via a stochastic equation. To go further, we could reduce the importance of SV model errors by coestimating the unresolved field at degrees n>14 (and its associated uncertainties) together with the field at large lengthscales, following Aubert (2014) who performed such a coestimation using the crosscovariances between Gauss coefficients obtained from the forward integration of a geodynamo simulation. Implementing more sophisticated stochastic models for can also be envisioned, given that the Laplace correlation function associated with the AR1 Equation (10) is only an approximation of that found by Gillet et al. (2015). Finally, we used here the compressible QG constraint on core surface flows. Any possible topological constraint may be considered, and the algorithm presented above could be used to test the ability of each hypothesis to predict the observed SV within reanalysis studies. With the prototype algorithm illustrated above, one could, for instance, explore the hypothesis of a stratified layer at the top of the outer core, through its implications on the structure in space and time of core surface flow (Buffett 2014).
Endnotes
^{a} Note that Equation (2) differs from Equation (twelve) in Gillet et al. (2013). Both define processes with the same autocovariance function (1), but their Equation (twelve), contrary to our Equation (2), corresponds to a nonstationary process. This does not affects their results that have been computed from the covariance function and not the stochastic equation.
^{b} By replacing in Equation (4) the scalar quantity 1/τ _{ u } by a matrix homogeneous to a frequency, one could derive more complex stochastic models still compatible with the −4 slope for the PSD of observatory series.
References
Aubert, J (2014) Earth’s core internal dynamics 1840–2010 imaged by inverse geodynamo modelling. Geophys J Int 197(3): 1321–1334.
Aubert, J, Finlay CC, Fournier A (2013) Bottomup control of geomagnetic secular variation by the Earth’s inner core. Nature 502: 219–223.
Baerenzung, J, Holschneider M, Lesur V (2014) Bayesian inversion for the filtered flow at the Earth’s core mantle boundary. J Geophys Res Solid Earth 119: 2695–2720. DOI 10.1002/2013JB010358.
Beggan, C, Whaler K (2009) Forecasting change of the magnetic field using core surface flows and ensemble Kalman filtering. Geophys Res Lett36: L18303. DOI 10.1029/2009GL039927.
Bloxham, J, Jackson A (1992) Timedependent mapping of the magnetic field at the coremantle boundary. J Geophys Res 97: 19,537–19,563.
Buffett, B (2014) Geomagnetic fluctuations reveal stable stratification at the top of the Earth’s core. Nature 507: 484–487.
Buffett, B, Matsui H (2015) A power spectrum for the geomagnetic dipole moment. Earth Planetary Sci Lett 411: 20–26.
Buffett, BA, King EM, Matsui H (2014) A physical interpretation of stochastic models for fluctuations in the earth’s dipole field. Geophys J Int 198(1): 597–608.
Canet, E, Fournier A, Jault D (2009) Forward and adjoint quasigeostrophic models of the geomagnetic secular variation. J Geophys Res 114: B11,101. doi:10.1029/2008JB006,189.
De Santis, A, Barraclough D, Tozzi R (2003) Spatial and temporal spectra of the geomagnetic field and their scaling properties. Phys Earth Planet Int 135(2): 125–134.
Evensen, G (2003) The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn 53(4): 343–367.
Evensen, G, Van Leeuwen PJ (2000) An ensemble Kalman smoother for nonlinear dynamics. Mon Weather Rev 128(6): 1852–1867.
Eymin, C, Hulot G (2005) On core surface flows inferred from satellite magnetic data. Phys Earth Planet Inter 152: 200–220.
Finlay, CC, Maus S, Beggan CD, Bondar TN, Chambodut A, Chernova TA, Chulliat A, Golovkov VP, Hamilton B, Hamoudi M, Holme R, Hulot G, Kuang W, Langlais B, Lesur V, Lowes FJ, Lühr H, Macmillan S, Mandea M, McLean S, Manoj C, Menvielle M, Michaelis I, Olsen N, Rauberg J, Rother M, Sabaka TJ, Tangborn A, TøffnerClausen L, Thébault E, et al. (2010) International geomagnetic reference field: the eleventh generation. Geophys J Int 183(3): 1216–1230.
Finlay, CC, Jackson A, Gillet N, Olsen N (2012) Core surface magnetic field evolution 2000–2010. Geophys J Int 189: 761–781. DOI 10.1111/j.1365246X.2012.05395.x.
Finlay, CC, Olsen N, TøffnerClausen L (2015) DTU candidate field models for IGRF12 and the CHAOS5 geomagnetic field model. Earth, Planets and Space, in press.
Fournier, A, Hulot G, Jault D, Kuang W, Tangborn A, Gillet N, Canet E, Aubert J, Lhuillier F (2010) An introduction to data assimilation and predictability in geomagnetism. Space Sci Rev 155: 247–291. http://dx.doi.org/10.1007/s1121401096694.
Fournier, A, Aubert J, Thébault E (2011) Inference on core surface flow from observations and 3D dynamo modelling. Geophys J Int 186: 118–136.
FriisChristensen, E, Lühr H, Hulot G (2006) Swarm a constellation to study the Earth’s magnetic field. Earth Planet Space 58: 351–358.
Gillet, N, Jault D, Finlay CC, Olsen N (2013) Stochastic modeling of the earth’s magnetic field: inversion for covariances over the observatory era. Geochem Geophys Geosyst 14(4): 766–786.
Gillet, N, Jault D, Finlay CC (2015) Planetary gyre, timedependent eddies, torsional waves and equatorial jets at the Earth’s core surface. J. Geophys Res, in press.
Holme R (2007) Large scale flow in the core. In: Olson P Schubert G (eds)Treatise in geophysics, core dynamics, 107–129.. Elsevier, chap 4.
Holme, R, Bloxham J (1996) The treatment of attitude errors in satellite geomagnetic data. Phys Earth Planet Inter 98: 221–223.
Jackson, A, Jonkers ART, Walker MR (2000) Four centuries of geomagnetic secular variation from historical records. Phil Trans R Soc Lond A 358: 957–990.
Kloeden, PE, Platen E (1992) Numerical solution of stochastic differential equations, Vol. 23. SpringerVerlag, Berlin Heidelberg.
Korte, M, Constable C, Donadini F, Holme R (2011) Reconstructing the holocene geomagnetic field. Earth Planet Sci Lett 312: 497–505.
Le Mouël, JL, Gire C, Madden T (1985) Motions of the core surface in the geostrophic approximation. Phys Earth Planet Inter 39: 270–287.
Lesur, V, Wardinski I, Hamoudi M, Rother M (2010) The second generation of the GFZ reference internal magnetic model: GRIMM2. Earth Planets Space 62: 765–773.
Licht, A, Hulot G, Gallet Y, Thébault E (2013) Ensembles of low degree archeomagnetic field models for the past three millennia. Phys Earth Planetary Inter 224: 38–67.
Nilsson, A, Holme R, Korte M, Suttie N, Hill M (2014) Reconstructing holocene geomagnetic field variation: new methods, models and implications. Geophys J Int 198(1): 229–248.
Olsen, N (2002) A model of the geomagnetic field and its secular variation for epoch 2000 estimated from ørsted data. Geophys J Int 149(2): 454–462.
Olsen, N, FriisChristensen E, Floberghagen R, Alken P, Beggan CD, Chulliat A, Doornbos E, da Encarnaçao JT, Hamilton B, Hulot G, et al (2013) The swarm satellite constellation application and research facility (scarf) and Swarm data products. Earth Planets Space 65(11): 1189–1200.
Olsen, N, Luhr H, Finlay CC, Sabaka TJ, Michaelis I, Rauberg J, TøffnerClausen L (2014) The CHAOS4 geomagnetic field model. Geophys J Int 197: 815–827.
Olson, PL, Christensen UR, Driscoll PE (2012) From superchrons to secular variation: a broadband dynamo frequency spectrum for the geomagnetic dipole. Earth Planet Sci Lett319–320: 75–82. http://www.sciencedirect.com/science/article/pii/S0012821X11007229.
Ou, J, Gillet N, Du A (2015) Geomagnetic observatory monthly series, 1930 to 2010: empirical analysis and unmodeled signal estimation. Earth Planets Space 67(1): 13. DOI 10.1186/s406230140173z.
Pais, MA, Jault D (2008) Quasigeostrophic flows responsible for the secular variation of the Earth’s magnetic field. Geophys J Int 173: 421–443.
Papoulis, A, Pillai SU (2002) Probability, random variable and stochastic process. 4th ed., McGrawHill, New York.
PavónCarrasco, FJ, Osete ML, Torta JM, De Santis A (2014) A geomagnetic field model for the holocene based on archaeomagnetic and lava flow data. Earth Planetary Sci Lett 388: 98–109.
Sabaka, TJ, Olsen N, Tyler RH, Kuvshinov A (2015) Cm5, a preswarm comprehensive geomagnetic field model derived from over 12 yr of champ, ørsted, sacc and observatory data. Geophys J Int 200(3): 1596–1626.
Tanriverdi, V, Tilgner A (2011) Global fluctuations in magnetohydrodynamic dynamos. New J Phys 13(3): 033,019.
Thébault, E, Finlay CC, Beggan C, Alken P, Aubert J, Barrois O, Bertrand F, Bondar T, Boness A, Brocco L, Canet E, Chambodut A, Chulliat A, Coïsson P, Civet F, Du A, Fournier A, Fratter I, Gillet N, Hamilton B, Hamoudi M, Hulot G, Jager J, Korte M, Kuang W, Lalanne X, Langlais B, Léger JM, Lesur V, Lowes FJ, et al. (2015) International geomagnetic reference field: the twelfth generation. Earth, Planets and Space, accepted.
Velímský, J, Finlay CC, Effect of a metallic core on transient geomagnetic induction (2011). Geochem Geophys Geosyst 12(5): Q05,011. DOI 10.1029/2011GC003557.
Waddington, R, Gubbins D, Barber N (1995) Geomagnetic field analysis –V. Determining steady core surface flows directly from geomagnetic observations. Geophys J Int 122: 326–350.
Yaglom, AM (1962) An introduction to the theory of stationary random functions, PrenticeHall, Englewood Cliffs NJ.
Acknowledgements
We thank the national institutes that support ground magnetic observatories and INTERMAGNET for promoting high standards of practice and making the data available. The support of the CHAMP mission by the German Aerospace Center (DLR) and the Federal Ministry of Education and Research is gratefully acknowledged. The Oersted Project was made possible by extensive support from the Danish Government, NASA, ESA, CNES, DARA, and the Thomas B. Thriges Foundation. We thank T. Sabaka and A. De Santis for their review of our manuscript. This work was supported in part by the French Centre National d’Etudes Spatiales (CNES) for the preparation of the Swarm mission of ESA. This work has been partially supported by the French ‘Agence Nationale de la Recherche’ under the grant ANR11BS56011. We thank the International Space Science Institute for providing support for the workshops of international team no. 241.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
NG adapted and ran the code to produce the COVOBS.x1 field model. CF performed the selection of the satellite and ground observatory geomagnetic data. NG and CF performed the analysis of the model statistics. NG and OB derived the augmentedstate Kalman filter algorithm used to produce the SV candidate model. This tool has been implemented, validated, and run by OB. NG lead the writing of the manuscript. All authors discussed the results and commented on the manuscript. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Gillet, N., Barrois, O. & Finlay, C.C. Stochastic forecasting of the geomagnetic field from the COVOBS.x1 geomagnetic field model, and candidate models for IGRF12. Earth Planet Sp 67, 71 (2015). https://doi.org/10.1186/s406230150225z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s406230150225z
Keywords
 Geomagnetic field
 Secular variation
 Stochastic equations
 Ensemble Kalman filter