An algorithm for deriving core magnetic field models from the Swarm data set
© The Society of Geomagnetism and Earth, Planetary and Space Sciences (SGEPSS); The Seismological Society of Japan; The Volcanological Society of Japan; The Geodetic Society of Japan; The Japanese Society for Planetary Sciences; TERRAPUB 2013
Received: 1 March 2013
Accepted: 17 July 2013
Published: 22 November 2013
In view of an optimal exploitation of the Swarm data set, we have prepared and tested software dedicated to the determination of accurate core magnetic field models and of the Euler angles between the magnetic sensors and the satellite reference frame. The dedicated core field model estimation is derived directly from the GFZ Reference Internal Magnetic Model (GRIMM) inversion and modeling family. The data selection techniques and the model parameterizations are similar to what were used for the derivation of the second (Lesur et al., 2010) and third versions of GRIMM, although the usage of observatory data is not planned in the framework of the application to Swarm. The regularization technique applied during the inversion process smoothes the magnetic field model in time. The algorithm to estimate the Euler angles is also derived from the CHAMP studies. The inversion scheme includes Euler angle determination with a quaternion representation for describing the rotations. It has been built to handle possible weak time variations of these angles. The modeling approach and software have been initially validated on a simple, noise-free, synthetic data set and on CHAMP vector magnetic field measurements. We present results of test runs applied to the synthetic Swarm test data set.
The pioneering satellite Magsat (Langel et al., 1982), the Danish satellite Oersted and the low earth orbiting satellite CHAMP have opened opportunities for the investigation of the various contributions to the Earth’s magnetic field (e.g. the main field, the lithospheric field, the external fields), but also of their interactions and impacts on our society. In the light of recent perception from palaeomagnetic records, indicating surprisingly fast magnetic field reversals (Nowaczyk et al., 2012), and in view of the fast evolution of the field revealed by CHAMP satellite data (Lesur et al., 2008), it is important to pursue data collection, which is foundation for global studies of core dynamics and core-mantle interaction. The Swarm mission with three satellites, two flying side by side and one in a higher orbit, and its well-suited instrumentation, is able to contribute to this objective. A backbone for magnetic field investigations is to have a valid, consolidated, ideally up-to-date magnetic field model describing the main field contribution originating in the Earth’s fluid core. The focus implies a reliable description of its time derivatives: the elusive small scale Secular Variation (SV) and Acceleration. Depending on the interest of the modelers and the time period in focus, several approaches with different model designs are available, e.g. CM4 (Sabaka et al., 2004), POMME (Maus et al., 2006), CHAOS (Olsen et al., 2010) and GRIMM (Lesur et al., 2008, 2010) series.
To help with the successful exploitation of the expected Swarm data, ESA has supported a processing environment to create so-called Level 2 products (Olsen et al., 2013). The aim is to provide the scientific community with state-of-the-art models of the known different contributions to the magnetic field. The products are grouped into two categories: The CAT-2 products, with mature and strongly automatized algorithms creating Level 2 products with small delays, and, the CAT-1 software based on mature and accepted algorithms that require scientific supervision. Described in the following is the outline of the so called Dedicated Core field Model (DCO) branch of the Swarm CAT-1 processing environment.
The DCO software is split into a slow and a fast lane. Each lane is split in the determination of the dedicated core field model and an estimation of the misalignment angles between magnetic field sensors and the satellite reference frame. The slow lane is designed to cover all available data and therefore is suited for time-spans of at least one year. The fast lane focuses on short periods but requires nonetheless to cover all local times, i.e. generally about at least three or four months. While the slow lane aims at a precise description of the secular variation, and is therefore characterized by a complex description of the time dependencies, the main goal of the fast lane is to have an early view on the accuracy of the predictive core field model used by other Swarm CAT-1 chains. Also the fast lane is used to assess the validity of the misalignment angles between magnetic field sensors and the satellite reference frame used for the processing of the Swarm Level-1b magnetic data (Tøffner-Clausen and Hansen, 2007). The outputs of the fast lane are for internal validation only and not released to the public. They are not described any further in this manuscript.
The structure of the paper is as follows: the DCO core field modeling and the misalignment angle (i.e. Euler angle) estimations are introduced in separate sections, even though they are an integral part of the software. For each of these we first present an outline of the algorithm, and then the specific adaptation for the Swarm set-up. Finally the DCO processing approach is tested and applied to a synthetic data set established in the framework of this study. Results of application to real data are also shown for the Euler Angle determination.
2. Core Field Modeling: Heritage and Adaptations
The GRIMM approach was established and developed with the rapidly growing CHAMP data set and the characteristics of the model have been generally preserved in this implementation. Nonetheless, a few changes have been introduced in the focus of the approach and in its application. It is not foreseen to use observatory data. However, it is mainly in the handling of the external and induced fields that the approach has evolved. A careful selection of their parametrization is necessary, firstly since the modeling needs to be based on the available indices, secondly since other indices than in the usual GRIMM approach are used, and thirdly because of the specific characteristics of the data set actually at hand. As modelling the core field from satellite data is a difficult process, a Scientist in Loop (SIL) is required to adjust the software configuration and make final decisions for delivery.
MMA is the a time series of spherical harmonic model coefficients of the large-scale magnetospheric field and its Earth-induced counterparts (Hamilton, 2013);
AUX DST is the name of a Swarm L2 Product with DST indices including quick-look and preliminary estimates from World Data Center for Geomagnetism in Kyoto, in listing format (Olsen et al., 2013);
AUX IMF is the name of a Swarm L2 Product with the values of the Interplanetary Magnetic Field propagated to the Earth magnetosphere (Olsen et al., 2013).
the z-component of the interplanetary magnetic field (IMF-B z ) must be positive, for minimizing the noise associated with possible re-connection of the magnetic field lines with the Interplanetary Magnetic Field (IMF);
a 20 s minimum is required between sampled points for minimizing correlated errors generated by non-modeled lithospheric field;
data local time must be between 23:00 and 05:00 for minimizing the contribution from the magnetic field generated in the ionosphere. The sun must also be below the horizon at 100 km above the Earth’s reference radius (a = 6371.2 km),
the value of the MMA must be less than 30 nT and its time derivative norm lower than 100 nT/day to select magnetically quiet periods. While the original GRIMM scheme is using the Vector Magnetic Disturbance Index, Thomson and Lesur (2007), with bounds set to 20 nT and 100 nT/day, our selection is using either the fast MMA product or, the AUX DST product. The choice is made depending on the availability of the MMA or whether or not the MMA turns out to be not appropriate for the purpose. The thresholds used will need adapting to the actual data set. It is one of the tasks of the SIL to choose and justify the choice.
the quality flags should indicate data of a minimum quality threshold. This is set mainly to reject outliers. Data with only one star camera reading should normally be rejected unless the weak data density requires their selection. The handling of the flag information has been implemented as for CHAMP data, but cannot actually be fine-tuned for Swarm before true readings from Swarm are available.
Outside the ±55° magnetic latitude interval, at high latitudes, the three component vector magnetic satellite data are used in North, East, Center (NEC) system of coordinates and for all local times. These two selection criteria were chosen to avoid significant gaps in the time series of high-latitude data. Even if these selection criteria are used for the initial core field inversion, they may be tuned by the SIL if this seems recommended by the initial results. In particular, for the application to the synthetic Swarm test data set (TDS-1, see Olsen et al., 2013) the high latitude data were selected with a tight time window.
2.2 Model parametrization and estimation
The handling of the large scale external fields in principle distinguishes between firstly, a magnetospheric field model in the solar magnetic system of coordinates (SM) varying slowly in time and, secondly, a fast varying external field model, combined with its induced counterpart. This latter field is in the usual earth fixed, earth centered system of coordinates (geocentric), and parametrized in time by an index controlling the rapid variations of the field. The external field index is preferentially the MMA Level 2 product (Hamilton, 2013). In case the MMA index is not available or found not to be appropriate, the DST index can be used alternatively.
The maximum SH degree for the external field is set to Le = 2, but only a certain subset of the external coefficients may actually be used depending on the data set and the apparent significance of the coefficients. Particularly for the test using the TDS-1 data set, only the orders 0 and ±1 were chosen for the slowly varying external field model, whereas for the fast varying fields parametrized with the MMA index only the SH degree 1 and the order 0 SH degree 2 coefficients were included. Later application on real measurements may require an adaptation of these settings.
In a first step we aim for a valid, not necessarily perfect, core field model and a corresponding, appropriate external field description. For this first step we assume a Gaussian distribution of the residuals. The mid-latitude dipole-aligned Z-component data are used exclusively for the external field part and do not enter into the estimation of the core field. This is equivalent to the infinite variance approach set in Olsen et al. (2007) and therefore requires several iterations of the optimization process until further updates in the model parameters become insignificant. The model nonetheless requires some constraints to be set on the temporal evolution of the core field model. These constraints are introduced through the matrix D in the functional defined in Eq. (14). We use effectively the same approach as in the second and third version of GRIMM described in Lesur et al. (2010), where the acceleration is minimized at the end points of the model whereas the third time derivative is minimized over the model time span. But it is not excluded that we revise this approach if necessary.
3. Euler Angles
The main instruments for estimating the orientation of the magnetic sensors in space are the star cameras. These are rigidly mounted on the so-called “optic bench” that also carries the magnetometers. So, in principle, the angles (i.e. Euler angles) between the magnetic sensors and the star cameras are known and should not vary in time. However, since the satellites are under stress during the launch and sustain large temperature gradients along their orbit path, it is known that these angles have to be re-estimated during the flight. The algorithm we shortly describe below for this purpose is fundamentally the same as the one proposed in Olsen et al. (2007), but we use quaternions here. Small corrections to the Euler angles established before launch can be estimated, assuming a known magnetic field and using the magnetometer readings to find their orientations. Alternatively, we can co-estimate the magnetic field model and the Euler angles. This latter algorithm is described below after an introduction to quaternions.
In the following, the notation of the quaternion is using the convention proposed in Wertz (1978), p. 762, equation E-7a. Here, q4 is the scalar component of the rotation whereas (q1, q2, q3) defines the rotation axis. We note that a given rotation is described by a unique quaternion as long as the sign of q4 is imposed.
We have organized the software to cover two operation modes that consist of either estimating the core field model and the quaternions independently, or of co-estimating both. The need to cover these two operation modes changed the internal data organization in comparison to the original GRIMM scheme. With the introduction of the quaternions and rotation matrices, the problem becomes clearly nonlinear and more than one iteration is required. The estimation of the core field model independently also requires several iterations. The software is therefore organized with two embedded iterative loops, the outer loop being used to handle the non-linearity of the quaternion determination. The data are therefore read in the sensor system of coordinates and the outer loop includes, as an initial task, a rotation of these data in an Earth-fixed system using the current values of the quaternions. It is always possible to reduce the complexity of the problem by either imposing a core field model, in which case the inner loop is skipped, or by imposing a set of quaternions with the possibility of reading directly the data in an Earth-fixed system of coordinates. In all cases, it is the iterative re-weighted least-squares algorithm used in GRIMM model family that is applied to solve the system of equations.
As there is a possibility that the Euler angles vary with time, for example as a result of a thermal bending of the optical bench, the quaternions have to be parametrized in time. Our approach is to split long time spans into relatively short segments where the quaternions are assumed constant. The objective is to have segments covering no more than 30 days, while a full local time coverage, achieved typically in 4 months for one satellite, is still necessary to derive robust core field models. This 30 day window requirement imposes a different data selection scheme is applied for the quaternion estimation than for the core field estimation. For stability of the quaternion estimation it is essential to select a significant number of vector data for each segment. This is typically achieved by selecting data on a larger local time window than the tight 23:00 to 05:00 window used for core field modeling.
The stability of the quaternion estimation is expected to be a critical issue, so we apply the following scheme. A first estimation is done on a relatively large window (e.g. 100 days) that is progressively reduced to 30 days. This provides good starting values for the non-linear estimation and the new quaternions determined on smaller time window can be required not to differ too much from the starting values. Outliers, destabilizing the quaternion estimation, can be also hand-picked and removed from the data set. A clear advantage of the scheme is that it gives us hints about the overall robustness of the estimates.
The distinct 30 days segments for the Euler angle determination may become very unequally populated. To avoid invalid results, low population thresholds apply, and the resulting gaps in the Euler Angle time series may be filled by interpolation. Ultimately the most robust segment may represent the final quaternion estimate if a fairly smooth temporal variation of the angles is assumed.
The basic functionality of the software has been fully tested on an ideal synthetic vector data set, where the noise and external fields were ignored and an ideal distribution of data on the sphere was assumed. The performances of the algorithm were extensively tested on the data sets defined below. Results are given in the next section.
4.1 Data sets
The full CHAMP data set covering 10 years from 2001 to 2010;
TDS-1, a synthetic multicomponent data set used for closed loop and processing tests. External, internal and induced fields as well as noise were taken into account for generating this data set, but the field contributions associated with the field aligned currents were not included. This TDS-1 was supplied by DTU (see Olsen et al., 2013) and the Swarm Science Study (Olsen et al., 2007). The data are provided in two systems of coordinates: In a North-East-Center (NEC) system and in the sensor system of coordinates. In the latter a time constant misalignment error was introduced for each satellite, in order to test the Euler angle estimation process.
The results we present correspond to the output of the final stage of the iterative process using modified Huber weights. To obtain these results, the field models and quaternions were calculated independently. For this test, and due to the specific characteristics of the data set, our data selection scheme was modified by introducing a local time selection at high latitude. This proved to be beneficial probably because the field-aligned currents are not contributing to the synthetic data. As the core field model used to build the TDS-1 is known, a comparison with the DCO outputs is possible. We will refer to this known core field model as the reference model.
Standard deviations of the residuals to the fit to the data in nT.
The core field modeling works well under the conditions of the given Swarm test data set, the fit to the data is good. As stated above, from our experience with the CHAMP data, the standard deviations of the residuals in polar regions are significantly too small compared to what we expect from real data. This is probably because no field-aligned current models are used when generating the synthetic data set. However, for equatorial regions, the residuals’ standard deviations are slightly larger than expected, possibly associated with unexpected contributions from either the ionosphere or the induced magnetic field models.
The benefit of using quaternions for the Euler angle determination is the simplicity of the algorithm for their derivation. But, as a drawback, the quaternion norm needs to be constrained, which for DCO is imposed through regulariza-tion. The Euler angle estimation on TDS-1 is leading to results within the ESA threshold requirements for the Eu-ler angle estimation on Swarm. The γ angles are clearly the most noisy; this is to be expected from the near-polar configuration of the orbits. The same difficulty has been observed with real satellite data.
In the lower frame of Fig. 4 the GRIMM versions differ by the estimation window length in days (w =99, 10, 20); the r2 in the label indicates an additional data filtering applied to CHAMP data to reduce outliers. This filtering was removing data vectors with current data residuals after inversion larger then constant thresholds, which can be set in the configuration for each component and data type. The thresholds chosen are intended to remove apparent short periods of outlier bursts, probably created by suboptimal external field handling. In particular the shown Euler angle X reveals a possibly spurious strong local time dependency, which is common to all estimates. Deviations can result from compromises on complexity (i.e. in external field modeling), from the size of the local time window and from the size of the Euler angle temporal segments. The sensitivity of the DCO-based Euler angle determination to model details appears weak, but the sensitivity to sparseness of segment population and data quality is strong. This is particularly true when a model-angle co-estimation approach is used. As shown on the upper frame of Fig. 4, for the rotation along the X component, the rotations we obtain are generally in agreement with the available references: the apparent local time dependence, also present in the SCA reference series, is mostly reproduced.
The amplitude of the angle α local time dependence is about 30–50 arc secs. This is large in comparison to the requirement of only a few arc secs for the Euler angle estimation performance for Swarm. However, the mechanism behind those strong local time dependences of the angle is not finally clarified, even though it is generally agreed that the dependence is likely to be a signature of the field generated by field aligned currents. This hypothesis is supported by the results obtained with the TDS-1 where, beside the scattering, no spurious signal in the time series of the Euler angle correction estimations is visible (see Fig. 3). The field aligned currents are one prominent external field contribution, that is not properly simulated in the TDS-1. On the other hand, even though the local time dependency is not correlating consistently with the measured temperature signal (private communication with Hermann Lühr), a bending of the optical bench cannot be excluded. It will be interesting to see, if actual Swarm measurements of vector data lead to any significant local time dependent modulation of the Euler angle time series, as has been experienced with CHAMP. Also remarkable is the existence of a remaining local time signal in the difference between the GRIMM Euler angle series and the smoothed SCA solution. This difference looks like a phase shift starting from 2002.5 or shortly after. The appearance of this time-shift is yet unexplained. For short time windows (e.g. 10 days) the angles estimation for the CHAMP data starts to be noisy. For example the scatter of the results is significant in the SCA estimation, for which we also show a version where a symmetric smoothing filter has been applied (see Fig. 4). For our approach, a good compromise between roughness and resolution is found for a window of 20 days (w=20). The optimum results obtained here for the window of 20 days may be attributed to the fact that this choice minimizes the effects of magnetosphere related to magnetic storm activity. The duration of a typical magnetic storm is shorter then this 20 day period.
Finally, we note that the results for the other two rotation angles (not shown) do not present clear patterns. The Z rotation (i.e. the γ angle) is always the most noisy estimate.
Two distinct approaches are integrated in the dedicated core field modeling for Swarm, estimating a core field and estimating the Euler angles. The algorithms have been extensively tested using the Swarm TDS-1. The results show that we are able to recover the reference Gauss coefficients used to build the synthetic data set with a very good accuracy. However, the quality of the core field modeling results when applied to real data can only be assessed if the data selection parameters, the external field model parametrization and the constraints applied to the model are tuned by the “scientist in the loop”. We are confident that the approach we follow can be successful because it has been used on CHAMP satellite data. The estimation of the Euler angles has also been fully tested, on CHAMP data, where the results resembled prominent features revealed by other modelers. Nonetheless, we will have to wait for probably a full year of Swarm data before being able to assess the separation of the external field from the angles estimates.
We thank the anonymous reviewers for the helpful comments. We thank other members of the SCARF consortium for constructive discussions and ESA for financial support. We thank Stefan Maus and Nils Olsen for providing time series of Euler Angle estimates. The figures have been created either with the free statistic software R (R Development Core Team, 2012), or Gnuplot.
- Farquharson, C. G. and D. W. Oldenburg, Non-linear inversion using general measures of data misfit and model structure, Geophys. J. Int., 134, 213–227, 1998.View ArticleGoogle Scholar
- Hamilton, B., Rapid modelling of the large-scale magnetospheric field from Swarm satellite data, Earth Planets Space, 65, this issue, 1295–1308, 2013.View ArticleGoogle Scholar
- Langel, R., R. Estes, and G. Mead, Some new methods in geomagnetic field modeling applied to the 1960-1980 epoch, J. Geomag. Geoelectr., 34, 327–349, 1982.View ArticleGoogle Scholar
- Lesur, V., I. Wardinski, M. Rother, and M. Mandea, GRIMM: the GFZ Reference Internal Magnetic Model based on vector satellite and observatory data, Geophys. J. Int., 173, 382–394, doi:10.1111/j.1365-246X.2008.03724.x, 2008.View ArticleGoogle Scholar
- Lesur, V., I. Wardinski, M. Hamoudi, and M. Rother, The second generation of the GFZ Reference Internal Magnetic field Model: GRIMM-2, Earth Planets Space, 62, 765–773, doi:10.5047/eps.2010.07.007, 2010.View ArticleGoogle Scholar
- Maus, S., M. Rother, C. Stolle, W. Mai, S. Choi, H. Lühr, D. Cooke, and C. Roth, Third generation of the Potsdam Magnetic Model of the Earth (POMME), Geochem. Geophys. Geosyst., 7, Q07008, doi:10.1029/2006GC001269, 2006.View ArticleGoogle Scholar
- Nowaczyk, N. R., H. W. Arz, U. Frank, J. Kind, and B. Plessen, Dynamics of the Laschamp geomagnetic excursion from Black Sea sediments, Earth Planet. Sci. Lett., 351, 54–69, doi:10.1016/j.epsl.2012.06.050, 2012.View ArticleGoogle Scholar
- Olsen, N., A model of the geomagnetic main field and its secular variation for epoch 2000 estimates from Ørsted data, Geophys. J. Int., 149, 454–462, 2002.View ArticleGoogle Scholar
- Olsen, N., T. J. Sabaka, and L. R. Gaya-Pique, Study of an Improved Comprehensive Magnetic Field Inversion Analysis for Swarm, Final Report, Tech. Rep. ESA CONTRACT No 11570/05/NL/AR, Danish National Space Center (DNSC), 2007.Google Scholar
- Olsen, N., M. Mandea, T. J. Sabaka, and L. Tøffner-Clausen, CHAOS-2—a geomagnetic field model derived from one decade of continuous satellite data, Geophys. J. Int., 179, 1477–1487, doi:10.1111/j.1365-246X.2009.04386.x, 2009.View ArticleGoogle Scholar
- Olsen, N., M. Mandea, T. Sabaka, and L. Tøffner-Clausen, The CHAOS-3 geomagnetic field model and candidates for the 11th generation IGRF, Earth Planets Space, 62,719–727, doi:10.5047/eps.2010.07.003, 2010.View ArticleGoogle Scholar
- Olsen, N., E. Friis-Christensen, R. Floberghagen, P. Alken, C. D Beggan, A. Chulliat, E. Doornbos, J. T. da Encarnação, B. Hamilton, G. Hulot, J. van den IJssel, A. Kuvshinov, V. Lesur, H. Lühr, S. Macmillan, S. Maus, M. Noja, P. E. H. Olsen, J. Park, G. Plank, C. Püthe, J. Rauberg, P. Ritter, M. Rother, T. J. Sabaka, R. Schachtschneider, O. Sirol, C. Stolle, E. Thébault, A. W. P. Thomson, L. Tøffner-Clausen, J. Velímský, P. Vigneron, and P. N. Visser, The Swarm Satellite Constellation Application and Research Facility (SCARF) and Swarm data products, Earth Planets Space, 65, this issue, 1189–1200, 2013.View ArticleGoogle Scholar
- R Development Core Team: R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, http://www.R-project.org, 2012.
- Sabaka, T. J., N. Olsen, and M. E. Purucker, Extending comprehensive models of the Earth’s magnetic field with Ørsted and CHAMP data, Geophys. J. Int., 159, 521–547, doi:10.1111/j.1365-246X.2004.02421.x, 2004.View ArticleGoogle Scholar
- Thomson, A. W. P. and V. Lesur, An improved geomagnetic data selection algorithm for global geomagnetic field modelling, Geophys. J. Int., 169, 951–963, doi:10.1111/j.1365-246X.2007.03354.x, 2007.View ArticleGoogle Scholar
- Tøffner-Clausen, L. and F. Hansen, Swarm Phase B, Level 1b Processor Algorithms, Tech. Rep. SW-RS-DSC-SY-0002, Issue 3, Danish National Space Center (DNSC), 2007.Google Scholar
- Wertz, J. R. ed., Spacecraft Attitude Determination and Control, vol. 73 of Astrophysics and Space Science Library, Kluwer Academic Publishers, 1978.Google Scholar