 Technical report
 Open Access
 Published:
A framework for estimating spherical vector fields using localized basis functions and its application to SuperDARN data processing
Earth, Planets and Space volume 72, Article number: 46 (2020)
Abstract
A technique for estimating a plasma drift velocity distribution in the ionosphere is presented. This technique is based on a framework for representing a global vector field on a sphere by using a set of localized basis functions which is newly derived as a variant of the spherical elementary current system (SECS). A vector field on a sphere can be divided into its divergencefree (DF) component and curlfree (CF) component. The DF and CF components can then be represented by weighted sums of the DF and CF vectorvalued basis functions, respectively. While the SECS basis functions have a singular point, the new basis functions do not diverge over a sphere. This property of the new basis function allows us to achieve robust prediction of the drift velocity at any point in the ionosphere. Assuming that the ionospheric plasma drift velocity has no divergence, its distribution can be represented by a weighted sum of the DF basis functions. The proposed technique estimates the ionospheric plasma drift velocity distribution from the SuperDARN data by using the DF basis functions. Since there are some wide gaps in the spatial coverage of the SuperDARN, an empirical convection model is combined with the framework based on the new basis functions. It is demonstrated that the proposed technique is useful for the estimation and modeling of the ionospheric plasma velocity distribution.
Introduction
The global ionospheric convection pattern is a fundamental property of the ionosphere and the magnetosphere, and many studies have conducted modeling of the global convection pattern. One notable empirical model was provided by Heppner and Maynard (1987), which improves on the earlier model of Heppner (1977) by using electric field measurements from Dynamic Explorer 2 (DE2). Weimer (2001) presented an improved electric field model based on the DE2 data as a function of solar wind parameters and geomagnetic conditions. Ruohoniemi and Greenwald (1996) derived empirical convection maps based on Goose Bay HF radar observations. However, since the ionospheric convection field varies greatly according to geomagnetic disturbances, these empirical models are not always guaranteed to well represent variations of the convection pattern.
In order to monitor the variations of the ionospheric convection pattern, global observation networks have been constructed over the last couple of decades. The Super Dual Auroral Radar Network (SuperDARN) (e.g., Greenwald et al. 1995; Nishitani et al. 2019) is one such global network, consisting of HF radars covering high latitudes, and recently it covers even the middle latitudes. Each radar of this network observes the backscatter from fieldaligned irregularities of electron density in the ionosphere and obtains the lineofsight component of the electron drift motion, which follows the \(\varvec{E}\times \varvec{B}\) drift in the Fregion ionosphere. The radar beam typically scans in 16 directions over a 52° sector every 1 or 2 min. The SuperDARN provides global information on the ionospheric plasma drift velocity distribution which is associated with the electric field distribution in the ionosphere. However, there are some wide gaps in the spatial coverage of the SuperDARN. In addition, each radar gives only the lineofsight component of the drift velocity and data are frequently missing. Thus, it is not necessarily easy to retrieve a global convection pattern from the SuperDARN data.
There have been proposed several techniques for obtaining the variations of the global convection pattern. Richmond and Kamide (1988) proposed a method to estimate the variations of the global ionospheric potential distribution by combining various observations including HF radar observations and geomagnetic observations. Although their method is not necessarily for analyzing the SuperDARN data, it is applicable to obtain the ionospheric potential from the SuperDARN data. Ruohoniemi and Baker (1998) presented a method for obtaining the global convection pattern, which is specialized to use the SuperDARN data. The method for SuperDARN data was further improved by employing a set of empirical convection models based on data from the polar cap through the midlatitudes (Thomas and Shepherd 2018). These methods basically use spherical harmonic functions as basis functions to represent the global potential distribution. However, since each spherical harmonic function represents some global pattern, spurious structures can be produced in the data gap region as a result of unevenly distributed data. In addition, it would be difficult to consider relatively smallscale local structures which could be resolved by the SuperDARN. Cousins et al. (2013b) used empirical orthogonal functions based on spherical harmonic functions (Matsuo et al. 2002; Cousins et al. 2013a), and Gjerloev et al. (2018) employed a similar method to obtain the global convection map. Although these approaches would improve an estimate in the data gap region by using empirical orthogonal functions, they may still suffer from the problems due to the use of global basis functions.
Amm (1997) proposed another approach based on a different set of basis functions called spherical elementary current systems (SECS), which was originally introduced for representing ionospheric electric currents. Each SECS basis function is symmetric with respect to its source point, and its value decreases as the distance from its source point increases. The problems of spurious structures in the data gap due to the use of spherical harmonic functions could be avoided by using the SECS basis functions. Amm et al. (2010) demonstrated SECS basis functions are useful for obtaining a regional velocity field from the SuperDARN data. Reistad et al. (2019a, b) performed a statistical analysis of ionospheric convection sources using SECS functions. However, an original SECS basis function has a singular point at which the value of the basis function diverges. This problem is unfavorable when using the analysis results as a reference to compare with other observations such as spacecraft observations. For example, if the footprint of a spacecraft comes to the neighborhood of a singular point by chance, the data from spacecraft observation cannot be compared with an SECS analysis result. Thus, in many applications of the SECS functions, it was essential to appropriately treat the singularities as discussed by Vanhamäki and Juusola (2020).
The present study introduces an alternative set of localized basis functions as a variant of SECS basis functions. The basis functions proposed in this study do not have singular points in order to enable us to obtain reliable estimates and predictions for ionospheric properties. We then propose a technique for estimating the global drift velocity distribution from the SuperDARN data based on the newly introduced basis functions. The use of localized basis functions would make it difficult to effectively predict the drift velocity in the data gap region. However, another existing model such as an empirical convection pattern model can be incorporated into a model with localized functions in order to fill in the data gap. There exists some other localized approaches. Fiori et al. (2010) employed localized spherical cap harmonic functions for analyzing the SuperDARN data. Bristow et al. (2016) proposed another localized approach which discretizes space into cells and assumes local divergencefree for each cell. On the other hand, our approach which is an extension of the SECS method is easy to apply and it would allow a flexible modeling of the ionosphere. Although a basic idea on the proposed technique is briefly described in the paper by Seki et al. (2018), the present paper provides a detailed explanation of the idea of the set of basis functions and their application to estimating the ionospheric drift velocity distribution from the SuperDARN data.
Spherical elementary current systems
Amm (1997) proposed sets of SECS basis functions for representing a vector field on a sphere. There are two sets of SECS basis functions. One comprises curlfree (CF) basis functions:
and the other comprises divergencefree (DF) basis functions:
where \(\varvec{r}\) and \(\varvec{r}_i\) are vectors pointing to positions on a sphere with radius R (i.e., \(\varvec{r}=\varvec{r}_i=R\)), and \(\Delta \theta\) is the angle between the vectors \(\varvec{r}\) and \(\varvec{r}_i\), that is,
and the vectors \(\varvec{e}_{\phi }\) and \(\varvec{e}_{\theta }\) are defined as follows:
The vector \(\varvec{e}_{\phi }\) and \(\varvec{e}_{\theta }\) correspond to unit vectors in the azimuthal and polarangle directions of the spherical coordinate system where the pole is in the direction of the vector \(\varvec{r}_i\). We hereinafter omit the constant factors in Eqs. (1) and (2) because they would not affect the following discussions, that is,
Amm and Viljanen (1999) proposed an expansion of a vector field on a sphere in a series of SECS basis functions:
where i is an index of a basis function, n is the number of the basis functions used in this expansion, and \(\varvec{r}_i\) is the position of the center of the ith basis function. If basis functions located at various positions are distributed over the sphere, then various spherical vector fields can be represented by tuning the weights \(\{w_i^{cf}\}\) and \(\{w_i^{\text{df}}\}\). Equation (8) thus provides a flexible representation of a vector field on a sphere. However, this model is problematic when it is used for practical data analysis. The SECS basis functions \(\varvec{v}^{\text{cf}}(\varvec{r}, \varvec{r}_i)\) and \(\varvec{v}^{\text{df}}(\varvec{r}, \varvec{r}_i)\) diverge to infinity when approaching \(\varvec{r}_i\). Therefore, \(\varvec{V}(\varvec{r})\) in Eq. (8) would diverge to \(\infty\) or \(\infty\) at any \(\varvec{r}_{i}\). This singularity would deteriorate the robustness of the analysis. The prediction using Eq. (8) would thus be unreliable in the vicinity of \(\varvec{r}_{i}.\)
Extension of spherical elementary current systems
A vector field on a sphere can be decomposed into CF and DF components. The basic idea of the SECS expansion is to represent each of the vector field components by a linear combination of CF and DF localized basis functions. The CF SECS basis function was chosen so that its divergence is constant on the sphere except at \(\varvec{r}=\varvec{r}_i\), and the DF SECS basis function was chosen so that its curl is constant except at \(\varvec{r}=\varvec{r}_i\). As described above, however, the SECS basis functions diverge to infinity at \(\varvec{r}=\varvec{r}_i\). This section explores a set of localized basis functions which satisfy the CF or DF condition and take only finite values over the sphere.
Before obtaining alternative set of basis functions, we consider scalar functions \(\Psi ^{\text{cf}}(\varvec{r} )\) and \(\Psi ^{\text{df}}(\varvec{r} )\) defined on a sphere. From these scalar functions, the following two kinds of spherical vector fields can be derived:
where \(\nabla _\Omega \,\) denotes the gradient operator on the sphere and \(\varvec{e}_r\) denotes the radial unit vector at \(\varvec{r}\). The vector field \(\varvec{V}^{\text{cf}}\) satisfies the CF condition \(\nabla _\Omega \,\times \varvec{V}^{\text{cf}}=0\), where \(\Psi ^{cf}\) gives its scalar potential. The vector field \(\varvec{V}^{\text{df}}\) satisfies the DF condition \(\nabla _\Omega \,\cdot \varvec{V}^{\text{df}}=0\), where \(\Psi ^{\text{df}}\) gives its stream function. We approximate each scalar function by a series of radial basis functions as follows:
Each of these equations can be regarded as a radial basis function network (e.g., Bishop, 2006). The radial basis functions \(\psi ^{\text{cf}}\) and \(\psi ^{\text{df}}\) yield the following localized vectorvalued basis functions satisfying CF and DF conditions, respectively:
Equtions (9) and (10) can thus be rewritten in the forms
and thus a vector field \(\varvec{V}(\varvec{r})\) can be decomposed as follows:
Equtions (13) and (14) provide sufficient conditions of CF and DF basis functions, respectively. If we choose
then we obtain the SECS CF and DF basis functions in Eqs. (6) and (7).
A different choice of \(\psi ^{\text{cf}}\) and \(\psi ^{\text{df}}\) provides a different set of basis functions. One practical choice would be a spherical Gaussian function as follows:
where \(\eta\) is a scale parameter which gives the spread of the spherical Gaussian function. As \(\eta\) is smaller, the spread becomes larger. When Eq. (19) is used, Eqs. (11) and (12) are regarded as Gaussian radial basis function networks bounded on a sphere for representing \(\Psi ^{\text{cf}}\) and \(\Psi ^{\text{df}}\). In principle, the Gaussian radial basis function network can represent any scalar function in a finite region with arbitrary accuracy by tuning the scale parameter and the number of basis functions (Park and Sandberg 1991, 1993). According to Eqs. (13) and (14), the spherical Gaussian function in Eq. (19) yields the following CF and DF basis functions:
Figure 1 shows the shape of basis stream functions and the profile of the azimuthal component of DF basis functions. In the left panel of Fig. 1, the dotted line indicates the profile of a basis stream function for an original SECS function in Eq. (18), and the solid line indicates that for a proposed basis function in Eq. (19), where \(\eta = 131.4\). In the right panel, the dotted line indicates the profile of the azimuthal component of a DF SECS basis function in Eq. (7) and the solid line indicates a proposed DF basis function in Eq. (21). While the SECS functions diverge as \(\Delta \theta\) is approaching 0, the proposed basis functions take finite values at any point. Accordingly, an expansion in the form of Eq. (17) would take finite values at any point on the sphere as far as all the weights \(\{w_i^{\text{cf}}\}\) and \(\{w_i^{\text{df}}\}\) are finite.
Estimation of ionospheric plasma velocity field
As an application of the newly introduced basis functions in Eqs. (20) and (21), we estimate a temporal evolution of the ionospheric plasma velocity field from the SuperDARN data. The plasma velocity field in the ionosphere can be reasonably assumed to have no divergence. We can thus consider a stream function of the velocity field at the time \(t_k\) in the form of Eq. (12):
where a spherical Gaussian function in Eq. (19) is chosen as the stream function \(\psi\) here. Since we consider a DF situation where the CF component can be ignored, the superscript df is omitted. The velocity field at \(t_k\) can be derived from the stream function in Eq. (22) as follows:
where \(\varvec{v}(\varvec{r}, \varvec{r}_i)\) is the DF basis function in Eq. (21). We placed 2500 basis functions over the region of the northern hemisphere at higher geomagnetic latitudes than 40°. The poles of the basis functions \(\{\varvec{r}_i\}\) are distributed uniformly but at random locations over this region. Since the basis functions are distributed fairly uniformly, Eq. (23) corresponds to a Monte Carlo approximation of the following convolution integral (Heaton et al. 2014)
where S indicates the region above \(40^{\circ }\) in geomagnetic latitude. A spherical Gaussian function has a scale parameter \(\eta\) which gives its spread. As \(\eta\) is smaller, the spread becomes larger. If the spread is taken to be too small, each localized basis function could not fill the gaps with its neighbors and erroneous artifacts would be produced when the expansion of Eq. (23). Meanwhile, if the spread is too small, the spatial resolution of Eq. (23) becomes poor. Here we set \(\eta\) at 131.4, which is determined so that the exponent of Eq. (19) becomes half of the peak value at \(\Delta \theta =5^{\circ }\). This means the typical spread of a localized basis function in Eqs. (20) and (21) is \(5\pi R/180\) in geodesic distance on the sphere. This spatial spread is large enough to enable us to represent a spatially smooth solution with 2500 basis functions distributed in the region of interest.
We want to obtain such weights \(\{w_{k,1}, \ldots \}\) that \(\varvec{V}_k(\varvec{r})\) will fit to the observations from the SuperDARN. We denote the jth record of the lineofsight plasma velocity as \(y_{k,j}\) and the location of that record as \(\varvec{r}_{k,j}\). A prediction for \(y_{k,j}\) based on Eq. (23) is given as
where \(\varvec{e}_{k,j}\) denotes a unit vector in the lineofsight direction of a radar beam providing a velocity measurement at the point \(\varvec{r}_{k,j}\). Denoting the observation noise as \(\varepsilon _{k,j}\), the observed lineofsight velocity \(y_{k,j}\) can be written as
Combining all the records of lineofsight plasma drift velocity at the time \(t_k\) into one vector \(\varvec{y}_k\), Eq. (26) for all the records can be written in the following form:
where \(\varvec{w}_k\) is a vector consisting of all the weights contained in Eq. (23), \(\varvec{\varepsilon }_k\) is a vector consisting of \(\varepsilon _{k,j}\) for all \(y_{k,j}\), and \(\mathsf {H}_k\) is a matrix of which each element \(H_{k,ji}\) is defined as
If the estimate of \(\varvec{w}_k\) is obtained, then we can basically predict the plasma drift velocity at an arbitrary point \(\varvec{r}\) by using Eq. (23). However, there are some wide gaps in the spatial coverage of the SuperDARN, and the radars could miss velocity measurements even in the fields of view. It is difficult to appropriately determine the weights for the entire region in the hemisphere. In order to resolve the problems of observation gaps and missing data, we use an empirical model of the ionospheric electric potential as additional information. We decompose the weight \(\varvec{w}_{k}\) into the background component \(\varvec{\zeta }_{k}\) and the disturbance component \(\varvec{\beta }_k\) as follows:
The background component \(\varvec{\zeta }_k\) can be obtained by assuming that the plasma drift velocity is equal to the \(\varvec{E}\times \varvec{B}\) velocity which is given by the empirical model of the electric potential distribution. In this study, the electric potential model by Weimer (2001) is used to obtain \(\varvec{\zeta }_k\). The OMNI hourly solar wind data were used as the input of the Weimer model. The background potential distribution at each minute is then obtained by linear interpolation of the hourly distribution of the Weimer model.
If \(\varvec{\zeta }_k\) is given, Eq. (27) can be rewritten as
We then estimate the disturbance component \(\varvec{\beta }_k\) by using a Bayesian method, which is based on the posterior distribution given the observations \(\varvec{y}_k\). The posterior distribution \(p(\varvec{w}_k\varvec{y}_k)\) is obtained according to Bayes’ theorem:
In the following, a Gaussian distribution with mean \(\varvec{\mu }\) and covariance matrix \(\mathsf {P}\) is denoted as \({\mathcal {N}}(\varvec{\mu }, \mathsf {P})\). If \(\varvec{\varepsilon }_k\) in Eq. (30) obeys a Gaussian distribution \({\mathcal {N}}(\varvec{0}, \mathsf {R}_k)\), \(p(\varvec{y}_k\varvec{\beta }_k)\) becomes the Gaussian distribution with mean \(\mathsf {H}_k\varvec{\zeta }_k+\mathsf {H}_k\varvec{\beta }_k\) and variance \(\mathsf {R}_k\), that is
In addition, we assume that the prior distribution \(p(\varvec{\beta }_k)\) is Gaussian as follows:
The posterior distribution \(p(\varvec{\beta }_k\varvec{y}_k)\) then becomes a Gaussian distribution, where its mean vector \(\bar{\varvec{\beta }}_{k}\) and covariance matrix \(\bar{\mathsf {P}}_k\) are
The mean of the posterior in Eq. (34) can be regarded as an estimate of the disturbance, and it provides an estimate of the weight \(\bar{\varvec{w}}_k\) as follows:
Once \(\bar{\varvec{w}}_k\) is obtained, the stream function can be estimated by Eq. (22), and the plasma velocity field \(\varvec{V}_k(\varvec{r})\) can be estimated by Eq. (23). The covariance matrix of the posterior in Eq. (35) represents the uncertainty of the estimate of \(\bar{\varvec{\beta }}_k\). The uncertainty of \(\Psi _k(\varvec{r})\) can be evaluated by introducing the following vector:
Using the vector \(\varvec{a}\), the variance of \(\Psi _k(\varvec{r})\) becomes
This can be used as a proxy of the uncertainty of \(\Psi _k(\varvec{r})\). The uncertainty of each component of the plasma velocity \(\varvec{V}_k(\varvec{r})\) can also be evaluated in a similar manner.
The prior distribution of the disturbance \(p(\varvec{\beta }_{k})\) can be determined in various ways. One effective way is to determine \(p(\varvec{\beta }_{k})\) based on the observations in the previous time intervals. This means that the conditional distribution \(p(\varvec{\beta }_{k}\varvec{y}_{1:k1})\) is used as a prior distribution, where \(\varvec{y}_{1:k1}\) denotes the sequence of the observations \(\{\varvec{y}_1, \varvec{y}_2, \ldots , \varvec{y}_{k1}\}\). We then obtain
The conditional distribution \(p(\varvec{\beta }_{k}\varvec{y}_{1:k1})\) can be obtained from \(p(\varvec{\beta }_{k1}\varvec{y}_{1:k1})\), which corresponds to the distribution of Eq. (39) for the previous time interval. We assume the distribution \(p(\varvec{\beta }_{k1}\varvec{y}_{1:k1})\) is Gaussian as follows:
In addition, the probability distribution of \(\varvec{\beta }_{k}\) given the disturbance for the previous time interval, \(\varvec{\beta }_{k1}\), is assumed to be a Gaussian distribution
We then obtain a predictive distribution of \(\varvec{\beta }_k\) as a Gaussian distribution:
where the mean vector \(\varvec{\beta }_{kk1}\) and covariance matrix \(\mathsf {P}_{kk1}\) are given as
Similarly to Eqs. (34) and (35), the posterior mean \(\varvec{\beta }_{kk}\) becomes
and the posterior covariance matrix \(\mathsf {P}_{kk}\) is
Applying Eqs. (43)–(46) recursively, \(\varvec{\beta }_k\) for each time interval can be estimated. This is the Kalman filter algorithm for estimating \(\varvec{\beta }_k\) based on the sequence of observations \(\varvec{y}_1, \ldots , \varvec{y}_k\). The estimate of \(\varvec{\beta }_k\) provides the estimate of \(\varvec{w}_k\) according to Eq. (29). The posterior distribution of \(\varvec{w}_k\) is thus given as
where \(\varvec{w}_{kk}=\varvec{\zeta }_k+\varvec{\beta }_{kk}\). The stream function is estimated according to Eq. (22):
where \(w_{kk,i}\) denotes the ith element of the vector \(\varvec{w}_{kk}\). The plasma drift velocity distribution is also estimated according to Eq. (23):
As done in Eq. (38), the variance of the \(\Psi _{k}\) given \(\varvec{y}_{1:k}\) can be obtained as follows:
and the variance of \(\varvec{V}_k\) given \(\varvec{y}_{1:k}\) can also be obtained using a similar equation.
In the beginning of the Kalman filter algorithm, \(\varvec{\beta }_{00}\) and \(\mathsf {P}_{00}\) were set as follows:
Although the initial variance \(\mathsf {P}_{00}\) is very large, it becomes a reasonable value after several steps. In order to estimate a sequence of \(\varvec{\beta }_k\), the parameter \(\alpha\) in Eq. (41) and the covariance matrices \(\mathsf {Q}\) and \(\mathsf {R}_k\) must also be given in advance. In order to ensure spatial smoothness among the elements of \(\varvec{\beta }_k\), the matrix \(\mathsf {Q}\) is set as follows:
where \(C_Q(\varvec{r}_i, \varvec{r}_j)\) is a correlation function between \(\varvec{r}_i\) and \(\varvec{r}_j\). We assume \(C_Q(\varvec{r}_i, \varvec{r}_j)\) is a spherical Gaussian function:
where we assume \(\kappa =14.7\) so that the exponent becomes half of the peak at \(\Delta \theta =15^{\circ }\). The function \(\rho\) in Eq. (53) forces the stream function \(\Psi _k(\varvec{r})\) at the boundary (\(40^{\circ }\) geomagnetic latitude) to be near zero. We define \(\rho\) as follows:
The matrix \(\mathsf {R}_k\) is set as follows:
where m is the dimension of \(\varvec{y}_k\), \(\delta _{ij}\) is the Kronecker delta:
\(b_i\) and \(g_i\) denote the beam number and the range gate of the ith element of the observation \(\varvec{y}\). The beam number indicates the direction of a radar beam and the range gate is associated with the distance from a radar site. We assume \(C_R(g_i, g_j)\) can be written in the following form:
Equation (55) means the correlations within the same beam are considered while the correlations between different beams are ignored. The parameters \(\sigma _Q\), \(\sigma _R\), and \(\alpha\) are determined by maximizing the marginal likelihood:
(e.g., Morris 1983; Casella 1985). As a result, we chose \(\sigma _Q=100\), \(\sigma _R=400\), and \(\alpha =0.9\).
In order to evaluate how the proposed basis functions works, we performed fitting to the drift velocity distribution obtained from an empirical model by Weimer (2001). The red line in Fig. 2 shows the latitudinal profile of the azimuthal velocity at 3h MLT which was reconstructed by the proposed functions. For reference, the reconstruction with the original SECS functions is overplotted with the blue line, and the drift velocity profile directly derived from the Weimer’s model is overplotted with the green line. In this fitting, we did not consider the temporal evolution; that is, the estimation was performed with Eq. (34), where \(\mathsf {P}_{b,k}\) was taken to be as large as \(\mathsf {P}_{00}\) in Eq. (51). While the Weimer’s model gives a smooth latitudinal profile, the original SECS functions produce a little serrated profile due to their singularities. This problem would be inconvenient when compared with other observations such as spacecraft observations. In comparison with highresolution data such as total electron content (TEC) data from Global Navigation Satellite System (GNSS) satellites, it would be almost impossible to expect all the data points are apart from a center of any basis functions. The singularities could be eliminated by modifying the original SECS functions in the neighborhood of their source points as discussed by Vanhamäki and Juusola (2020). The proposed basis functions provide another practical way which enables us to obtain a reasonable estimate as smooth as the Weimer’s model.
Application
We estimated the temporal evolution of the ionospheric plasma drift velocity distribution during the magnetic storm on March 17, 2015 by using the method described in the previous section. In advance of applying the above method, the records of lineofsight velocity of which the absolute values were less than \(100\,\mathrm {m/s}\) were excluded because they might be ground scatter echoes. The records of the absolute values that were larger than \(2000\,\mathrm {m/s}\) were also excluded as outliers. We used the data from 16 radar sites (Adak Island East, Adak Island West, Christmas Valley East, Christmas Valley West, Fort Hays East, Fort Hays West, Hankasalmi, Hokkaido East, Hokkaido West, Inuvik, Kapuskasing, King Salmon, Prince George, Pykkvibaer, Rankin Inlet, Saskatoon) in operation during this event.
Figure 3 shows the estimated plasma drift velocity distribution and some related quantities at 08:30 UT, when the data coverage on the nightside was relatively good. The upperleft panel indicates the stream function estimated according to Eq. (48), and the upperright panel indicates the uncertainty of the stream function value as estimated by the variance of the posterior distribution of the stream function, which can be obtained using Eq. (50). The lowerleft panel shows the estimated plasma drift velocity distribution with white arrows. The uncertainty of the plasma drift velocity is superposed with a color code in this panel. The lowerright panel shows the number of the available SuperDARN data for past 10 min for each bin, where white indicates no data points being available for that bin. As shown in the lowerright panel, the SuperDARN data points were not evenly distributed, but rather most of the data were obtained on the duskside or the nightside at this time. Accordingly, the uncertainty of the estimate tends to be small on the duskside and the nightside, while it tends to be large on the dawnside and the dayside as indicated in the upperright panel and the lowerleft panels. The uncertainty near the outer boundary is also small because we assume \(\Psi _k(\varvec{r})\) at the boundary to be zero.
Figure 4 shows geomagnetic indices (the SYMH and AE indices) and the southward component of the interplanetary magnetic field observed by the ACE spacecraft from 00:00 to 12:00 UT for reference. At 08:30 UT, a magnetic storm was in progress, and the empirical model by Weimer (2001) predicted that the twocell convection structure was well developed, which is shown in the upperleft panel of Fig. 3. In order to determine the impact of the SuperDARN data, the drift velocity distribution is decomposed into two components: the background Weimer model component \(\zeta _k\) and the disturbance component \(\beta _k\). As described above, the disturbance \(\beta _k\) is estimated so as to fit the SuperDARN data. Thus, the disturbance component reflects the impact of the SuperDARN data. The left and right panels in Fig. 5 show the background and the disturbance components, respectively. In the polar cap region, the disturbance component shows a flow toward the dayside, which is opposite to the normal twocell convection as seen in the empirical model. This would suggest that the flow speed in the dayside polar cap region was overestimated by the empirical model and that it was estimated to be smaller by considering the SuperDARN data. On the nightside, the disturbance component was small, which means the empirical model predicted the flow distribution with high accuracy.
Figure 6 shows the temporal evolution of the estimated plasma drift velocity distribution from 06:00 to 08:30 UT, and Fig. 7 shows the corresponding evolution of the disturbance component. The estimation result shows the ionospheric convection was weak at 06:00 UT. At 06:30 UT, the ionospheric convection was estimated to be enhanced, which was in accord with the southward turning of the solar wind magnetic field around 06:00 UT as shown in Fig. 4. The disturbance component at 06:30 UT was in the opposite sense to the estimated plasma velocity shown in Fig. 7 especially in the polar cap region, which suggests the empirical model overestimated the plasma velocity there. The disturbance component gradually decayed until 07:30 UT on the dayside. In the postmidnight region, the westward disturbance component is maintained from \(50^{\circ }\) to \(60^{\circ }\) geomagnetic latitude. In the premidnight region, the disturbance component is oriented northward. At 08:30 UT, the disturbance component in the sunlit polar cap was visible again. Figure 8 shows a histogram of the deviation of the observed lineofsight velocity from the estimate obtained with the proposed method with a red line. The deviation of the observation from the prediction with the background Weimer’s model is also shown with blue shade. Large residuals still remain after the fitting probably because we assumed temporal smoothness as in Eq. (41) and spatial smoothness as in Eq. (52) to obtain robust results. However, the residuals certainly became smaller than the prediction with the Weimer’s model. The global observation such as the SuperDARN provides vital information for improving a prediction with an empirical model for each event. The proposed technique is helpful for making use of the global measurement in order to obtain a reliable prediction.
Discussion and concluding remarks
We have proposed a technique for estimating the spatial distribution of ionospheric plasma drift velocity. In this technique, the ionospheric plasma velocity distribution is represented by a sum of the background component and the perturbation component. While the background component is obtained from an empirical convection model, the perturbation component is written by a weighted sum of DF localized basis functions. In modeling of the global ionospheric drift velocity distribution, global basis functions such as spherical harmonic functions were usually used (e.g., Ruohoniemi and Baker 1998; Thomas and Shepherd 2018). However, such global basis functions may cause spurious artifacts in the data gap region when using the SuperDARN data. The use of localized basis functions would be an effective way to avoid such artifacts.
The basis functions introduced in this study can be regarded as a variant of the SECS proposed by Amm (1997). However, the original SECS basis functions have a singular point. This problem would be serious especially when analyzing measurement data with high spatial resolution such as the SuperDARN data. If highresolution data are used, it would be difficult to place all singular points apart from any observation points. This means that some observation points would be in the vicinity of singular points. In such a situation, analysis with the SECS functions would be strongly constrained by the data obtained in the vicinity of singularities, and representation of largescale features could be poor.
In contrast, the basis functions employed in this paper have been derived from spherical Gaussian functions, and they do not have a singular point. The proposed framework would enable us to obtain a natural smooth solution in analysis of high spatial resolution data. Moreover, it enables us to obtain a reliable estimate of the plasma drift velocity at an arbitrary point of the ionosphere. This allows us to use analysis results as a reference for comparison with other observations such as spacecraft observations. Nowadays a variety of ionospheric and geomagnetic measurements attain high spatial resolution. The proposed framework would also be helpful for comparing such data with high spatial resolution.
This study focused on the estimation of the global plasma velocity in the ionosphere. However, the basis functions introduced in this study can be applied for a variety of purposes as the original SECS functions are used for many studies. For example, since the proposed framework employs local basis functions, we can apply this framework for estimating a regional pattern of the plasma velocity distribution as done by Hori et al. (2018). Modeling of the ionospheric electric current would also be a potentially useful application. The original work by Amm (1997) proposed the SECS functions for representing ionospheric currents and analyzing ground magnetic disturbances due to the ionospheric currents. Many studies have employed the SECS functions for this purpose. Such analyses of ionospheric currents could be improved with the proposed smooth basis functions.
Availability of data and materials
The SuperDARN data were obtained in the form of common time fitacf CDF via ERG Science Center (ERGSC) data repository (Hori et al. 2015). The SYMH and AE indices were obtained via the World Data Center for Geomagnetism, Kyoto University. The ACE data were obtained through the Coordinated Data Analysis Web (CDAWeb) of NASA/GSFC.
Abbreviations
 DF:

Divergence free
 CF:

Curl free
 DE2:

Dynamic Explorer 2
 SuperDARN:

Super Dual Auroral Radar Network
 SECS:

Spherical Elementary Current System
References
Amm O (1997) Ionospheric elementary current systems in spherical coordinates and their application. Earth Planets Space 49:947–955
Amm O, Viljanen A (1999) Ionospheric disturbance magnetic field continuation from the ground to the ionosphere using spherical elementary current systems. Earth Planets Space 51:431–440
Amm O, Grocott A, Lester M, Yeoman TK (2010) Local determination of ionospheric plasma convection from coherent scatter radar data using the SECS technique. J Geophys Res 115:A03304. https://doi.org/10.1029/2009JA014832
Bishop CM (2006) Pattern recognition and machine learning. Springer, New York
Bristow WA, Hampton DL, Otto A (2016) Highspatialresolution velocity measurements derived using local divergencefree fitting of SuperDARN observations. J Geophys Res 121:1340–1361. https://doi.org/10.1002/2015JA021862
Casella G (1985) An introduction to empirical Bayes data analysis. Amer Stat 39:83–87
Cousins EDP, Matsuo T, Richmond AD (2013a) Mesoscale and largescale variability in highlatitude ionospheric convection: Dominant modes and spatial/temporal coherence. J Geophys Res 118:7895–7904. https://doi.org/10.1002/2013JA019319
Cousins EDP, Matsuo T, Richmond AD (2013b) SuperDARN assimilative mapping. J Geophys Res 118:7954–7962. https://doi.org/10.1002/2013JA019321
Fiori RAD, Boteler DH, Koustov AV, Haines GV, Ruohoniemi JM (2010) Spherical cap harmonic analysis of Super Dual Auroral Radar Network (SuperDARN) observations for generating maps. J Geophys Res 115:A07307. https://doi.org/10.1029/2009JA015055
Gjerloev JW, Waters CL, Barnes RJ (2018) Deriving global convection maps from SuperDARN measurements. J Geophys Res 123:2902–2915. https://doi.org/10.1002/2017JA024543
Greenwald RA, Baker KB, Dudeney JR, Pinnock M, Jones TB, Thomas EC, Villain JP, Cerisier JC, Senior C, Hanuise C, Hunsucker RD, Sofko G, Koehler J, Nielsen E, Pellinen R, Walker ADM, Sato N, Yamagishi H (1995) DARN/SuperDARN: a global view of the dynamics of highlatitude convection. Space Sci Rev 71:761–796
Heaton MJ, Katzfuss M, Berrett C, Nychka DW (2014) Constructing valid spatial processes on the sphere using kernel convolutions. Environmetrics 25:2–15. https://doi.org/10.1002/env.2251
Heppner JP (1977) Empirical models of highlatitude electric fields. J Geophys Res 82:1115–1125
Heppner JP, Maynard NC (1987) Empirical highlatitude electric field models. J Geophys Res 92:4467–4489
Hori T, Miyashita Y, Miyoshi Y, Seki K, Segawa T, Tanaka YM, Keika K, Shoji M, Shinohara I, Shiokawa K, Otsuka Y, Abe S, Yoshikawa A, Yumoto K, Obana Y, Nishitani N, Yukimatu AS, Nagatsuma T, Kunitake M, Hosokawa K, Ogawa Y, Murata KT, Nosé M, Kawano H, Sakanoi T (2015) CDF data archive and integrated data analysis platform for ERGrelated ground data developed by ERG Science Center (ERGSC), JAXA Research and Development Report. J Space Sci Inf Jpn 4:75–89. https://repository.exst.jaxa.jp/dspace/handle/ais/326251
Hori T, Nishitani N, Shepherd SG, Ruohoniemi JM, Connors M, Teramoto M, Nakano S, Seki K, Takahashi N, Kasahara S, Yokota S, Mitani T, Higashio N, Matsuoka A, Asamura K, Kazama Y, Wang SY, Tam SWY, Chang TF, Wang BJ, Miyoshi Y, Shinohara I (2018) Substormassociated ionospheric flow fluctuations during the 27, (March 2017) magnetic storm: SuperDARNArase conjunction. Geophys Res Lett 45:9441–9449. https://doi.org/10.1029/2018GL079777
Matsuo T, Richmond AD, Nychka DW (2002) Modes of highlatitude electric field variability derived from DE2 measurements: Empirical Orthogonal Function (EOF) analysis. Geophys Res Lett 29:1107. https://doi.org/10.1029/2002GL014077
Morris CM (1983) Parametric empirical Bayes inference: theory and applications. J Am Stat Assoc 78:47–55
Nishitani N, Ruohoniemi JM, Lester M, Baker JBH, Koustov AV, Shepherd SG, Chisham G, Hori T, Thomas EG, Makarevich RA, Marchaudon A, Ponomarenko P, Wild JA, Milan SE, Bristow WA, Devlin J, Miller E, Greenwald RA, Ogawa T, Kikuchi T (2019) Review of the accomplishments of midlatitude Super Dual Auroral Radar Network (SuperDARN) HF radars. Prog Earth Plan Sci 6:27. https://doi.org/10.1186/s4064501902705
Park J, Sandberg IW (1991) Universal approximation using radialbasisfunction networks. Neural Comput 3:246–257
Park J, Sandberg IW (1993) Approximation and radialbasisfunction networks. Neural Comput 5:305–316
Reistad JP, Laundal KM, Østgaard N, Ohma A, Haaland S, Oksavik K, Milan SE (2019a) Separation and quantification of ionospheric convection sources: 1. A new technique. J Geophys Res 124:6343–6357. https://doi.org/10.1029/2019JA026634
Reistad JP, Laundal KM, Østgaard N, Ohma A, Thomas EG, Haaland S, Oksavik K, Milan SE (2019b) Separation and quantification of ionospheric convection sources: 2. The dipole tilt angle influence on reverse convection cells during northward IMF. J Geophys Res 124:6182–6194. https://doi.org/10.1029/2019JA026641
Richmond AD, Kamide Y (1988) Mapping electrodynamic features of the highlatitude ionosphere from localized observations: technique. J Geophys Res 93:5741–5759
Ruohoniemi JM, Baker KB (1998) Largescale imaging of highlatitude convection with Super Dual Auroral Radar Network HF radar observations. J Geophys Res 103:20797–20811
Ruohoniemi JM, Greenwald RA (1996) Statistical patterns of highlatitude convection obtained from Goose Bay HF radar observations. J Geophys Res 101:21743–21763
Seki K, Miyoshi Y, Ebihara Y, Katoh Y, Amano T, Saito S, Shoji M, Nakamizo A, Keika K, Hori T, Nakano S, Watanabe S, Kamiya K, Takahashi N, Omura Y, Nose M, Fok MC, Tanaka T, Ieda A, Yoshikawa A (2018) Theory, modeling, and integrated studies in the Arase (ERG) project. Earth Planets Space 70:17. https://doi.org/10.1186/s4062301807859
Thomas EG, Shepherd SG (2018) Statistical pattern of ionospheric convection derived from midlatitude, highlatitude, and polar SuperDARN HF radar observations. J Geophys Res 123:3196–3216. https://doi.org/10.1002/2018JA025280
Vanhamäki H, Juusola L (2020) Introduction to spherical elementary current systems. In: Dunlop MW, Lühr H (eds) Ionospheric multispacecraft analysis tools. Springer, New York, pp 25–26
Weimer DR (2001) An improved model of ionospheric electric potentials including substorm perturbations and application to the Geospace Environment Modeling November 24, 1996 event. J Geophys Res 106:407–416
Acknowledgements
SuperDARN is a collection of radars funded by national scientific funding agencies of Australia, Canada, China, France, Italy, Japan, Norway, South Africa, United Kingdom, and the United States. The authors would like to thank the World Data Center for Geomagnetism, Kyoto University, for providing the SYMH and AE indices. The authors would also like to thank N. Ness and the ACE Science Center for providing the ACE data. This study was carried out on Supercomputer System for Statistical Science at ISM under the ISM Cooperative Research Program (2018ISMCRP2009).
Funding
The work of SN was in part supported by JSPS KAKENHI Grant Number JP17H01704. The work of TH was done at ERGSC and was in part supported by JSPS KAKENHI grant number JP19K03949.
Author information
Affiliations
Contributions
SN developed the technique and conducted the data analysis. TH and NN processed and organized the SuperDARN data. KS built scientific foundations and ideas of this research. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Nakano, S., Hori, T., Seki, K. et al. A framework for estimating spherical vector fields using localized basis functions and its application to SuperDARN data processing. Earth Planets Space 72, 46 (2020). https://doi.org/10.1186/s40623020011684
Received:
Accepted:
Published:
Keywords
 SuperDARN
 Plasma drift velocity
 Ionospheric convection
 Spherical elementary current system
 Radial basis function network
 Kalman filter