 Full paper
 Open Access
 Published:
Statistical analysis of ionospheric total electron content (TEC): longterm estimation of extreme TEC in Japan
Earth, Planets and Space volume 73, Article number: 52 (2021)
Abstract
Ionospheric total electron content (TEC) is one of the key parameters for users of radiobased systems, such as the Global Navigation Satellite System, highfrequency communication systems, and spacebased remote sensing systems, since total ionospheric delay is proportional to TEC through the propagation path. It is important to know extreme TEC values in readiness for hazardous ionospheric conditions. The purpose of this study is to estimate extreme TEC values with occurrences of once per year, 10 years, and hundred years in Japan. In order to estimate the extreme values of TEC, a cumulative distribution function of daily TEC is derived using 22 years of TEC data from 1997 to 2018. The extreme values corresponding to once per year and 10 years are 90 and 110 TECU, respectively, in Tokyo, Japan. On the other hand, the 22year data set is not sufficient to estimate the onceper100year value. Thus, we use the 62year data set of manually scaled ionosonde data for the critical frequency of the Flayer (foF2) at Kokubunji in Tokyo. First, we study the relationship between TEC and foF2 for 22 years and investigate the slab thickness. Then the result is applied to the statistical distribution of foF2 data for 62 years. In this study, two methods are applied to estimate the extreme TEC value. In the first method, the distribution of slab thickness is artificially inflated to estimate extreme TEC values. In the second method, extreme slab thicknesses are applied to estimate extreme TEC values. The result shows that the onceper100year TEC is about 150–190 TECU at Tokyo. The value is also estimated to be 180–230 TECU in Kagoshima and 120–150 TECU in Hokkaido, in the southern and northern parts of Japan, respectively.
Introduction
The ionospheric condition is one of the most important space weather features for users of radiobased systems, such as navigation systems based on the Global Navigation Satellite System (GNSS), highfrequency (HF) communication systems, and spacebased remote sensing systems. Radio waves propagating in the ionosphere experience a delay in group velocity and advance in phase velocity due to the electrons in the ionosphere. The ionospheric delay is proportional to the ionospheric total electron content (TEC) along the propagation path. The easiest way to correct the ionospheric delay is to utilize broadcast ionospheric delay models based on simple empirical TEC models such as the Klobuchar (1987) and NeQuick (Hochegger et al. 2000, Radicella and Leitinger 2001) models. The TEC value is determined by many factors, such as solar activity, the season, local time, and geomagnetic activity. There is also latitudinal dependence in TEC variations. TEC variations caused by solar activity, the season, and local time may be estimated using these simple models but those caused by geomagnetic storms and other phenomena cannot be fully removed from these models. Therefore, users of radiobased systems may be affected by positive and/or negative ionospheric storms. During negative ionospheric storms, TEC is ≥ 0 TECU even if the negative storm is extremely severe. On the other hand, extreme TEC values during positive storms are not unknown and should be studied.
For the design and operation of systems that may be impacted by space weather phenomena, it is important to know the possible extent of the impact and how often such events are likely to occur. Thus, it is important to study extreme values related to various space weather phenomena. For users of transionosphere radiobased systems, the extreme TEC value is a key value.
Extreme values of some space weather parameters have been studied. For example, that of the Dst index was investigated using extreme value modeling (Tsubouchi and Omura 2007). Those of the solar flare Xray flux, speed of coronal mass ejection, Dst index, and proton energy in proton events were studied by Riley (2012) using complementary cumulative distribution functions. More recently, that of shortwave fadeout by a solar flare was examined on the basis of longterm ionosonde observation data (Tao et al. 2020).
However, extreme TEC values of once per long period of time have not yet been quantitatively estimated. Several countries have prepared documents with space weather benchmarks. The US White House published “Space Weather Phase 1 Benchmarks” in June 2018 (US White House 2018). Although it lists three factors that cause ionospheric disturbances, such as geomagnetic storms, quantitative benchmarks were not provided because the ionospheric effects of geomagnetic storms on the ionosphere largely differ from event to event and even their mechanism is not completely understood.
Another reason why extreme TEC values have not been fully studied is that only 20 years has passed since the start of fully fledged TEC observations. TEC observations started with measurements of the Faraday rotation or Doppler effect many decades ago (Bauer and Daniels 1959; Evans 1977). Since these observations were conducted by a few transmitters and receivers, it is difficult to study TEC behavior statistically. With the spread of GNSS and its groundbased receivers, the number of TEC observations dramatically increased. Thanks to the GNSSTEC observation systems, we have learned a lot about TEC behavior during the last 20 years (for example Foster 2007; Nishioka et al. 2009; Maruyama et al. 2013). The purpose of this study is to estimate extreme values of TEC with their occurrence rates. We investigate the occurrence rates of extreme values of TEC in Japan in the short, mid, and long term, which are once per year, 10 years, and 100 years, respectively.
To evaluate TEC corresponding to an occurrence rate of once per 100 years, 20 years of data is obviously insufficient. Furthermore, solar activity in the last 20 years has on average been moderate, although several intense geomagnetic storms occurred during solar cycle 24. Compared with GNSSTEC observation, ionosonde observation has a much longer history. This technique was developed in the late 1920s and began to be implemented in the 1940s in order to monitor shortwave propagation (Gladden 1959). In Japan, ionosonde observation began in 1931. After going through various changes, routine ionosonde observation was started by the predecessor of National Institute of Information and Communications Technology (NICT) in 1951 using an automatic system. Ionospheric parameters derived from the longterm ionosonde observation are archived by World Data Center for the Ionosphere at NICT (http://wdc.nict.go.jp/IONO/wdc/). Longterm ionosonde data have been used for various studies such as a study of the longterm trends of the ionosphere (Xu et al. 2004) and for the development of empirical models (Bilitza 2018; Yue et al. 2006; Maruyama 2011). As the TEC and the maximum density of the F region derived from ionosonde observation (NmF2) are known to be correlated, NmF2 can be a proxy of TEC. In this study, about 60 years of data of ionospheric parameters derived from the longterm ionosonde observation are used. Although the data period is still shorter than 100 years, we investigate statistical characteristics of extreme TEC values in order to estimate the ionospheric onceper100year condition.
The TEC value over Japan depends on the latitude, normally with a larger value in southern Japan. Japan is mainly located in the lower midlatitude region with a latitudinal range of about 20°. The southern part of Japan is located at the poleward slope of the equatorial ionospheric anomaly (EIA) crest. On the other hand, the northern part is hardly affected by EIA variation and may rather be affected by phenomena originating from the polar region (Cherniak et al. 2015). Therefore, extreme TEC values should also differ among the center, southern, and northern parts of Japan.
Details of the data set used in this study and the analysis method are described in "Data set" and "Methods", respectively. In "Results", the result obtained using about 20 years of TEC data collected in Tokyo, which is almost in the center of Japan, is shown as the first step. Then longterm ionosonde data are analyzed. On the basis of the result, extreme TEC values with probabilities of once per year, 10 years, and 100 years are estimated for Tokyo. In the last part of the section, the extreme TEC values in southern and northern Japan are also estimated. In "Discussion", the results are discussed in comparison with those of case studies of geomagnetic storms in previous papers. The last section provides the summary of this study.
Data set
In this study, we use TEC data derived from the nationwide GNSS network over Japan, which is called the GNSS Earth Observation Network System (GEONET) and operated by the Geospatial Information Authority of Japan, and ionosonde observation data collected over Tokyo.
GNSSTEC data derived from GEONET have been archived by NICT since 1997. Using the network data, the slant TEC along the line of sight between the receiver and the satellite was derived from pseudorange and carrierphase measurements by dualfrequency GPS receivers (Saito et al. 1998). The instrumental bias of the TEC associated with the interfrequency bias of the satellite and receiver was obtained by a technique proposed by Otsuka et al. (2002), in which the daily bias values are derived by assuming that hourly averaged TEC values are uniform within the field of view of a given GNSS receiver. The slant TEC is converted to the vertical TEC after removing the instrumental bias. The TEC data from small satellite elevation angles, which is smaller than 35° is neglected to reduce cycle slips and errors due to conversion from slant to vertical TEC. The median value of the vertical TEC whose ionospheric pierce point is located within 100 km from a given location over 1 h is derived as an hourly TEC. The largest hourly TEC in a given day is noted as the daily TEC in this paper. The daily TECs of 22 years from 1997 to 2018 are used in this study and studied in Sect. 4.1.
Ionospheric conditions have been monitored for about 70 years by NICT using ionosondes in Kokubunji, Tokyo (36.7°N, 139.5°E, 26.8°N in Mag.Lat) and other stations. Ionospheric parameters have been manually scaled from ionograms. In order to ensure uniform quality of data, the scalers have discussed and established scaling rules, although automatic scaling tools have been developed in recent years. Thanks to the substantial efforts of the scalers, ionospheric parameters from the 1950s to the present are now available. In this study, the manually scaled critical frequency of the Flayer (foF2), which corresponds to the peak density of the Flayer, is used. In order to study foF2 with the daily TEC, we refer to the maximum foF2 in a given day as the daily foF2. In Sect. 4.2, a 22year data set of daily foF2 values from 1997 to 2018 is used. In the same section, a 62year data set of daily foF2 values from 1957 to 2018 is also used.
Methods
In order to find extreme values of TEC corresponding to an occurrence frequency of once every certain number of years, the cumulative distribution function (CDF) of daily TEC occurrence is investigated (Riley 2012; Kataoka 2020). The CDF of the daily TEC occurrence is a distribution function of daily TEC values that are greater than or equal to a critical TEC. One of the advantages of investigating the CDF instead of a simple occurrence probability is that it is easy to find TEC values with an occurrence frequency of once per long period (Riley 2012). In other words, the CDF of the daily TEC occurrence provides an occurrence probability of a daily TEC that is greater than or equal to a certain value, while a normal distribution provides the occurrence probability of a daily TEC between two values.
Although a data set of TEC values over 22 years may be sufficient to investigate TEC values with occurrence frequency of once per year and 10 years, it would not be sufficient to investigate the TEC value with an occurrence frequency of once per 100 years.
To compensate the insufficient number of TEC data, we utilized a 62year data set of foF2 values in order to calculate NmF2 and study a property of the relationship between TEC and NmF2. The relationship between TEC and foF2 is given by the following equation:
where S is the slab thickness. In this study, characteristics of slab thickness are studied using the 22year data set of TEC and foF2 values. By utilizing the characteristics of the slab thickness and the 62 years of foF2 data, we deduce CDFs of TEC values over 62 years, from which we estimate the TEC value corresponding to occurrence frequency of once per 100 years.
Even if the 62year data are utilized to estimate the TEC values with occurrence frequency of once per hundred years, the amount of the data is still not enough. The occurrence rate of a single event in 62year data set is 1/((365.25 × 62)) = 0.0044%. This occurrence rate is larger than that of oncein100year event, 1/((365.25 × 100)) = 0.003%. In order to compensate the insufficient number data set, the distribution was extrapolated in two ways in order to deduce CDFs of TEC values over 62 years in this study. In the former method, which we call Method I, the following four steps are taken to derive the CDF using the 62year data set of NmF2. For the first step, probability function of slab thickness, \({P}_{\mathrm{s}}\), is presumed with the 22year slab thickness data set. The presumed \({P}_{\mathrm{s}}\) is used to calculate a probability function of TEC for a given ith day, \({P}_{\mathrm{T}}^{i}\), with NmF2 observed on the day, \({\mathrm{NmF}2}^{i}\). In the third step, \({P}_{\mathrm{T}}^{i}\) is converted to \({\mathrm{CDF}}^{i}\), which is a CDF of TEC for ith day. Finally, \({\mathrm{CDF}}^{i}\) is derived with all NmF2 values in 62 years and integrated to deduce CDF of TEC values over 62 years.
Here, in the step one, we assume that slab thickness follows a normal distribution, e.g., \(S\sim \mathcal{N}({\mu }_{\mathrm{S}},{\sigma }_{\mathrm{S}}^{2})\) where \({\mu }_{\mathrm{s}}\) and \({\sigma }_{\mathrm{S}}\) are mean and standard deviation of slab thickness based on 22 years. The probability function of P_{s} for slab thickness of s [km] is described as follows:
One of the problems in estimating extreme TEC value of oncein100years is that the number of TEC data, or slab thickness data is insufficient compare to a 100 years. Therefore, the normal distribution, \(\mathcal{N}({\mu }_{\mathrm{S}},{\sigma }_{\mathrm{S}}^{2})\), cannot reproduce extreme slab thickness. In order to compensate the lack of extreme values with \(\mathcal{N}({\mu }_{\mathrm{S}},{\sigma }_{\mathrm{S}}^{2})\), we introduce an inflated sigma, which is described as \(\widehat{{\sigma }_{\mathrm{s}}}\), to model the slab thickness. Inflation factor, \(\frac{\widehat{{\sigma }_{\mathrm{s}}}}{{\sigma }_{\mathrm{s}}}\), is determined by comparing TEC values of oncein10years deduced with various inflation factors with that based on 22year TEC data set.
As the step 2, a probability function of TEC for ith day, \({P}_{\mathrm{T}}^{i}\) is calculated on the assumption that NmF2 and slab thickness are independent parameters. The \({\mathrm{TEC}}^{i}\) follows a normal distribution with mean and standard deviation of \({\mathrm{NmF}2}_{i}\times {\mu }_{\mathrm{S}}\) and \({\mathrm{NmF}2}_{i}\times {\sigma }_{\mathrm{S}}\), respectively. That is, \({\mathrm{TEC}}^{i}\sim \mathcal{N}({\mu }_{\mathrm{T}}, {\sigma }_{\mathrm{T}}^{2})\) where \({\mu }_{\mathrm{T}}={\mathrm{NmF}2}_{i}\times {\mu }_{\mathrm{S}}\) and \({\sigma }_{\mathrm{T}}={\mathrm{NmF}2}_{i}\times {\sigma }_{\mathrm{S}}\). The distribution of \({\mathrm{TEC}}^{i}\) for TEC of t [TECU] is expressed as the following equation:
Since \({\mathrm{TEC}}^{i}\) follows normal distribution, CDF of \({\mathrm{TEC}}^{i}\), \({\mathrm{CDF}}^{i}\), is given using error function, erf,
In the final step, CDF^{i} is calculated for each day in the 62 years and added to obtain \(\mathrm{CDF},\) that is,
where N is the total number of the day in 62 years.
In the latter method, which we call Method II, CDF_{TEC} of extreme case was deduced by multiplying the extreme slab thickness, which could occur once in 10 and 100 years, by the 62year data set of daily foF2. By assuming that the slab thickness has a normal distribution with a mean \(\mu\) and a standard deviation \(\sigma\), the value corresponding to occurrence of once per 10 and 100 years, or 0.03% and 0.003%, are \(\mu +3\sigma\) and \(\mu +4.2\sigma\), respectively. CDF_{TEC} for the 62 years can be deduced by multiplying the CDF of NmF2 for the 62 years by the extreme values of slab thickness.
Since the slab thickness is known to have seasonal dependence, a single value of the slab thickness is not appropriate for estimating TEC from foF2. In order to estimate P_{ST} in Method I, data set of slab thickness is divided into four seasons, that is, from February to April, from May to July, from August to October, from November to January. Four seasonal P_{ST} are used to estimated CDF_{TEC} in Eqs. (3), (4) and (5). Threemonth data are used to derive P_{ST} in Method I to obtain sufficient number of data for the inflation. On the other hand, monthly data is used to calculate the mean μ and the standard deviation σ in Method II.
Results
Statistical analysis of TEC over 22 years
Figure 1 shows the CDF of the daily TEC occurrence at Tokyo. The occurrence rate is shown on the left axis. The occurrence rate on the lefthand axis of the ordinate is days per 100 years, which is obtained by dividing the occurrence days by the total number of days in 22 years and then multiplying those in 100 years. Therefore, an occurrence rate of one day means an occurrence rate of once per 100 years. The occurrence rate is converted to the occurrence percentage and shown on the righthand axis of the ordinate. An occurrence probability of 0.3%, which corresponds to a frequency of once per year, is shown as a solid horizontal line. It is found that the daily TEC can reach about 90 TECU with a frequency of once per year. The occurrence probabilities of once per 10 years and once per 100 years correspond to 0.03% and 0.003% and are shown with dotted and dashed horizontal lines, respectively. It is found that a daily TEC of more than 100 TECU occurs with a frequency of once per 10 years. The TEC values with frequencies of once per year and once per 10 years are summarized in Table 1.
On the other hand, the daily onceper100year TEC value cannot be appropriately estimated from Fig. 1 because the distribution is based on only 22 years of data.
The colors in the histograms in Fig. 1 represent the classifications based on solar and geomagnetic activity: red, pink, blue, and light blue represent days of high solar activity and high geomagnetic activity (HSHG), high solar activity and low geomagnetic activity (HSLG), low solar activity and high geomagnetic activity (LSHG), and low solar activity and low geomagnetic activity (LSLG), respectively. Solar and geomagnetic activities are, respectively, defined on the basis of the solar sunspot number (SSN) and disturbance stormtime (DST) index, which are provided as sunspot data from the World Data Center SILSO, Royal Observatory of Belgium, Brussels (http://sidc.be/silso/datafiles) and WDC for Geomagnetism, Kyoto (http://wdc.kugi.kyotou.ac.jp/dstdir/index.html), respectively. HS (LS) days are defined as days for which the average daily SSN for the previous 27 days is ≥ (<) 50. HG (LG) days are defined as days for which the average daily DST of the current day and the previous day is ≤ (>) − 50 nT. It can be seen that a TEC of 60 TECU or larger is most likely to be observed when either the solar activity or the geomagnetic activity is high, while those exceeding 100 TECU are observed only when the solar activity is high.
Statistical analysis of foF2 over 22 and 62 years
Here, CDFs of the daily foF2 occurrence are studied in order to estimate onceper100year values. First, a CDF of the daily foF2 occurrence over the same period as in Fig. 1, from 1997 to 2018, were examined in comparison with that of the 22 years of TEC data in Fig. 1. Figure 2 shows a CDF of the daily foF2 occurrence, that is, the distribution of the daily foF2 that is greater than or equal to some critical foF2. As in Fig. 1, the occurrence rate per 100 years is shown on the lefthand axis of the ordinate and the occurrence rate in percentage is shown on the right axis. The occurrence frequencies of once per year, 10 years, and 100 years of 0.3%, 0.03%, and 0.003% are shown as solid, dotted, and dashed horizontal lines, respectively. The colors in Fig. 2 represent solar and geomagnetic activities similarly to in Fig. 1; red, pink, blue, and light blue represent days of HSHG, HSLG, LSHG, and LSLG, respectively. The largest foF2 was about 17.5 MHz. It is found that foF2 was higher than 15 MHz for only HSHG and HSLG days, which is similar to the result in Fig. 1.
The same analysis is carried out for the 62year foF2 data set from 1957 to 2018. The result is shown in Fig. 3 in the same format as Fig. 2. The maximum observed foF2 is about 18.7 MHz, which is slightly larger than that obtained from the 22year data set in Fig. 2. The maximum foF2 18.7 MHz was observed during geomagnetic storm in November 1960 when DST index reached − 333 nT (Cliver and Svalgaard 2004). Moreover, the occurrence rate of daily foF2 values larger than 16.8 MHz in Fig. 3, which corresponds to the rightmost bar in the histogram, is about twice of that in Fig. 2.
Estimation of extreme TEC from slab thickness using Method I
As the characteristics of the CDFs of the daily foF2 occurrence are different for the 22 and 62year data sets, the onceper100year TEC value cannot be estimated by extrapolating the CDF of the daily TEC occurrence obtained from the 22year data set. In this subsection, we estimate the onceper100year TEC value by using the 62year foF2 data set with Method I.
The value of foF2 is proportional to the square root of the maximum ionospheric density, NmF2. NmF2 is given by the following equation.
Figure 4 shows the correlation between daily TEC and NmF2 derived from the daily foF2. All data collected over 22 years are shown in this scatter plot. It can be seen that TEC and NmF2 have a strong correlation. The red line is the leastsquares linear approximation of all data. As shown in Eq. (1), the slope, which is about 250 km, is equivalent to the thickness of the ionosphere that gives a TEC value with a density of NmF2. This parameter, which is called the ionospheric slab thickness, is used to deduce TEC from NmF2 because of the strong correlation between daily TEC and daily foF2.
In order to derive CDFs of TEC values over 62 years with Method I, distribution of slab thickness is examined. Figure 5 shows distribution of slab thickness from 1997 to 2018. Mean and standard deviation of the distribution is 215 km and 52 km, respectively. The red curve represents the normal distribution with the mean and the standard deviation. The distribution in 3 months from May to July is shown in Fig. 6. The mean and standard deviation of the distribution is 273 km and 45 km. The mean is larger than that in Fig. 5, which is one of the seasonal effects. The red curve represents a normal distribution with the mean and the standard deviation. The curve roughly fits the slab thicknesses but does not cover large values such as more than 400 km. Mean values and standard deviations of other seasons, that is, from February to April, from August to October, and November to January, are listed in Table 2. Normal distributions with the mean and the standard deviations for each season listed in Table 2 are applied for P_{ST} in Method I. The result of CDF_{TEC} is shown with black histograms in Fig. 7. TEC of once per 10 and 100 years, that is, TEC of 0.03% and 0.003% was 35 TECU and 45 TECU, respectively, which are smaller than those can be read in Fig. 1. This is because of the assumption of the normal distribution, which cannot cover the large slab thickness. In order to cover them, normal distributions are inflated using an inflation factor. The blue curves in Fig. 6 show the inflated normal distribution with inflation factors. The dashed and solid lines are derived with inflation factors of 2.0 and 3.8, respectively. The inflated normal distribution with an inflation factor of 3.8 overbounds the large slab thickness around 480 km while that of 2.0 is too small to cover the large slab thicknesses. In order to optimize the inflation factor, onceper10year TEC value is calculated using various inflation factors to obtain CDF_{TEC}. Figure 8 shows the once per 10year TEC value as a function of the inflation factor. It increases as the inflation factor increases and exceeds 110 TECU, which is the onceper10year TEC value based on the 22year TEC data set, when the inflation factor changes from 3.7 to 3.8. In this paper, therefore, the inflation factor of 3.8 is adopted based on the 22year TEC data set. Using the inflated normal distribution with the inflation factor of 3.8, CDF of TEC are derived as blue histogram in Fig. 7. TEC of once per 10 and 100 years, that is, TEC of 0.03% and 0.003% was 110 TECU and 150 TECU, respectively.
Estimation of extreme TEC from slab thickness using Method II
In this subsection, we estimate the onceper100year TEC value by using the 62year foF2 data set with Method II. Here, we calculated the mean and the standard deviation of slab thickness for each month. Figure 9 shows the slab thickness against the day of the year for 22 years from 1997 to 2018. Data are sparser from June to August compared with other months, because foF2 values of 10 cannot be obtained owing to masking by the sporadic Elayer, which often appears in these months. The red polyline is the monthly mean of the slab thickness. The monthly mean slab thickness is about 180 km in winter and 280 km in summer. Blue and red vertical lines indicate the ranges of ± 3σ and ± 4.2σ. These ranges are equivalent to probabilities of once per 10 and 100 years, respectively, when the estimated slab thickness is assumed to have a normal distribution, that is, occurrence probability of the values larger than average + 3σ and + 4.2σ are 0.13% and 0.001%
Here, we estimate the daily TEC from the daily NmF2 data, assuming the slab thickness has only seasonal dependence. Figure 10 shows the CDFs of the estimated daily TEC occurrence obtained using the monthly mean slab thickness and observed NmF2 from 1957 to 2018. The black histograms are distributions of the daily TEC estimated with the monthly mean slab thickness, which is shown with a red polyline in Fig. 9. The number of days per 100 years and the occurrence rate are shown on the left and righthand axes of the ordinate, respectively. The black solid, dotted, and dashed horizontal lines correspond to 0.3% (once a year), 0.03% (once every 10 years), and 0.003% (once every 100 years), respectively. The blue histograms in Fig. 10 are the distribution of TEC estimated with the average + 3σ slab thickness (upper value of the blue vertical line in Fig. 9), which corresponds to a slab thickness with a frequency of once per 10 years. According to this histogram, the TEC with a frequency of once per 10 years is 130 TECU or more. Furthermore, the red histograms in Fig. 10 are derived from the average + 4.2σ slab thickness (upper limit of the red vertical line in Fig. 3). This result indicates that TEC values of more than 190 TECU can be observed with a frequency of once per 100 years. These TEC values are summarized in Table 1.
Latitudinal dependence of extreme TEC
Figures 1, 2, 3, 4, 5, 6, 7, 8 and 9 are results based on data obtained in Tokyo. Here we estimate extreme TEC values for southern and northern Japan because TEC behavior is expected to be different at different magnetic latitudes. Figure 11 shows the correlations of daily TEC between Tokyo and Kagoshima (31.2°N, 130.6°E, 21.7°N in Mag. Lat) and between Tokyo and Hokkaido (45.2°N, 141.8°E 36.4°N in Mag. Lat) for 22 years from 1997 to 2018. Basically, the TEC in Tokyo is smaller than that in Kagoshima and larger than that in Hokkaido. The red line represents the linear approximation of these data and reveals that the TECs in Kagoshima and Hokkaido are, on average, 1.2 and 0.8 times that in Tokyo, respectively. From these results, the TEC values with probabilities of once per year, 10 years, and 100 years are estimated as 110, 130–155, and 180–230 TECU (70, 90–105, and 120–150 TECU), respectively, in Kagoshima (Hokkaido) as round to the nearest multiple of five. The numbers are summarized in the second and third rows in Table 1.
Discussion
It is important to estimate the occurrence rates of extreme values of TEC in Japan in the short, mid, and long term, which are once per year, 10 years, and 100 years, respectively, in readiness for hazardous ionospheric conditions. “Space Weather Phase 1 Benchmarks”, which was published by the USA White House in June 2018, lists three factors that cause ionospheric disturbances: solar flares, proton events, and geomagnetic storms. However, quantitative benchmarks are difficult to derive because the effects of geomagnetic storms largely differ from event to event. Furthermore, the mechanism of ionospheric storms is not yet completely understood. Although the results in this paper are limited to the region around Japan, they are a starting point for evaluating benchmarks in other regions.
One of the challenges is to estimate extreme TEC value such as once per a 100 year with a limited data set. In this study, we have 22year TEC data set and 62year foF2 data set. Method I assumes the probability distribution of slab thickness as a normal distribution. First, raw \(\sigma\) is used to model the slab thickness with the 22year data set. The resulting CDF which is shown with black histograms is Fig. 7 underestimates the observed CDFs in Fig. 1. The TEC values of onceperyear, for example, were about 90 TECU in Fig. 1 while that of black histograms in Fig. 7 was < 30 TECU. One of the reasons that the values underestimate extreme TEC values is that comes that the normal distribution cannot reproduce large value of slab thickness such as over 400 km. In order to cover the large slab thickness, the slab thickness distribution was approximated by inflated normal distributions. The inflation factor is a key parameter which affects the extreme TEC values. The solid and dashed lines in Fig. 8 show TEC values which would occur once per 10 and 100 years, respectively, as a function of the inflation factor. If the inflation factor is chosen as 5, the onceper10year TEC value is more than 150 TECU, which is comparable to the onceper100year TEC value for the inflation factor of 3.8. Inflation factor largely affects the extreme TEC value in Method I while this study adopts the inflation factor of 3.8 based on 22year TEC data set.
In Fig. 6, the inflated normal distribution with an inflation factor of 3.8 overbounds the large slab thickness around 480 km while that of 2.0 does not. A discussion should be done for the assumption of normal distribution for the slab thickness. As shown in Figs. 5 and 6, the distribution of slab thickness has long tail, the tail cannot be reproduced by normal distributions even if the \(\sigma\) is inflated. Alternative approach would be to model the distribution in a different way. The distribution in Figs. 5 and 6 could be fitted by a sum of two normal functions which centers the core part and the tail parts, socalled double Gaussian, instead of multiplying an inflation factor to the standard deviation, which is left for future studies.
Comparing Method I and Method II, Method II is more conservative than Method I because Method II takes out the extreme slab thickness multiplies it with TEC values. Method I has an advantage in order to grasp the overall distribution while extreme large values are not reproduced, which may depends on how to determine the inflation factor. Method II has an advantage in estimating extreme values while overall distribution is not very accurate.
In this study, we estimated extreme TEC values by assuming that the slab thickness has only seasonal dependence. The seasonal dependence of the slab thickness shown in Fig. 9 is consistent with the results of previous studies (Jin et al. 2007; Huang et al. 2016). Another factor determining the slab thickness is the dynamics and/or composition change caused by geomagnetic disturbances. According to Stankov and Warnant (2009), the slab thickness is systemically enhanced during geomagnetic disturbances for both positive and negative ionospheric storms. Extreme values of TEC estimated by blue or red histograms in Fig. 10 would be recorded during geomagnetic storm conditions.
Extreme positive storms are thought to be caused by a geomagnetic disturbance that induces prompt penetration of the electric field (Tsurutani et al. 2004). The largest reported TEC is about 330 TECU to our knowledge, which was recorded by a GPS receiver onboard the CHAMP satellite at an altitude of about 400 km during the October 2003 Halloween storm (Mannucci et al. 2005). Magnetic latitude where the 330 TECU was observed was about 25°S. Although the observation was in the south hemisphere, the magnetic latitude is similar to that of Tokyo (26.8°N). The TEC value of 330 TECU reported in Mannucci et al. (2005) is much higher than our result of 190 TECU, which is conservatively estimated in Method II.
Before discussing possible reasons for the discrepancy between our result and that reported in Mannucci (2005), we have to discuss estimation accuracy of the instrumental bias to derive absolute value of TEC. In estimating instrumental bias, we assume that the hourly average of vertical TEC is uniform within an area covered by a receiver; this area approximately corresponds to a surrounding of 1000 km (Otsuka et al. 2002). It is reported that the technique can derive absolute values of TEC with the accuracy of ∼3 TECU in the daytime and ∼1 TECU in the nighttime, respectively, during quiet and moderated disturbed day. It is also reported the characteristics of temporal and spatial distribution of absolute TEC are consistent with the previous studies during a geomagnetic storm day. Nonetheless, during the geomagnetic disturbed condition, TEC tends to have spatial gradient and largescale traveling ionospheric disturbances (LSTIDs) could appear. The horizontal scale of LSTIDs is more than 2000 km, which is larger than the assumption of TEC uniformity. Therefore, there is a possibility that the assumption of the TEC uniformity tends to be invalid during severe geomagnetic storm days. Zhang et al. (2009) investigated influences of geomagnetic storms on the estimation of GPS instrumental biases. The bias errors are in order of a few TECU while the errors are different among geomagnetic storms and its duration. Since the order of the errors in estimating instrumental bias is < 10 TEC, we speculate that the error would not reverse the difference between our result (190 TECU) and that in Manucci et al. (330 TECU) while further quantitative investigation would be necessary in order to clarify the estimation errors.
Here we discuss possible reasons for the difference between these values. One possibility is differences in observation opportunities. The characteristics of ionospheric storms are not always similar among geomagnetic storms, with their magnitude varying greatly from event to event. Mannucci et al. (2008) analyzed four intense geomagnetic storms in 2003 including the event for which the extreme value of 330 TECU was observed by the CHAMP satellite. A dramatic increase in TEC was observed in only one event. The observed TEC on the other three storm days was around 100 TECU or less. If the eventtoevent difference is too large, 70 years of data might not be enough to estimate TEC values for onceper100year or onceper1000year events.
Another possibility accounting for the difference between the extreme value of 330 TECU in Mannucci et al. (2003) and our result is the longitude dependence of the ionospheric influence on geomagnetic storms. Immel and Mannucci (2013) analyzed global TEC maps during geomagnetic storms over 7 years. Their analysis confirmed that on average the American sector exhibits larger TEC enhancements regardless of the onset UT. Greer et al. (2017) used the Global Ionosphere–Thermosphere Model to carry out an experiment on a geomagnetic storm by modifying the storm arrival UT. The result indicated that the strongest enhancements of TEC during storms are found in the American and Pacific longitude sectors. They suggested that the longitudinal dependences were due to Earth’s asymmetrical geomagnetic topology in the American and Pacific sectors. The difference between our results and that of Mannucci et al. (2003) may originate from the difference between the Japanese and American/Pacific sectors. In order to clarify whether the longitudinal dependence results in the large difference between the results of this study and that of Mannucci et al. (2008), longterm observational data in addition to data over oceans are necessary.
This study focuses on positive ionospheric storms, which may significantly affect GNSS users. On the other hand, the effect of negative storms on space weather users may also be significant, particularly for HF communicators, who may experience blackouts during negative ionospheric storms. In addition, parameters other than TEC, such as maximum usable frequency (MUF) and scintillation indices, should be studied for extreme cases.
Summary
In this study, extreme values of TEC with frequencies of once per year, 10 years, and 100 years were investigated. The results are summarized as follows:
The CDF of daily TEC values was studied for a 22year data set observed in Tokyo in order to estimate TECs with frequencies of once per year and 10 years. The obtained onceperyear and onceper10year TECs were 90 and 110 TECU, respectively.

In order to estimate the onceper100year TEC value, 62 years of manually scaled ionosonde data were used to augment the insufficient observation period of TEC. The slab thickness was assumed to have only seasonal variation and was used to estimate TEC from 62 years of foF2 data. In this study, two methods were tested in order to compensate the insufficient number of data.

In Method I, the slab thickness distribution is modeled with artificially inflated normal distributions. The inflation factor was determined by calibrating the oncein10year TEC value deduced with various inflation factors with that based on 22year TEC data set. The onceper10year TEC was result as 150 TECU.

In Method II, extreme slab thickness is applied to deduce the extreme TEC values. Slab thickness of the average + 3σ and + 4.2σ, which correspond to onceper10years and onceper100years, respectively, to deduce the extreme values of TEC. The result was 190 TECU. In Method II, onceper10year TEC is also derived and was 130 TECU.

Extreme TEC values were also studied for Kagoshima and Hokkaido in southern and northern Japan, respectively. In Kagoshima, those which occur once per one, 10, and a 100 years are 110 TECU, 130–155 TECU, and 180–230 TECU, respectively. In Hokkaido, they are 70 TECU, 90–105 TECU, and 120–150 TECU, respectively.
Availability of data and materials
The TEC data used in this study are archived on NICT’s homepage (https://aerncweb.nict.go.jp/GPS/GEONET/). Manually scaled ionosonde parameters are also archived on NICT’s homepage (http://wdc.nict.go.jp/IONO/HP2009/ISDJ/manual_txt.html).
Abbreviations
 EIA:

Equatorial ionospheric anomaly
 EUV:

Solar extreme ultraviolet (EUV)
 foF2:

Critical frequency of the Flayer
 GEONET:

GNSS Earth Observation Network System
 GNSS:

Global Navigation Satellite System
 HF:

High frequency
 HSHG:

High solar and high geomagnetic activity
 HSLG:

High solar and low geomagnetic activity
 LSHG:

Low solar and high geomagnetic activity
 LSLG:

Low solar and low geomagnetic activity
 MUF:

Maximum usable frequency
 NICT:

National Institute of Information and Communications Technology
 NmF2:

Maximum density of the F2 layer
 TEC:

Total electron content
References
Bauer SJ, Daniels FB (1959) Measurements of Ionospheric Electron Content by Lunar Radio Technique. J Geophys Res 64(10):1371–1376
Bilitza D (2018) IRI the International Standard for the Ionosphere. Adv Radio Sci 16:1–11. https://doi.org/10.5194/ars1612018
Cherniak I, Zakharenkova I, Redmon RJ (2015) Dynamics of the highlatitude ionospheric irregularities during the 17 March 2015 St. Patrick’s Day storm: groundbased GPS measurements. Space Weather 13:585–597. https://doi.org/10.1002/2015SW001237
Evans JV (1977) Satellite beacon contributions to studies of the structure of the ionosphere. Reviews of Geophysics 15(3):325
Foster JC, Rideout W, Sandel B, Forrester WT, Rich FJ (2007) On the relationship of SAPS to stormenhanced density. J Atmos Sol Terr Phys 69:303–313
Cliver EW, Svalgaard L (2004) The 1859 solarterrestrial disturbances and the current limits of extreme space weather activity. Sol Phys 224:407–422
Gladden, Sanford C (1959) A history of verticalincidence ionosphere sounding at the national bureau of standards, United states department of commerce office of technical services
Greer KR, Immel T, Ridley A (2017) On the variation in the ionospheric response to geomagnetic storms with time of onset. J Geophys Res Space Phys 122:4512–4525. https://doi.org/10.1002/2016JA02345
Hochegger G, Nava B, Radicella SM, Leitinger R (2000) A family of ionospheric models for different uses. Phys Chem Earth Part C Solar Terr Planet Sci 25(4):307–310
Huang H, Liu L, Chen Y, Le H, Wan W (2016) A global picture of ionospheric slab thickness derived from GIM TEC and COSMIC radio occultation observations. J Geophys Res Space Phys 121:867–880. https://doi.org/10.1002/2015JA021964
Immel TJ, Mannucci AJ (2013) Ionospheric redistribution during geomagnetic storms. J Geophys Res Space Phys 118:7928–7939. https://doi.org/10.1002/2013JA018919
Jin S, Cho JH, Park JU (2007) Ionospheric slab thickness and its seasonal variations observed by GPS. J Atmos Sol Terr Phys 69(15):1864–1870. https://doi.org/10.1016/j.jastp.2007.07.008
Kataoka, R. (2020) Extreme geomagnetic activities: a statistical study. Earth Planets Space 72:124. https://doi.org/10.1186/s40623020012618
Klobuchar JA (1987) Ionospheric timedelay algorithm for singlefrequency GPS users. IEEE Trans Aerosp Electron Syst AES23(3):325–331
Mannucci AJ, Tsurutani BT, Iijima BA, Komjathy A, Saito A, Gonzalez WD, Guarnieri FL, Kozyra JU, Skoug R (2005) Dayside global ionospheric response to the major interplanetary events of October 29. 30, 2003 Halloween Storm. Geophys Res Lett 32:L12S02. https://doi.org/10.1029/2004GL021467
Mannucci AJ, Tsurutani BT, Abdu MA, Gonzalez WD, Komjathy A, Echer E, Iijima BA, Crowley G, Anderson D (2008) Superposed epoch analysis of the dayside ionospheric response to four intense geomagnetic storms. J. Geophys. Res. 113:A00A02. https://doi.org/10.1029/2007JA012732
Maruyama T (2011) Modified solar flux index for upper atmospheric applications. J Geophys Res 116:A08303. https://doi.org/10.1029/2010JA016322
Maruyama T, Ma G, Tsugawa T (2013) Storminduced plasma stream in the lowlatitude to midlatitude ionosphere. J Geophys Res Space Phys 118:5931–5941. https://doi.org/10.1002/jgra.50541
Nishioka M, Saito A, Tsugawa T (2009) Supermediumscale traveling ionospheric disturbance observed at midlatitude during the geomagnetic storm on 10 November 2004. J Geophys Res 114:A07310. https://doi.org/10.1029/2008JA013581
Otsuka Y, Ogawa T, Saito A, Tsugawa T, Fukao S, Miyazaki S (2002) A new technique for mapping of total electron content using GPS network in Japan. Earth Planets Space 54:63–70. https://doi.org/10.1016/S02731177(00)001381
Radicella SM, Leitinger R (2001) The evolution of the DGR approach to model electron density profiles. Adv Space Res 27(1):35–40
Riley P (2012) On the probability of occurrence of extreme space weather events. Space Weather 10:S02012. https://doi.org/10.1029/2011SW000734
Saito A, Fukao S, Miyazaki S (1998) High resolution mapping of TEC perturbations with the GSI GPS network over Japan. Geophys Res Lett 25:3079–3082. https://doi.org/10.1029/98GL52361
Stankov SM, Warnant R (2009) Ionospheric slab thickness. Analysis, modelling and monitoring. Adv Space Res 44:1295–1303
Tao C, Nishioka M, Tsugawa T, Saito S, Shiota D, Watanabe K, Ishii M (2020) Statistical analysis of shortwave fadeout for extreme event estimation. Earth Planets Space. https://doi.org/10.1186/s4062302001278z
Tsubouchi K, Omura Y (2007) Longterm occurrence probabilities of intense geomagnetic storm events. Space Weather 5:S12003. https://doi.org/10.1029/2007SW000329
Tsurutani BT et al (2004) Global dayside ionospheric uplift and enhancement associated with interplanetary electric fields. J Geophys Res 109:A08302. https://doi.org/10.1029/2003JA010342
US White House (2018) Space Weather Phase 1 Benchmarks. Space Weather Operations, Research, and Mitigation Subcommittee Committee on Homeland and National Security, National Science & Technology Council. https://www.sworm.gov/publications/2018/SpaceWeatherPhase1BenchmarksReport.pdf
Xu ZW, Wu J, Igarashi K, Kato H, Wu ZS (2004) Longterm ionospheric trends based on groundbased ionosonde observations at Kokubunji. Japan J Geophys Res 109:A09307. https://doi.org/10.1029/2004JA010572
Yue X, Wan W, Liu L, Ning B, Zhao B (2006) Applying artificial neural network to derive longterm foF2 trends in the Asia/Pacific sector from ionosonde observations. J Geophys Res 111:A10303. https://doi.org/10.1029/2005JA01157
Zhang W, Zhang DH, Xiao Z (2009) The influence of geomagnetic storms on the estimation of GPS instrumental biases. Ann Geophys 27:1613–1623. https://doi.org/10.5194/angeo2716132009
Acknowledgements
GPS data of GEONET were provided by the Geospatial Information Authority of Japan. MN thanks to ionograms scalers of NICT and forerunner of NICT for valuable manually scaled data.
Funding
This work was supported by MEXT/JSPS KAKENHI Grant 15H05813.
Author information
Affiliations
Contributions
MN conducted the research and has responsibility for the results presented in this paper. SS has supported this analysis and contributed to the discussion. CT, DS, TT, and MI contributed to the discussion as experts of ionosphere and space weather. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Nishioka, M., Saito, S., Tao, C. et al. Statistical analysis of ionospheric total electron content (TEC): longterm estimation of extreme TEC in Japan. Earth Planets Space 73, 52 (2021). https://doi.org/10.1186/s40623021013748
Received:
Accepted:
Published:
Keywords
 Total electron content (TEC)
 Extreme TEC
 Longterm ionosonde observation
 Manually scaled foF2
 Slab thickness