Skip to main content
  • Frontier Letter
  • Open access
  • Published:

PSTEP: project for solar–terrestrial environment prediction

Abstract

Although solar activity may significantly impact the global environment and socioeconomic systems, the mechanisms for solar eruptions and the subsequent processes have not yet been fully understood. Thus, modern society supported by advanced information systems is at risk from severe space weather disturbances. Project for solar–terrestrial environment prediction (PSTEP) was launched to improve this situation through synergy between basic science research and operational forecast. The PSTEP is a nationwide research collaboration in Japan and was conducted from April 2015 to March 2020, supported by a Grant-in-Aid for Scientific Research on Innovative Areas from the Ministry of Education, Culture, Sports, Science and Technology of Japan. By this project, we sought to answer the fundamental questions concerning the solar–terrestrial environment and aimed to build a next-generation space weather forecast system to prepare for severe space weather disasters. The PSTEP consists of four research groups and proposal-based research units. It has made a significant progress in space weather research and operational forecasts, publishing over 500 refereed journal papers and organizing four international symposiums, various workshops and seminars, and summer school for graduate students at Rikubetsu in 2017. This paper is a summary report of the PSTEP and describes the major research achievements it produced.

Introduction

The solar–terrestrial environment, including the Sun, the Earth, and the interplanetary space, is the place of modern civilization’s activity. As a result of the progress of space exploration and the rapid growth of information society, our socioeconomic system supported by highly developed infrastructures, e.g., communication systems, electric power grid, aviation network, and artificial satellites, may become more vulnerable to space weather and space climate variabilities (see Fig. 1).

Fig. 1
figure 1

The illustration of solar–terrestrial environment. Solar flares and coronal mass ejections (CMEs) may impact our infrastructures through the disturbances in magnetosphere, ionosphere and thermosphere

Recent studies suggested that an extreme space weather event equivalent to the Carrington Event, which occurred on September 1, 1859, is likely to cause significant social impacts (National Research Council 2008). Furthermore, the cosmogenic isotope analysis recorded in tree rings and ice-core indicates the probability that the Sun may have caused massive explosions of more than ten times the Carrington Event (Miyake et al. 2012). Therefore, space weather disturbance is a potential risk to modern society.

Also, the mechanisms by which long-term solar activity variations affect the Earth's weather and climate are still unclear. Thus, a significant uncertainty remains in the assessment of solar impacts in climate change projections. These facts suggest that a planetary-scale environmental change caused by the Sun may be a dangerous phenomenon and there is an urgent need to establish a scientific basis for accurate prediction of space weather and space climate. However, we have not yet gained sufficient predictive capability of the solar–terrestrial environment. There are two possible major reasons that hamper the progress in our prediction, which are as follows:

First, there is a lack of full-fledged interdisciplinary research. Dynamics in the solar–terrestrial environment are complex phenomena studied in separate disciplines, and there has been an insufficient attempt to grasp the whole picture of the events.

Second, there is the gap between scientific research and operational forecasts. Government agencies in various countries are monitoring the solar–terrestrial environment and operating the prediction of changes in it. However, current space weather forecasting remains at the stage of relying on limited past experiences. We have not yet reached the stage of precise and robust predictions based on physics. This situation has been described as a “valley of death” between cutting-edge space science and space weather forecasting. While scientific research has not yet reached the level of application in operational forecasting, many scientists are not interested in the ad hoc prediction that relies only on heuristic methods. It has created a mutually negative perception between the scientific understanding and the forecasting efforts of the solar–terrestrial environmental dynamics.

Therefore, both scientifically and practically, it is an important and urgent issue to develop a synergy between scientific research and operational forecasts, collaborating among the various disciplines related to space weather and space climate. Project for Solar–Terrestrial Environment Prediction (PSTEP) was launched in 2015 to obtain the synergy between basic sciences and operational forecasts. The PSTEP is a nationwide research collaboration for 5 years supported by a Grant-in-Aid for Scientific Research on Innovative Areas from the Ministry of Education, Culture, Sports, Science and Technology of Japan. This project sought to answer some of the fundamental questions concerning the solar–terrestrial environmental and aimed to contribute to building a next-generation space weather forecast system to prepare for severe space weather disasters.

The goal of this project was to achieve the following two objectives:

  1. 1.

    By integrating the latest observations and simulations, we would build a new scheme to predict phenomena based on a physical model, and through a quantitative verification of the predictions, we would improve our scientific understanding and finally solve critical scientific problems such as the onset mechanism of solar flares, the mechanism of ionospheric and magnetospheric disturbances, and the variability of the solar cycle and their influences on meteorology and climate.

  2. 2.

    Through cross-disciplinary research, we would investigate the impact of the solar–terrestrial environment dynamics on the social systems and provide feedbacks from the quantitative validation of the forecast to improve our scientific understanding of the solar–terrestrial environment. To this end, we would build an interactive system that can allow us to make the best use of space weather forecasting as a social infrastructure. For instance, we would develop space weather benchmarks for severe space weather disasters based on state-of-the-art scientific research.

The PSTEP consisted of the following four research groups (A01–A04, Fig. 2): the goal of the Group for Space Weather Forecast System (A01) was to implement the physics-based model developed by the other groups A02–A04 and build the system to provide a forecast result to the society that needs them. Also, this group would make a space weather hazard map of Japan. Furthermore, this group would develop a next-generation space weather forecast model which can realize more precise predictions based on physics-based models in real-time.

Fig. 2
figure 2

PSTEP is organized by four research groups (A01–A04). With collaborations with international partners and socioeconomic activities

The goal of Solar Storm Group (A02) was to develop the prediction of solar flares and solar eruptions by combining the physics-based models and the data observed by the Hinode satellite and other space-borne and ground-based instruments. By elucidating the triggering mechanism, we would develop a more accurate scheme for predicting large solar flares. The fundamental goal was to create a methodology for probabilistic prediction within a few hours of the onset of a large flare. Furthermore, this group would develop an appropriate assimilation method of observations and numerical models to predict the impact of a coronal mass ejection (CME) before it arrives the Earth.

The goal of Space Dynamics Group (A03) was to improve the accuracy of the predictions of the following three phenomena in the Earth's magnetosphere and ionosphere: (1) thermospheric density and ionospheric electron density variations caused by solar flares several hours in advance and the probability of occurrence and arrival of ionospheric mesoscale disturbance phenomena such as plasma bubbles; (2) geomagnetically induced currents (GICs) in Japan, and (3) variation of cosmic radiation, in particular the variation of high-energy particles in the radiation belts in the Earth's magnetosphere.

The Group for Solar Cycle Activity and Impact on Climate (A04) aimed (1) to predict the activity of the next solar cycle (i.e., Cycle 25) and (2) to improve the understanding of the mechanisms of solar impact on climate. This group would also elucidate the mechanisms of long-term solar activity variability on a multihundred-year scale and incorporate solar effects and simulate long-term climate changes caused by solar activity variation using the Earth system model.

The PSTEP was conducted from April 2015 to March 2020 and produced many scientific results, including more than 500 refereed journal papers and many new models for predicting solar–terrestrial environmental processes (see Table 1). This paper is the summary report of the PSTEP research activity, and the rest of the paper is organized as follows: in Sects. 2, 3, 4 and 5, the main results of the PSTEP are, respectively, shown for each research group. In Sect. 6, finally, the contribution of the PSTEP to the understanding and prediction of space weather and space climate is summarized, and future issues are discussed.

Table 1 The models developed by PSTEP for solar–terrestrial environment prediction

Main results of A01 group: space weather forecast system

Our basic objective of A01 group was to establish a system to provide detailed space weather information to the public by interconnecting the physical models developed by groups A02–A04 with the space weather forecast information required by the public. We have developed different models for space weather prediction and also published space weather hazard maps of Japan as described in the following subsection. They would contribute to the establishment of a next-generation space weather forecast system that can provide precise predictions based on physical models in real-time.

Discussion of required space weather information with users

We established “Space Weather users committee” for discussing the needs–seeds matching in space weather services and picked up the requirements from the space weather information users and the scientific products derived from scientists. From the viewpoint of operational demands, users request long-term space weather prediction, for example, solar flare occurrence for about 27 days, GIC peak time for 2 days, and ionospheric disturbances for 30 h. They are beyond the predictive timescale in our current operational forecast. Users also wish to know more accurate information than the currently possible prediction.

The gaps exist not only between the needs and the seeds of space weather forecast, but also between researchers and operators of space weather forecast. To resolve the problems, we have developed the schemes in PSTEP. Some simulation and model codes were improved in the PSTEP, e.g., Ground-to-Topside Model of Atmosphere and Ionosphere for Aeronomy (GAIA) real-time operation, SUSANOO-IPS, and Deep Flare Net (DeFN), which are used now in space weather forecast services in the National Institute of Information and Communications Technology (NICT). The cooperation and deep inter-communication between scientists and operators are also important to fully use the model for forecasts. We have developed new schemes for it. For example, an index called “I-scale” (Tao et al. 2020) which can be provided by the real-time GAIA model operation to evaluate ionospheric storms at NICT, Japan is better used for monitoring and forecast using GNSS observation (Nishioka et al. 2017) rather than simply showing ionospheric model parameters, i.e., plasma density. Also, we conducted the training for operators to understand the scientific framework of the models, e.g., the heliospheric model aided by the interplanetary scintillation measurement, SUSANOO-IPS. It helped to achieve operational prediction using the model simulations.

Next-generation space weather forecast systems

Radio propagation simulator

We developed a radio propagation simulator named High Frequency Simulator Targeting for All Users' Regional Telecommunications (HF-START) (Hozumi et al. 2019) for estimating the influence of ionospheric disturbance in HF communication and broadcast and satellite positioning (Fig. 3). Because the ionosphere has a local characteristic, it is necessary to have a reconstructed local ionospheric data as a propagation medium in order to obtain a realistic radio propagation information. There are many radio propagation simulators available worldwide. However, most of them were developed based on statistical ionospheric data. The existing simulators, therefore, could not be well capable with a day-to-day variability and local perturbations of the ionosphere. One of the advantages of our system is to use real-time ionospheric condition obtained from global position system (GPS) network in Japanese area named “GEONET”. The GEONET was reconstructed by using 3D tomography technique in a real-time basis over Japan (Saito et al. 2017). Using a real-time 3D tomography makes it possible to realistically estimate the present condition of radio usability over Japan. In addition to the real-time observation data, we also employed GAIA (Jin et al. 2012; Tao et al. 2020) data as a propagation medium for a global user.

Fig. 3
figure 3

Example of HF-START output. Red line represents the radio propagation path, and the three-dimensional distribution of colors represents the ionospheric electron density

In parallel to the simulator development, we also assessed the risk of space weather on the HF radio propagation. Hozumi et al. (2019) pointed out that there might be a risk of a loss of aircraft en route communications due to the coexistence of sporadic E (Es) and medium-scale traveling ionospheric disturbances (MSTIDs). Japan is known to be a favorable location for both Es (Taguchi and Shibata 1961) and MSTIDs (Saito et al. 2007; Otsuka et al. 2007) to occur. There were limited quantitative reports on the simultaneous occurrence of the Es and MSTIDs. Bowman (1960, 1968) found 85% simultaneous occurrence rate of the Es and travelling ionospheric disturbances (TIDs) from the 13 case studies in nighttime. Otsuka et al. (2008) reported cross-correlation coefficients between MSTIDs and critical frequency of Es and between MSTIDs and blanketing frequency of Es in summer nighttime during 2001–2005 over Japan. The cross-correlation coefficients, which are in the ranges of 0.48–0.65, show a good agreement of the Es and MSTIDs occurrences. By the way, the record of in-flight missing communication link is out of reach or is not available publicly. Therefore, the authors suggested to consider the space weather effect as one of the potential causes of the de facto missing of in-flight communication link especially in summer nighttime. Without the space weather knowledge, aeronautical users might regard such a missing communication as an instrumental failure. Unnecessary replacement of the radio frequency receiver onboard will be performed for quality assurance of the aircraft communication system. However, the pointed-out risk is not widely known and it may be just a theoretical risk that needs evaluation.

To evaluate the radio propagation time from HF-START, we developed a digital receiver, Low-cost Amateur receiver System Employing RTL-SDR (LASER) based on RTL-SDR (https://www.rtl-sdr.com) that is a cheap open-source hardware and GNU Radio (http://gnuradio.org/) that is an open-source software toolkit (Hozumi et al. 2018). The evaluation campaign was launched in late 2018 by installing the developed LASER at Wakkanai, Kokubunji, Yamagawa, and Okinawa to receive the HF radios transmitted from the Radio NIKKEI in Nagara. More details on the development and the campaign are available in the paper by Hozumi et al. (2018).

The HF-START web system has been successfully developed and is now available at https://hfstart.nict.go.jp/. On March 24, 2021, two main functions of the HF-START service, which are (1) real-time information provision and (2) web calculation, were released. Because of its user-friendly feature, prior knowledge on space weather is not a prerequisite in order to use the service. Users can select the propagation medium from real-time observation and models. Then, users just simply input locations of transmitter and receiver, transmitting frequency and angle, date and time; and then click a run button. Soon after that, the radio propagation information on demand will be served to the users. More information on the HF-START service is available at “What is “HF-START”?” and “Readme” on the website.

Estimation of individual satellite charging

One of the major causes of satellite anomaly is charging and discharging phenomena, which are caused by disturbances in the geospace environment such as injection of substorm particles and enhancement of radiation belt particles. Substorm particles and radiation belt particles cause surface charging and internal charging, respectively. To mitigate the effect of satellite anomaly caused by charging and discharging, information of disturbances predicted by space weather forecasting needs to be known in advance. However, charging and discharging conditions differ depending on the satellite shape and materials even if the condition of space environment is the same. Therefore, it is difficult for a satellite operator to identify the operational risk of an individual satellite using only the general information of space weather. To provide tailored space weather information, we have developed SECURES (Space Environment Customized Risk Estimation for Satellites) by combining models of the space environment and those of spacecraft charging (Nagatsuma et al. 2021). SECURES consists of a surface charging part and an internal charging part. In SECURES, we focus on the risk of spacecraft charging (surface/internal) for geosynchronous satellites.

The space environment that causes surface charging is simulated by the Global Magnetohydrodynamics (MHD) model (Tanaka 2015 and references therein). To perform a more realistic simulation, we have improved the model by introducing the inclination and precession of the magnetic dipole axis (Kubota et al. 2019). With this improved model, a real-time global magnetosphere simulation was carried out. The charging condition of an individual satellite was calculated using a satellite charging analysis model such as the Spacecraft Plasma Interaction System (SPIS) (Roussel et al. 2008) or Multi-Utility Spacecraft Charging Analysis Tool (MUSCAT) (Hosoda et al. 2008; Muranaka et al. 2008) with the simulated space environment.

The spacecraft charging analysis model requires the densities and temperatures of ions and electrons (Ni, Ti, Ne, and Te) as the input parameters of the model. Since MHD models cannot simulate these parameters in principle, empirical equations for estimating them using the MHD model were developed on the basis of statistical comparison between plasma parameters in GEO observed by the Magnetospheric Plasma Analyzer (MPA) onboard Los Alamos National Laboratory (LANL) satellites and those simulated by the MHD model. Furthermore, we have developed a quick estimation method of the equilibrium surface potential using precalculated results obtained from an individual geometric model, since the calculation of spacecraft charging analysis model takes hours to days for one space environment condition. We have developed two geometric models of the Van Allen Probes and the Michibiki-1 satellite as a test case.

We have confirmed that the satellite potential estimated from the surface charging part of SECURES is in relatively good agreement with the LANL satellite's observation within a certain factor (Nagatsuma et al. 2021). The results of the prototype surface charging/ESD risk estimation system can be browsed in near real time with a web viewer.

High-energy particles that cause internal charging were predicted by radiation belt simulation using the one-dimensional Fokker–Planck equation to describe the radial diffusion (Miyoshi et al. 2004). The information on the predicted space environment was used to calculate the internal charging using MUSCAT or a simple analysis method introduced in the NASA-HDBK-4002A (2017).

As an example of internal charging phenomena, the noise of the Earth Sensor Assembly (ESA) onboard the “Kodama” satellite was analyzed and confirmed to be highly correlated with the predicted value of high-energy electron flux. We tried to reproduce the internal charging on the basis of MUSCAT with a detailed model of ESA and predicted high-energy electron flux. However, we found that the calculated variation of the electrostatic potential of ESA was very small compared to the threshold potential of electrostatic discharge (ESD). This result suggests that the possibility of internal charging/ESD with other devices or cables, which are located under thin shield, needs to be considered. A detailed quantitative analysis is necessary to clarify the internal charging/ESD of the ESA onboard Kodama, including the development of the detailed structure and material model inside the satellite.

Therefore, internal charging part of SECURES has been developed on the basis of simple analysis method introduced in the NASA-HDBK-4002A (2017). This system is capable of sending an alert of elevated risk to the user who set the thickness of the shield and the device in accordance with the ESD risk.

We have confirmed the basic functions of SECURES as prototype products. SECURES will be provided to the public in the near future. These products will be useful for satellite operators and will improve the safety of satellite operation.

Estimation of human radiation dose on aviation and space station

When a large solar flare occurs, the radiation doses due to solar energetic particle (SEP) are occasionally increased especially at flight altitudes, and they can be a potential hazard to aircrews and passenger. Thus, development of a system for nowcasting and/or forecasting radiation doses due to SEP exposure is one of the most important challenges in space weather research. Collaboration with other research fields such as nuclear physics and radiological protection is the key issue in such development. We therefore developed a physics-based model for SEP dose estimation anywhere in the atmosphere and designated it as a warning system for aviation exposure to solar energetic particles (WASAVIES) (Sato et al. 2018a; Kataoka et al. 2018). It is an integrated system of the results of three simulations, which are as follows: (1) SEP transport simulation between the Sun and the Earth based on the focused transport equation (Kubo et al. 2015); (2) SEP transport simulation in the magnetosphere based on an empirical geomagnetic filed model, and (3) air shower simulation induced by SEP based on the PHITS code (Sato et al. 2014, 2018b).

In WASAVIES, the count rates of several neutron monitors at the ground level, as well as the proton fluxes measured by the GOES satellite, are continuously downloaded at intervals of 5 min and used for checking the occurrence of ground level enhancement (GLE). When a GLE event is detected, the system automatically determines the model parameters to characterize the profiles of each GLE event and nowcasts the radiation dose rates all over the world. The performance of WASAVIES is examined by analyzing the four major GLE events of the twenty-first century. Figure 4 shows the worldwide dose rate map at 12 km during GLE 69 (7:00 UT, January 20, 2005) drawn using WASAVIES. A web interface of WASAVIES was also developed and opened via public server of NICT (https://wasavies.nict.go.jp/) since November 7, 2019. The radiation dose during a large solar flare calculated by WASAVIES will be used as mandatory information for aviation operation management by the International Civil Aviation Organization. An extended version of WASAVIES applicable to the Earth Orbit was also developed (Sato et al. 2019).

Fig. 4
figure 4

Example of WASAVIES output. Colors indicate radiation doses at various locations

Monitoring of the VHF anomalous propagation by the Es layer

The Es layer could reflect the VHF radio waves to cause anomalous long-distance propagation. Because the frequency assignment in the VHF band including the aeronautical navigation band (from 108 to 118 MHz) considers only the propagation within the radio horizon, the anomalous propagation by the Es layer could cause radio interference.

We developed a network of receivers based on the software-defined radio technique to monitor signals of aeronautical radio navigation aids in 108 to 118 MHz (Hosokawa et al. 2020). Since the locations and frequencies of aeronautical radio navigation aids are published as the aeronautical information publication, we can identify the source of anomalously propagating VHF radio waves. This, at the same time, allows us to detect the Es layer occurrence around the middle points between the signal sources and receivers. We found that anomalous propagation caused by the Es layer could occur in the aeronautical navigation band quite frequently, and the signal strength of the anomalous propagation could often exceed the limit required for airborne navigation receivers to work properly (Sakai et al. 2019). Furthermore, in some special geometries, the strength of anomalously propagating signals can be stronger than those of nearby stations, which may need to be considered in frequency assignment (Sakai et al. 2020).

With this VHF anomalous propagation monitoring network, information on the occurrence and location of the Es layer causing potential interference to the VHF radio systems can be provided in near real time. Furthermore, the VHF anomalous propagation occurrences could be predicted based on continuous monitoring of their occurrence and propagation.

Discussion of the integration of space weather forecast models

We collected information on models on the solar–terrestrial environment being developed in Japan to discuss the designs of integrated models for next-generation prediction models and/or further scientific models. A series of PSTEP science meetings “Prospects of Modeling Studies for Solar–Terrestrial Environment Prediction” (cohosted by Institute for Space-Earth Environmental Research (ISEE)) was organized four times (almost once per year) with the participation of experts from various backgrounds covering meteorology, space physics, solar physics, and astrophysics. We sorted out difficulties, challenges, priorities, and feasibilities related to the improvement of each model and model–model couplings toward the prediction model. Several efforts related to model coupling were accelerated via these meetings and achieved: e.g., between SUSANOO (heliosphere/solar wind) and radiation belt, between SUSANOO and GIC prediction model, and between solar spectral model and GAIA (see Sect. 3.3.2), and between the global magnetosphere MHD model at NICT and satellite charging analysis models (Nagatsuma et al. 2021). On the other hand, remained challenges for model coupling are, e.g., comprehensive coupling among magnetosphere–ionosphere–atmosphere, coupling from internal Sun to its surface and heliosphere, and global and local coupling of ionosphere models, because improvements of each model were more prioritized during the project. The information of models related to the PSTEP including the observational activities is summarized in Table 1 and the PSTEP web page (https://www.pstep.jp/model).

Discussion of possible space weather disasters in Japan

Space weather seldom has an impact on society, but when it does, the effects could be significant. It is necessary to estimate the quantitative scale and frequency of space weather disasters for proper preparation. To answer the requirement, we prepared a document named “Space Weather benchmarks on Japanese Society” (Ishii et al. 2021), which is the first in Japan, where the plausible space weather disasters in the country with scale and frequency are described and estimated from past studies. The information was compiled for domestic users of space weather forecasts for appropriate preparedness against space weather disasters. This paper gives a comprehensive summary of the survey, focusing on the fields of electricity, satellite operations, communication and broadcasting, satellite positioning usage, aviation, human space activity, and daily life on the Earth’s surface, using the cutting-edge knowledge of space weather. Especially, we evaluated the social impact of space weather on electric power grid, satellite operation, aviation, telecommunication, broadcast, human space activity, and human activity on the ground (Ishii et al. 2021).

Main results of A02 group: solar storms

We aimed to improve our capability for predicting the solar–terrestrial environment by understanding the mechanism of solar explosions and the propagation of the consequent disturbances to the Earth using physics-based models. The primary objectives were as follows: (1) to develop a reliable scheme for predicting the occurrence of large-scale solar explosions by identifying its trigger mechanism using high-precision measurements of the magnetic fields on the Sun and advanced modeling based on physical principles; (2) to establish a methodology for forecasting solar storms that reach the Earth within several hours of the occurrence of the solar explosion by combining optical and radio observations and advanced modeling of the solar wind and CME, and (3) to form the basis for a next-generation space weather forecasting using a scheme for predicting the occurrence of large solar flares in a quantitative way from the synergetic combination of observations and modeling.

Prediction of solar flares

A new physics-based model (κ-scheme) to predict large solar flares

A new physics-based model called the κ-scheme was developed to predict large solar flares through the critical condition of a magnetohydrodynamic instability (Ishiguro and Kusano 2017) triggered by magnetic reconnection. Through the analysis of the largest (X-class) solar flares and the 198 active regions of the largest sunspots in Solar Cycle 24, it was demonstrated that the κ-scheme predicts not only the occurrence but also the precise location of imminent large solar flares (Fig. 5), with only small exceptions (Kusano et al. 2020). This study also found that the distribution of magnetic twist flux density near a magnetic polarity inversion line on the solar surface plays a crucial role in determining the onset and properties of solar flares. Some attempts have also been made to apply these findings to CME prediction (Lin et al. 2020, 2021).

Fig. 5
figure 5

of Kusano et al. 2020

Magnetic field on the solar surface and the flare ribbon. A Shows the full-disk image of magnetic field component along the line of sight observed by the Solar Dynamics Observatory (SDO) satellite on 6 September 2017. White and black indicate the positive and negative components, respectively. Each active region (AR) number is noted. B, C are the zoom-in view of AR 12,673 for the vertical magnetic field on 08:48 UT observed by SDO/Helioseismic and Magnetic Imager (HMI) and the flare ribbon of the X9.3 flare at 08:59:26 UT observed by SDO/Atmospheric Imaging Assembly (AIA) 1600 Å. White circle represents the location where the κ-scheme predicted a large flare can occur. B, C are reproduced from Fig. 3

The solar observation satellite “Hinode” has been operated during the period of the PSTEP project, giving its highest priority to flare observations. As a result, Hinode successfully recorded unique data for flares, including a series of X-class flares in September 2017. The acquired Hinode data have been primarily utilized for investigating trigger mechanisms of large flares with high-resolution, high-accuracy magnetic field vector maps at the photosphere. Bamba et al. (2017) identified the characteristic magnetic field structure on the magnetic polarity inversion lines and the preflare phenomena that triggered the large flares.

Magnetohydrodynamic simulations were conducted using the observed photospheric magnetic field as boundary conditions (Inoue et al. 2018a; b). The initial condition of each simulation was given a three-dimensional magnetic field that was numerically extrapolated from the photospheric field based on force-free approximation. The data-constrained simulations for the active regions 11,158 and 12,673 well reproduced the characteristics of the large flares caused by each active region, in particular the spatial distributions and behaviors of the flare ribbons. It was also found that the erupting magnetic flux rope (MFR) is enhanced via magnetic reconnection and that the nonlinear interaction with magnetic reconnection is important for the acceleration of the erupting MFR.

Further developments for improving the accuracy of the coronal magnetic fields were conducted, i.e., Miyoshi et al. (2020) studied more realistic non-force-free field modeling of three-dimensional magnetic field in the solar corona, and Kawabata et al. (2020) incorporated the observed information of the chromospheric magnetic field in the boundary condition for extrapolating the coronal magnetic field. These results will contribute to the improvement of the accuracy of the coronal field modeling and eventually the flare prediction.

Machine-learning algorithms for solar flare prediction

Machine-learning algorithms were also applied to solar flare prediction. Nishizuka et al. (2018) developed a solar flare prediction model using deep neural networks, named Deep Flare Net (DeFN). The model can automatically detect active regions and predict the maximum class of flares occurring in the next 24 h after obtaining solar observation images. The model was trained using 3 × 105 magnetograms and coronal extreme ultraviolet (EUV) images taken by the Solar Dynamic Observatories (SDO) satellite from 2010 to 2015, from which 79 physics-based features were extracted. DeFN was optimized and evaluated with the true skill statistic of 0.80 for M-class flares and 0.63 for C-class flares. Among the 79 features, the most critical for predictions of flares are the history of flare occurrence, the information of magnetic polarity inversion lines, and the preflare brightening in the lower chromosphere. The reliability of DeFN was further improved by a new optimization method named as Deep Flare Net-Reliable (DeFN-R; Nishizuka et al. 2020), and it has been used in daily operation in NICT since January 2019 (Nishizuka et al. 2021).

Benchmark test for operational solar flare forecasts

In addition to the developments of new modeling for the flare prediction so far mentioned, a collaboration was made between the PSTEP and ISEE, Nagoya University, to organize the international workshop “Benchmarks for Operational Solar Flare Forecasts” and to publish a series of papers on the quantitative comparison between the 18 different methods cooperating with 16 institutes all over the world (Leka et al. 2019a, b; Park et al. 2020). In this workshop, multiple quantitative evaluation metrics were employed for the comparison, with the focus and discussion on evaluation methodologies given the restrictions of operational forecasting. They concluded that numerous methods performed consistently above the “no-skill” level, although which method scored top marks is decisively a function of flare event definition and the metric used; there was no single winner. With these works, they presented a well-defined and robust methodology for evaluating solar flare forecasting methods in both research and operational frameworks.

Prediction of the occurrence of large-scale mass ejections

As for the prediction of the occurrence of large-scale mass ejections from the Sun, some empirical methodologies were investigated. First, a precursor of filament eruption was found by using a newly developed Doppler-imaging instrument at Hida Observatory, i.e., an enhancement of plasma motions in a filament and slow rising motion of whole filament were observed prior to the onset of its eruption (Seki et al. 2017, 2019). Such behavior was also observed in 12 events of filament eruptions 0.2–24 h before the onset of violent eruption. Thus, the enhancement of internal plasma motions of filaments will provide a clue for predicting filament eruptions (Seki et al. 2019). The process that leads to filament eruption was also investigated by a numerical simulation, and the observed behavior before the violent eruption was well reproduced. The simulation showed that an enhancement of turbulent motions of prominence material is induced by the Kelvin–Helmholtz instability before the rapid growth of the instability.

Observational aspect of the magnetic field in solar filaments

The National Astronomical Observatory of Japan (NAOJ) has focused on the observational aspect of the magnetic field in solar filaments. Since its evolution causes the eruption of the filaments, the investigation of the magnetic field in filaments will open the way for the early prediction of the commencements of filament eruptions and that of the magnetic configuration of the erupted flux ropes, which occasionally hit the Earth's magnetosphere. To elucidate the general characteristics of the magnetic field in solar filaments, a statistical study of their average orientation was carried out. On the basis of data acquired with daily full-Sun, full-Stokes spectropolarimetric observations using the He I 1083.0-nm line by NAOJ, it was revealed that the average orientation of the magnetic field in filaments shows a systematic property depending on the hemisphere (Hanaoka and Sakurai 2017). This is the first confirmation of the hemispheric pattern in the filament magnetic field using direct measurements of the magnetic field in filaments.

On the other hand, the currently available observational data used above are not acquired with a sufficiently high-cadence to track the evolution of the magnetic field of the early stage of filament eruptions. To realize the high-cadence magnetic field observations, high-performance polarimetry in the near-infrared wavelengths employing a high-speed, large-format detector is required. Thus, the development of a new infrared camera, using a large-format array, HAWAII-2RG (H2RG) of Teledyne, was conducted (Hanaoka et al. 2020), and the synchronizing operation of the H2RGs under “fast readout mode” with a high-speed polarization modulation was successfully realized for the first time. The technology developed here will contribute to the launch of advanced solar polarimetry, which is required for next-generation space weather prediction.

A new flare database and prediction of CME occurrence

A new flare database, consisting of 211 M-class and X-class flares observed from 2006 to 2015 observed by the Hinode/X-ray telescope (XRT) and Geostationary Operational Environmental Satellite (GOES) was created. Through the comparison between the flare database and the database of CMEs observed by Large Angle and Spectrometric Coronagraph (LASCO) aboard the Solar and Heliospheric Observatory (SOHO), the Hinode team found that the sigmoidal structure in soft X-ray images will be a useful feature for predicting the CME occurrence in on-disk flare events (Kawabata et al. 2018). Furthermore, the team has developed an algorithm to automatically identify the appearance of sigmoidal structures in soft X-ray images. The automatic algorithm could open a new possibility to identify the potential occurrence of geoeffective CMEs in advance of flares, in addition to the observations of magnetic field configuration and the modeling of the circumstances preferable for triggering large flares.

Real-time forecast of solar storms that reach the Earth

Observation of high-speed eruptions from the sun

To forecast the occurrence of CMEs and their arrival to the Earth by observing the initial phase of solar eruptions is the second primary objective of the group A02. It is known that many of CMEs are associated with prominence or filament eruptions, and the erupted filament is sometimes observed as the bright core of CMEs. In spite of the potential importance of the filament eruption for forecasting the occurrence and propagation of CMEs, none of the facilities for regular observation of solar eruption is able to capture the large line-of-sight velocity of erupting filaments because of a large Doppler shift of the observing spectral line.

To overcome this limitation and to establish a scheme for predicting the occurrence of CMEs that reach the Earth, a new solar imaging system to observe the three-dimensional velocity of filament eruptions was installed at Hida Observatory under the PSTEP (Ichimoto et al. 2017). The system (Solar Dynamics Doppler Imager, SDDI) takes full-disk solar images at multiple wavelengths around the Hα line at 6562 Å. Regular operation was started in May 2016, in which images at 73 wavelength positions spanning from Hα − 9 Å to Hα + 9 Å were obtained every 12 s. The large dynamic range of the line-of-sight velocity measurements (± 400 km s−1) allows us to determine the real motions of erupting filaments in three-dimensional space (Fig. 6). Using 24 events of filament eruptions observed by SDDI in the period of May 1, 2016 to June 18, 2019, Seki et al. (2021) discovered that the product of maximum ascending velocity and length of erupting filament remarkably well correlates with the occurrence of CME. This finding shed a light on a new scheme for future use in operational space weather prediction.

Fig. 6
figure 6

Images of a filament eruption observed by SDDI at Hida Observatory on 2 May 2016. Left panel shows full-disk solar image taken in H-alpha line center. Right panels show partial images taken in different wavelengths around H-alpha, where the bottom two images show components with a line-of-sight velocity of − 200 km/s and + 200 km/s

Metric solar radio burst observation

One of the most important roles of metric solar radio burst observation for space weather forecasting is to immediately detect shock wave formation in the solar corona. Metric type II solar radio bursts are signals of coronal shock wave formation and can be used to estimate propagation speed of the shock wave. Estimated shock speed can be used as initial condition of shock wave propagation simulation in the solar wind. As shock wave can accelerate particles in the corona, it will be the signal of SEP production. Therefore, immediate detection of type II radio burst is fairly useful for space weather forecasting. NICT developed a solar radio spectrograph (Iwai et al. 2017) in YAMAGAWA radio observation facility to monitor solar radio burst. The observation officially started in September 2016. The observation data have been opened to the public by FITS format on the internet via https://solarobs.nict.go.jp/. By using the monitoring data, an automatic detection algorithm of type II solar radio burst is developed to issue an alert of shock wave formation. This algorithm is based on a fact that maximum intensity part of type II burst will become nearly straight line when the data are plotted on a time versus an inverse-frequency plane. Therefore, we applied an image processing technique to detect the straight line from dynamic spectrum images of time versus inverse-frequency plane. After several preprocessings of the dynamic spectrum images with histogram equalization, filtering, and local peak detection, the probabilistic Hough transformation was used to detect straight line from the images. A detection performance was assessed by using the data for almost 1 year. The result is that the detection performance is fairly good, though false alarm occasionally occurs (see Fig. 7). The methodology for reducing the false alarm, such as using machine learning technique, is under investigation.

Fig. 7
figure 7

Result of automatic detection of type II solar radio burst for almost 1 year data

SUSANOO-CME

CMEs can be the main drivers of large-amplitude disturbances of the magnetosphere. The key parameters for such disturbances are southward interplanetary magnetic field (IMF) as well as high-speed and high-density solar wind, all of which can be brought by powerful CMEs. Shiota and Kataoka (2016) developed MHD simulation of the inner heliosphere called SUSANOO-CME, in which multiple CMEs including the internal magnetic field using modified spheromak magnetic field propagate in the background solar wind derived from the daily photospheric magnetic synoptic maps obtained in Global Oscillation Network Group Program. It was demonstrated that SUANOO-CME is capable of reproducing the arrival of a large amount of southward magnetic flux in high-speed such as the Halloween Storm in 2003.

For the purpose of application of SUSANOO-CME simulation into space weather forecast operation in NICT, Shiota (2020) have developed a system to automatically gather observational information as much as possible and to run ensemble SUSANOO-CME simulation based on the gathered observation. The system is planned to be used by nonscientist space weather forecasters, and therefore, the entire system is controlled by browser-based interfaces.

Use of interplanetary scintillation data

Interplanetary scintillation (IPS) is a radio-scattering phenomenon caused by density disturbances in the solar wind. CMEs in the interplanetary space can be detected by the enhanced IPS signatures during the observation of extra-galactic radio sources. ISEE, Nagoya University, has been observing IPS since 1980s using their own radio telescopes at 327 MHz. In the A02 project, Iwai et al. (2019) developed a CME arrival time forecasting system based on the IPS observational data and the above mentioned global MHD simulation, SUSANOO-CME. In this system, the initial speed of a CME is roughly derived from white-light coronagraph observations. Then, the propagation of the CME is calculated by SUSANOO-CME. The IPS response is estimated by the three-dimensional density distribution of the inner heliosphere derived from the MHD simulation. The simulated IPS data are compared with the actual IPS data observed by ISEE, Nagoya University.

The simulation run that best fits the IPS data was considered to be the most probable one, and its CME arrival time was automatically selected to the forecasting result. This system was validated using 12 halo CMEs. The average absolute arrival time error of the IPS-based SUSANOO-CME forecast was ~ 5.0 h, which is one of the most accurate predictions that has ever been validated. The real-time forecasting result for the same data set by another global MHD simulation, Enlil, archived in CCMC/NASA, was about 11.9 h, and the result of the SUSANOO-CME simulations without IPS data, in which the initial CME speed was derived from white-light coronagraph images, was ~ 6.7 h (Iwai et al. 2021). This improvement using IPS data indicates that IPS can efficiently detect the CME fronts, and more IPS observation instruments should be developed for the future space weather forecast. This system has been partially installed in the space weather forecasting center in NICT and operated in real-time.

Basis formation for a next-generation space weather forecasting

Formation of delta sunspots

Observations revealed that the strongest solar flares in history emanate from complex-shaped active regions called the delta sunspots. However, their formation process has long been one of the key mysteries because the solar interior cannot be investigated from direct optical observations. Therefore, a series of MHD models that allow us to study the origin of such flare-prolific active regions have been developed. First, the emergence of magnetic flux tubes in a stratified atmosphere representing the solar interior with a variety of initial settings was simulated (Toriumi and Takasao 2017). As a result, it was found that the subsurface dynamics such as collision and twisting of flux tubes attribute complexity to the generated active regions, and these mechanisms well explained the observed characteristics (Toriumi et al. 2017). Then, by utilizing state-of-the-art radiative MHD code R2D2 (Radiation and Reduced speed of sound technique for Deep Dynamics), which simultaneously solves the realistic convection in the deep interior and small-scale surface granulation, the first-ever modeling of the spontaneous generation of delta sunspots through the coupling between magnetic fields and background turbulence was successfully performed (Toriumi and Hotta 2019). Elevated by large-scale upflows, the magnetic flux appears on the solar surface as two emerging bipoles, and the positive and negative polarities collide against each other to eventually create a pair of delta sunspots. The reproduced delta sunspots not only present sheared polarity inversion lines due to spot rotation driven by the Lorentz force but also form magnetic flux ropes in the atmosphere, all of which are the key ingredients of major flare eruptions. In this way, the series of modeling efforts deepen our understanding of flare occurrence and thus may contribute to the further establishment of flare predictions. This motivated us to publish the Living Reviews article, which summarizes the current understanding of the formation and evolution of flare-productive active regions that has been brought about through decades of observational and theoretical investigations (Toriumi and Wang 2019).

X-rays and extreme ultraviolet emissions

X-rays and EUV emissions from solar flares rapidly change the physical composition of the Earth's thermosphere and ionosphere, thereby causing space weather phenomena such as communication failures. To find out the parameters that control the properties of flare emission, a statistical analysis on the observed flare emission data was performed to examine flare parameters related to the flare EUV spectra. From this study, it was found that the geometrical features of flare, such as flare loop length and ribbon distance, were found to be essential parameters for predicting flare emission duration (Nishimoto et al. 2020).

Then, to predict the effects of flare emissions on the Earth’s upper atmosphere, a simple model based on the physical process of the flare loop (Kawai et al. 2020) is developed. In this model, the soft X-ray light curves observed during flare events were converted into EUV emission spectra using a one-dimensional hydrodynamic calculation and the CHIANTI atomic database. To verify the proposed model, the calculation results, and observed EUV spectra were compared in a statistical manner. The proposed model succeeded in reproducing the EUV flare time-integrated irradiance of the EUV lines, and the correlation coefficient between the proposed model and observations was higher than 0.8 for most of the EUV flare line rise time (Nishimoto et al. 2021).

An experiment was conducted to reproduce the variation of total electron content (TEC) in the Earth’s atmosphere from the solar flare spectrum of the X9.3 flare on September 6, 2017. TEC distribution was obtained by inputting the solar flare spectrum obtained from the above study into GAIA. By comparing with the observed TEC distribution, it was found that the effective wavelength for increasing TEC is around 30 nm (Watanabe et al. 2021).

Coordinated data analysis workshop on SEP

The Coordinated Data Analysis Workshop (CDAW) is a community effort to promote the development and use of tools and techniques to analyze large volumes of joint datasets of selected solar–terrestrial events and to answer unsettled scientific questions. In order to establish long-term collaborations that can effectively address questions related to the SEP forecast, two CDAWs were held: one at Kyoto University in 2018 and another at Tohoku University in 2019. In the CDAWs, a dataset of 197 fast and wide coronal mass ejections (FW CMEs, V ≥ 900 km s−1, W ≥ 60°) was used to examine their SEP consequences. The characteristics of the FW CMEs and the associated flares and type II radio bursts were examined in conjunction with the SEP properties. Main results are as follows: a positive correlation (coefficient of 0.64) between the bandwidth of interplanetary type II radio bursts and the proton peak fluxes suggesting that the nonthermal electrons of type II bursts and the nonthermal ions of SEPs are generated by the same shock (Iwai et al. 2020), an isolation of short-duration 30-MeV proton enhancements associated with the passage of interplanetary shocks or a turbulent magnetic cavity embedded in the ICME sheath region (Oka et al. 2021), and significant correlations between SEP events (i.e., the occurrence, peak flux, and arrival/rising time scales) and the CME speed and the source longitude; Kihara et al. (2020). These results will provide an important piece for building a sophisticated SEP forecast model in the frame of next-generation space weather forecasting.

Main results of A03 group: geospace dynamics

The basic objectives of the A03 group were as follows: (1) to identify transient processes that cannot be captured by conventional radiation belt models and to improve the accuracy of predictions through comparison with Arase satellite observations; (2) to predict GICs by regionally coupled simulations and to improve the accuracy of predictions through verifications with observations, and (3) to predict geomagnetically induced currents in the vicinity of the geomagnetic field. We also predicted the probability of occurrence and arrival of ionospheric mesoscale disturbance phenomena such as plasma bubbles and improved the accuracy of the predictions based on the verification of observations. We have also investigated extreme events in geospace, radiation belts, ionospheric disturbances, and geomagnetic-induced currents from both observation and theoretical studies.

Prediction of radiation belt variations

Results from the Arase satellite data

The research team conducted research about radiation belts and inner magnetosphere by data analysis of the Arase satellite and other satellite data and newly developed computer simulation. We proposed a new model for solar wind and radiation belt coupling (Miyoshi et al. 2016) and a model of cross energy coupling that is a fundamental process for electron accelerations and loss in the inner magnetosphere (Miyoshi et al. 2018). In this process, wave–particle interactions play an essential role for various coupling processes.

Using the data observed by the Japanese Arase satellite, we identified a rapid electron acceleration event that is caused by plasma waves, revealing that nonlinear wave–particle interactions play crucial roles in the acceleration of electrons in the geospace (Kurita et al. 2018a). We also successfully observed the direct evidence of pitch angle scattering by plasma wave–particle interactions by the Arase satellite (Kasahara et al. 2018). Moreover, we showed the first direct evidence of momentum transfer process between waves and particle by the newly developed algorithm WPIA (Shoji et al. 2017; Kitamura et al. 2018).

Using simultaneously observed data by the Arase and other satellites and by ground-based observation, we revealed the contribution of whistler mode chorus emissions (Kurita et al. 2018b), MHD waves (Teramoto et al. 2019), EMIC waves (Hirai et al. 2018; Nakamura et al. 2019), and electrostatic electron cyclotron harmonic waves (Fukizawa et al. 2018) to the loss process of energetic electrons.

Computer simulations for wave–particle interactions

We also reproduced the excitation process of whistler mode chorus and resonant scattering process of relativistic electrons by carrying out numerical simulations under a realistic plasma and magnetic field environment (Saito et al. 2016; Katoh and Omura 2016; Katoh et al. 2018). These simulation results clarified that nonlinear processes are essential in the generation process of chorus emissions and resultant acceleration and loss processes of radiation belt electrons (Fig. 8).

Fig. 8
figure 8

Simulation results of the time evolution of the omnidirectional flux j as a function of the kinetic energy of relativistic electrons under the presence of coherent chorus elements with rising tone (Saito et al. 2016). The wave phase variation of chorus elements is artificially distorted by the frequency (fPB) of (a) 0.2 Hz, (b), 10 Hz, and (c) 1000 Hz, while the duration of chorus elements is assumed to be 1.25 s at the equator. These results clarified the significant effect of the phase trapping for the increase of the relativistic electron flux

We developed real-time forecast of radiation belt electron flux by a code-coupling simulation of SUSNOAA-solar wind and radiation belt based on cooperation with A01. The real-time forecast has been operated for several years since 2016. The Brier Score (Brier 1950) that is a skill score for the forecast performance is 0.09.

Prediction of GICs

Measurements of GICs

Direct measurements of GICs have been conducted in many countries, such as Finland (Pirjola 1985), Sweden (Wik et al. 2009), Spain (Torta 2014), Russia (Sakharov et al. 2009), Canada (Bolduc 2002), South Africa (Koen and Gaunt 2003), Australia (Marshall et al. 2013), New Zealand (Marshall et al. 2012), China (Liu et al. 2009), and Japan (Watari et al. 2009). With the cooperation of power companies, we installed clamp-type current probes at four substations in Japan. The current was sampled every 0.1 s to capture rapid variations of GICs associated with storm sudden commencements (SSCs) or sudden impulses (SIs). The clock of the measurement system was synchronized with the GPS time information to guarantee the accuracy of absolute time. The data acquired at the four substations were automatically transferred in a real-time manner. The first measurement started in February 2017 and we decided to continue our measurements after this project (Watari et al. 2021).

GIC modeling and simulations

Two different methods have been used to model the GICs. The first one is to calculate the GICs directly with the aid of that transfer functions that describe the relationship between the GICs and the geomagnetic field (geoelectric field) (Ingham 1993; Pulkkinen et al. 2007). This method is applied to the substations at which the GICs are measured in advance. The other is to calculate the currents flowing in the network on the basis of Ohm’s law and Kirchhoff’s law for given transmission line resistance, ground resistance, and geoelectric field (Viljanen and Pirjola 1994). To model the geoelectric field, an impedance method (Kaufman and Keller 1981), a finite element method (Rodi 1976), a finite differential method (Mackie et al. 1994) have been used.

For the purpose of evaluating the GICs flowing in the Japanese power grid, we calculated the currents on the basis of Ohm’s and Kirchhoff’s laws. We developed simplified models for the transmission lines at 500 kV (model A) and at voltage levels between 187 and 500 kV (model B). Model A consists of 130 nodes (substations, generators, and switchyards) and 165 links (transmission lines). Model B consists of 602 nodes and 737 links. As for the geoelectric field, we also developed a three-dimensional finite-difference time-domain (FDTD) simulation (Nakamura et al. 2018). The equivalent current inferred from the ground magnetic data was imposed on the topside boundary of the simulation box. Due to the source current, electromagnetic waves propagate downward, and penetrate into the ground. The ground resistance is nonuniform and determined on the basis of a global relief model and a sediment thickness model. As far as we know, this was the first model that calculates the global distribution of the GIC flowing in Japan. The results are shown in Fig. 9, together with the observed GIC described in Sect. 4.1.1. The correlation coefficient between the calculated GICs and the observed ones is 0.79 at a certain substation. The coefficient is 0.57 when we assumed a uniform ground resistance. This implies that realistic distribution of the ground resistance is necessary to improve the performance of prediction.

Fig. 9
figure 9

Calculation of geomagnetically induced currents (GICs) under realistic ground resistance and the Japanese power grid. The blue and red circles indicate GIC flowing into and out of the power grid, respectively

The input parameter for the FDTD simulation is the equivalent current, which can be estimated from the ground magnetic disturbances. Ground magnetic disturbances during substorms (Ebihara et al. 2014, 2019) and geomagnetic sudden commencements (Tanaka et al. 2019) can be numerically calculated by the global magnetohydrodynamics (MHD) simulation for given solar wind conditions.

Prediction of ionospheric variations

Observations of upper atmosphere

Using all-sky airglow imagers and Fabry–Perot interferometers (FPIs) of optical mesosphere thermosphere imagers, new results have been obtained by the PSTEP project for characteristics of mesospheric gravity waves (AGWs) and MSTIDs. Tsuchiya et al. (2018) applied the three-dimensional fast Fourier transform (FFT) spectral analysis method to the airglow images obtained in Japan and found that the AGW propagation direction changed from southwestward to northeastward at Rikubetsu on the day of the zonal wind reversal associated with Sudden Stratospheric Warming (SSW). Based on long-term observations of AGWs, Takeo et al. (2017) and Tsuchiya et al. (2019, 2020) suggested that the longitudinal and seasonal differences of AGW propagation direction are caused by difference of wind filtering of AGWs by zonal mesospheric jet winds and by the locations of the observation sites relative to tropospheric wave sources.

Nakamura et al. (2017) compared thermospheric temperatures measured by FPIs at various latitudes and those obtained from GAIA, which is a self-consistent atmosphere–ionosphere coupled model, to evaluate the performance of the model in the thermosphere. It was found that the temperatures obtained by FPIs at middle latitudes are comparable to those obtained from GAIA. On the other hand, the GAIA temperature is ~ 200 K lower than the FPI temperature in the auroral zone. This may be because the GAIA used in this study does not contain realistic thermospheric heating due to auroral energy input at high latitudes. At equatorial region, the difference of the GAIA and FPI temperatures is seen at around local midnight. This is possibly due to ambiguity of the location of midnight temperature maximum (MTM) in GAIA.

Observations of equatorial ionosphere

Dao et al. (2017) showed the generation of equatorial plasma bubbles around midnight associated with MTM using GNSS-TEC, airglow images, FPI thermospheric wind and temperature, and field-aligned irregularity (FAI) measurements over Indonesia. An enhancement of the magnetically equatorward thermospheric neutral wind was observed at the same time as an increase in the F-layer altitude at low latitudes in the night when the FAI was observed by a VHF radar around midnight. The observations suggest that convergence of equatorward neutral winds from the northern and southern hemispheres, which could be associated with MTM, could uplift the F-layer at low latitudes and increase the growth rate of the Rayleigh–Taylor instabilities, causing a rapid extension of plasma bubbles. Abadi et al. (2017), who statistically analyzed GNSS scintillation data obtained in Indonesia, found that scintillation occurs more frequently in the western azimuth than in the eastern azimuth from the ground-based receivers in March equinox, whereas such a feature is not discernible in September equinox. This result suggests that equatorial plasma bubbles are tilted westward in altitude and latitude more in March than in September equinox.

Moral et al. (2019) reported the first comparison of ground and satellite measurements of TIDs made by using the Challenging Minisatellite Payload satellite and a 630.0-nm airglow imager at the equatorial station. They suggested that the MSTIDs observed at the equatorial region could be caused by AGWs. To identify the meteorological phenomena as the source of AGWs that cause ionospheric currents and electron density fluctuations as observed by low-altitude satellites, microbarometric, high-time resolution rainfall, and geomagnetic and GPS observations were conducted. The magnetic and electron density data provided by the ESA/Swarm satellite mission were also analyzed. From these analyses, it was suggested that the source of magnetic ripples and electron fluctuations observed in the ionospheric F-region along the satellite orbit is the acoustic mode waves caused by strong cumulous convection and strong rainfall in the troposphere (Aoyama et al. 2017).

Observations of electrojet

During the PSTEP project, a new FM-CW radar has been installed at Huancayo, Peru, in December 2018 and started the normal operation since March 2019. A comprehensive analysis of ground-based magnetometer network data (MAGnetic Data Acquisition System; MAGDAS: http://magdas2.serc.kyushu-u.ac.jp) and FM-CW observational data is carried out in order to understand the energy transfer and propagation process from polar to equatorial ionosphere in the terms of the coupling the solar-magnetosphere–ionosphere–atmosphere. Fujimoto et al. (2016) developed a new EE-index which can be separating the magnetic disturbances in the equatorial region into the global and local magnetic variations. They found that new EE-index allow us to be monitoring equatorial electrojet (EEJ) during both magnetically quiet and disturbed period and will be useful to compare the relationship between EEJ and growth/development of equatorial plasma bubbles (EPBs). Fujimoto et al. (2019) also analyze 20-year long-term semidiurnal lunar tidal variations of EEJ. They gave the evidence that the semidiurnal variations are completely different between the magnetic quiet and disturbed periods. This is the first time that the seasonal dependence of disturbance-time semidiurnal variation has been provided from the analysis of the new EE-index. Some important aspects of magnetosphere–ionosphere coupling at high-latitudinal regions are also found. For the generation of not only EEJ, but also auroral electrojet, the Cowling channel plays an important role. Due to this mechanism, inside a high-conductivity band, an intense electric current flow in the direction of the primary electric field by the secondary Hall current driven by the polarization electric fields. Yoshikawa and Fujii (2018) provides an extension of the theoretical model of the classical Cowling channel with respect to the following aspects: (1) taking into account the 3D nature of the ionosphere, and (2) considering finite length of the Cowling channel by introducing a conductance boundary not only at the meridional borders of the Cowling channel, but also at its zonal boundaries. Using this new model, they discuss current closure and the energy principle for evolution of the Cowling channel.

Predictions using GAIA

By comparing with the observation data of the ionosphere and thermosphere, GAIA was improved. Shinagawa et al. (2018) found that a high growth rate for the Rayleigh–Taylor instability obtained from GAIA coincides with the actual plasma bubble occurrence found by a VHF radar and GPS receivers in Indonesia (Fig. 10). By using a high-resolution numerical model of the ionosphere, Yokoyama et al. (2019) succeeded in reproducing the generation and development of plasma bubbles and showed that the vertical wind over the dip equator with an amplitude of speed as low as 5 m s−1 can effectively seed plasma bubbles. This result suggests that the vertical wind perturbations driven by AGWs should play an important role in seeding plasma bubbles.

Fig. 10
figure 10

Daily variations in R-T growth rate obtained with GAIA. The daily maximum values of the R-T growth rate (black line) are obtained with GAIA at 100°E for the years of 2011. Vertical bars indicate the days when plasma bubbles are detected by EAR (red bar) and by GPS (green bar) (Shinagawa et al. 2018)

Furthermore, Shinagawa et al. (2017) calculated vertical ion convergence induced by vertical wind shear originating from atmospheric waves, and they succeeded in reproducing local time and seasonal variations and global distribution of sporadic E layer occurrence rate. Currently, GAIA is being operated in real-time by incorporating meteorological reanalysis data on the previous day below an altitude of 40 km via a nudging method to predict ionospheric phenomena which will occur in a few days. By comparing the observations, it was found that plasma bubble and sporadic E occurrences can be predicted with an accuracy of more than 73% and 86%, respectively. By including effects of the particle precipitations and the electric field from the magnetosphere to the ionosphere in GAIA, the ionospheric and thermospheric variations during magnetic disturbances have been reproduced in GAIA simulations. Including these two processes could reduce the discrepancy of thermospheric temperature at auroral zone between GAIA and observations described in Sub-Sect. 4.3.1.

A04 group: solar cycle activity and impact on climate

The basic goals of the A04 group were as follows: (1) to predict the next solar activity cycle through precise observation of solar activity and a new solar dynamo model and (2) to identify the impact of solar activity variations on climate through collaboration among solar physics, meteorology, and climatology. As a developmental goal, we have elucidated the mechanism of long-term solar activity variation on a multihundred-year scale and reproduced long-term variations using an Earth system model that incorporates solar influences.

Prediction of the next solar cycle activity

Variations of solar surface magnetic fields and simulation with a surface flux transport model

The 24th solar cycle was the unique cycle with the fewest sunspots in the last 100 years, although the reason is still not clear. Using various methods, the 24th solar cycle prediction has been discussed (e.g., Pesnell 2016 and references therein). So far, the prediction schemes can be categorized into 6 (climatology, recent climatology, precursor, dynamo model, spectral, neural network). On the other hand, the prediction results differ for each method (see Fig. 3 in Pesnell 2016) and it is still needed to debate which is the best way to predict the next solar cycle. Predicting whether the activity of the next 25th solar cycle will be active again or decline is essential for predicting the solar–terrestrial environment in the coming decades. Thus, there is an urgent need to establish a method for predicting the next solar cycle. Recently, much attention has been paid to a method of predicting the next cycle activity by estimating the strength of a magnetic field in the polar region. In recent cycles, a positive correlation between the magnetic field strength in the polar region at the solar minimum and the activity in the next solar cycle has been confirmed.

To predict the next solar cycle activity, we developed a surface flux transport (SFT) model simulation code that calculates the temporal evolution of solar surface magnetic fields (Iijima et al. 2017, 2019). Iijima et al. (2017) found that the observed polar magnetic fields become approximately constant during the period of several years before each cycle minimum. This result allows us to predict the polar magnetic fields at the Cycle 24/25 minimum using the SFT model without introducing new flux emergence. The prediction result suggests that the activity of Cycle 25 will be even weaker than the current Cycle 24 (Fig. 11). Further, in order to improve the prediction accuracy, we have studied the temporal variation of the differential rotation and the poleward meridional circulation during Cycle 24 by a magnetic element feature tracking technique (Imada and Fujiyama 2018; Imada et al. 2020). In particular, during the declining phase of the cycle, the meridional flow of the middle latitude is accelerated from 10 to 17 m s−1, which is almost half of the meridional flow itself. The cross-equatorial transport of the net magnetic flux is important for estimating the polar magnetic field at the solar minimum. The cross-equatorial transport of the net magnetic flux can be highly affected by the ratio between the meridional flow and turbulent diffusion. Therefore, the temporal variation of the meridional flow velocity is an important parameter for determining the polar magnetic field at the solar minimum.

Fig. 11
figure 11

Prediction of the maximum sunspot number for the next solar cycle (+) (Iijima et al. 2017). Maximum value of the 13-month smoothed monthly total sunspot number in each sunspot cycle (Cycle 22, 23, and 24; diamond) and the predicted cycle amplitude in Cycle 25 (cross) as a function of the axial dipole moment at the previous minimum predicted from the magnetogram observed three years before the minimum. The least-square fit for Cycles 22, 23, and 24 that crosses the point of origin is shown as the dashed line. The correlation coefficient for Cycles 22, 23, and 24 is 0.99

High-resolution simulation of the solar global convection and the dynamo

Our understanding of the solar dynamo, i.e., the generation mechanism of the magnetic field, was improved by higher resolution simulations. Previously, it was known that a large-scale magnetic field is destroyed by increasing the resolution, i.e., reducing the diffusivities, while the actual Sun has much smaller diffusivities. We improved our numerical method for reducing the numerical cost by using the reduced-speed-of-sound technique and carried out an unprecedentedly higher resolution simulation of the solar global convection and the dynamo by using the supercomputer KEI (Fig. 12). From a low-resolution to a middle-resolution computation, the result is consistent with the previous studies, i.e., the increase of the resolution causes the weakening of the large-scale magnetic field. In an unprecedentedly high-resolution computation, on the other hand, we discovered that the suppression of the destruction by a small-scale flow results in the amplification of a large-scale dynamo (Hotta et al. 2016).

Fig. 12
figure 12

The radial velocity around the top boundary. We see small-scale turbulent features as well as large-scale motion (Hotta et al. 2016)

This finding is crucial to understand the actual dynamo operating in the Sun. We also improved the numerical code to cover the whole convection zone from the base to the surface (Hotta et al. 2019). For the first time, we succeeded in carrying out such a computation and evaluated the influence of the near-surface layer to the deep convection zone. Furthermore, we carried out a simulation of the δ spot formation in collaboration with A02 group (Toriumi and Hotta 2019). We found that even with the surface phenomena such as the sunspot formation, we need to cover the full convection zone to understand the comprehensive process. We also prepared for the next-generation supercomputer FUGAKU. Using FUGAKU, we could extend our calculation domain closer to the surface and increase the resolution. These improvements lead to the reproduction of a more realistic solar situation.

Ground- and satellite-based observations of solar magnetic fields

We operated the infrared spectropolarimeter at the Mitaka campus of NAOJ over the whole period of the PSTEP and developed a data processing scheme to derive the magnetic field from polarization data (Sakurai et al. 2018). We also conducted mosaic observations to combine multiple scans of the Spectropolarimeter of the Solar Optical Telescope onboard Hinode to obtain magnetic field data covering wide regions. Our analysis of the wavenumber spectra of the current helicity using those mosaic observations was presented at the 10th Hinode Science Meeting held at Nagoya University in September 2016. The summary of the conference was published as a 118-page review paper, covering 11 years of science operation of Hinode (Hinode Review Team 2019). Sakurai (A04), Shiota (A01), Shimizu (A02), Toriumi (A02), and Imada (A04) were coauthors of this review paper. On the public relations and outreach activities, we published the second edition of “The Sun”, volume 10 of the “Modern Astronomy Series” of Nippon Hyoronsha, edited by Sakurai, Kojima, Kosugi, and Shibata. The chapter on space weather has been substantially revised by Mitsue Den of NICT. Another activity was the production of a poster showing Solar Cycle 24 in various wavelength bands and instrumentation. This was one of the contributions of the A04 team to the PSTEP-4 International Symposium held at Nagoya University in 2020.

Long-term variations of solar ultraviolet radiation

We have been focusing on the long-term variation of solar ultraviolet (UV) radiation as one of the main effective factors of space climate. Solar UV radiation is mainly emitted from the chromosphere and is absorbed in the Earth's upper atmosphere. Astronomical Observatory of Kyoto University and NAOJ hold solar chromospheric imaging data in the Ca II K-line (393.3 nm) on glass plates from 1928 to 1969 and from 1917 to 1974, respectively. These data are useful, since they directly provide the chromospheric features in the past. In the Ca II K-line images, we can identify various bright features, including plage, enhanced network, and quiet network. These bright features are the manifestation of the magnetic concentrations on the solar chromosphere, and they are also strongly correlated with the source of the solar UV radiation.

As part of the PSTEP, we digitally scanned the glass plate data, carefully calibrated them, and created the database (Kitai et al. 2014). By using the calibrated data, we succeeded to derive a butterfly diagram of the plage regions for the observing periods. During the PSTEP period, we also started international collaboration with India and analyzed the Ca II K-line data taken at Kodaikanal Observatory, which has even older data (from 1907). In particular, a new calibration method to convert the density on a Ca II K-line glass plate into the intensity was developed (Kakuwa and Ueno 2021) in order to quantitatively reproduce the UV intensity. We then performed a spectroscopic observation of the chromospheric Ca II K-line with the Domeless Solar Telescope (DST) at Hida Observatory, Kyoto University and showed the possibility of estimating the UV spectra from previous glass plate data by direct comparison with recent UV imaging data taken from satellites such as the SDO satellite.

Solar UV radiation has been sometimes substituted by microwave radiation, such as F10.7 (2.8 GHz). F10.7 index is a good indicator of solar activity and has been recorded for over 70 years. Frequency ranges are sensitive to the solar chromosphere, where solar UV radiation is mainly emitted. Using the Nobeyama Radio Polarimeters at Nobeyama Solar Radio Observatory, NAOJ has also recorded microwave emission at multifrequency of 1, 2, 3.75, and 9.4 GHz (Shimojo et al. 2017). The long-term variations in those frequencies are similar with those of the F10.7 variation. Interestingly, the microwave intensities and the spectra at the solar minima of Cycles 20–24 did not show differences. The fact that the microwave radiations did not decline so much during the “anomalous Cycle” 23/24 minima (2008–2009) does not replicate the amount of decline in UV radiation expected from ionospheric variability and other factors affected by solar UV radiation. This divergence is a new mystery.

Impact of solar activity variations on climate

Simulations with MRI Earth System Model

We developed the new Meteorological Research Institute Earth System Model version 2.0 (MRI-ESM2.0; see Yukimoto et al. 2019), reproducing realistic solar activity impacts on climate for the sixth phase of the Coupled Model Intercomparison Project (CMIP6; https://www.wcrp-climate.org/wgcm-cmip/wgcm-cmip6) experiments, which contributes to international assessments of climate change. In addition to the fine resolution of spectral solar irradiance (22 bands) as used in previous versions of the model MRI-CGCM3/MRI-ESM1 (e.g., Yukimoto et al. 2012), daily mean values of spectral solar irradiance instead of monthly mean values were applied in historical-related simulations (e.g., historical and AMIP experiments) in 1850–2014 (see SOLARIS-HEPPA recommendations for CMIP6; https://solarisheppa.geomar.de/cmip6). Effects of energetic particle precipitation (EPP) on atmospheric ozone chemistry were newly implemented. NOx and HOx production due to particle-induced ionization in the model domain was applied following the SOLARIS-HEPPA recommendations. Furthermore, NO molecular fluxes were prescribed at the model top (0.01 hPa) as the upper boundary condition of the EPP effect on odd nitrogen (NOy). Ozone changes over the North Pole during the 2003 Halloween Storm was simulated by MRI-ESM2.0. Due to violent EPP, two spikes of large ozone depletions in the mesosphere occurred around October 28 and November 4. While ozone reductions in the mesosphere recovered immediately, those in the upper stratosphere persisted throughout November. Even though the simulations did not perform initialization before this event, the behavior of ozone reductions is highly reproduced. Aside from the EPP effect, cloud radiative effect, and stratospheric circulations such as the quasi-biennial oscillation and sudden stratospheric warmings, which can modify solar activity impacts on climate, were also improved (e.g., Yukimoto et al. 2019; Naoe and Yoshida 2019).

Simulations using GAIA

In the mesosphere and thermosphere, some minor constituents, e.g., CO2 and NO, contribute to the energy budget of the upper atmosphere through infrared radiations from them, while some, e.g., H2O and HOx, have impacts on ozone chemistry (ozone depletion) and production of the noctilucent cloud. Thus, it is necessary to understand the chemical and luminous phenomena in the terrestrial upper atmospheres to identify the behaviors of such minor constituents as well as variations of the major species. NO and HOx are produced by precipitating particles in the polar mesosphere and thermosphere. The European incoherent scatter radar observations (e.g., on March 27, 2017) showed enhancements of the electron density in the 70- to 100-km altitude range, suggesting NO production in the polar region. Since the transport of minor species depends on atmospheric dynamics, e.g., global circulation, which shows seasonal and solar cycle variations, we should observe not only the minor species but also precipitating particles and neutral winds. Some modeling studies are also essential. We have investigated impacts of NO and HOx on the thermosphere and ionosphere by using numerical models, e.g., GAIA (Jin et al. 2011). Effects of precipitating electrons and protons with energy of 0.1–1000 keV on ionization of the polar upper atmosphere and production of NO and HOx were modeled in the PSTEP.

Effects of solar proton events on polar ozone using the MIROC chemistry–climate model

Using the MIROC3.2 chemistry–climate model developed at the National Institute for Environmental Studies (Nakajima et al. 2020), we investigated the effects of giant solar proton events (Carrington Event on September 1, 1859) on polar ozone for several years. After validating the model with ozone changes after the 2003 Halloween Storm, the atmospheric composition in 1859 when the giant event occurred and the atmospheric composition in 2000 when the concentration of equivalent effective stratospheric chlorine reached the peak due to the release of CFCs were used for the calculation and results were compared. It was found that the influence of the proton events on the polar lower stratosphere ozone (ozone destruction) increases from spring to early summer due to the increase of chlorine and bromine compounds. We also found that the expansion of the impact is related to the interaction between the ozone, temperature, and westerly winds. These results indicate that future CFC regulation in accordance with the Montreal Protocol and its amendments could reduce the impact of future giant solar proton events on the ozone layer and climate.

Passive-tracer transport experiments on the 775 AD Miyake Event using the EMAC model

A series of passive-tracer transport experiments of 10Be produced in the 775 AD Miyake Event (Miyake et al. 2012), which is known as the largest solar high-energy particle event in the Holocene, were performed in order to clarify the seasonal dependence of the transport processes in the atmosphere (including the stratosphere–troposphere exchange and surface deposition processes) and to limit the constraints on geological sample analysis such as ice cores. This study was made under international collaboration with Atmospheric Dynamics group of Free University of Berlin with their chemistry–climate model, EMAC (ECHAM/MESSy Atmospheric Chemistry) model, to perform an ensemble experiment of 10-year model integrations by injecting the tracer for every month of the year for ten times for different dynamical states.

To calculate the three-dimensional 10Be initial conditions, we used the latest version of the operational WASAVIES (Sato et al. 2018a) and evaluated the strength of the Miyake Event relative to the solar proton event of 2005, which is the latest and perhaps best documented event. Recently obtained surface flux estimations of 10Be at four ice-core drilling sites in Greenland and Antarctica (two sites for each) were used for the evaluation of the relative strength. Moreover, the comparison of exponential decay in the first six years between the reconstructed ice-core data and the modeled data for each injection month concluded that the event most likely happened in early boreal springtime, in March. This study is a demonstration that such an extreme solar particle event as the Miyake Event is an ideal test case for solar–terrestrial physics, climate modeling, and geochronology. It can be used as a new modeling framework to evaluate model performances and to investigate atmospheric pathways with a state-of-the-art climate model, by comparing the model results to geological ice-core records. The results also provide new motivations in high-resolution geochronological proxy sample analyses regarding the seasonal timing of the event with contrast between the two hemispheres.

Proxy-based observation for the little ice age

Proxy-based observation of hydrological condition at the Little Ice Age has suggested that relative humidity in central Japan increases as solar activity decreases (Sakashita et al. 2017). Using the Japanese cedar collected at the Ise Grand Shrine, we investigated the variation of oxygen-18 in annually resolved tree-ring cellulose, which is an index of relative humidity. The growths of the trees are most active around June to July; therefore, oxygen-18 reflects the humidity around the rainy seasons. The reconstructed relative humidity indicated an increase toward the end of the Little Ice Age, but it shifted to drier condition since around 1850 CE. As directly observed, meteorological data suggest that relative humidity in Japan is strongly influenced by sea surface temperatures around the Philippines. It implies that low-latitude regions are the key area to understand the response of climate system to solar forcing.

To further understand the response of climate system to solar forcing, we also investigated the daily meteorological data in Japan (Miyahara et al. 2017a, b, 2018). Several researches have suggested that solar rotational period is often detected in meteorological phenomena such as cloud and thunderstorm activities. We analyzed thunderstorm record in Japan and found that solar rotational period becomes prominent as sunspot activity increases. Thunderstorm records over the 47 prefectures since 1989 CE indicated that the signal of solar rotational period shows north–eastward migration, similar to the cloud activity pattern in summer in Japan. It again implies the importance of low-latitude regions as a possible recipient region of solar forcing.

Investigation of long-term variations and predictions

Proxy-based observation on past solar and cosmic ray variations

Past solar and cosmic ray variations can be monitored by cosmogenic nuclides such as carbon-14 in tree rings and beryllium-10 in ice cores. In this project, we proceeded the annual-resolution measurements mainly around the grand solar minima. Previous studies have suggested that solar cycles are lengthened during the grand solar minima and that the lengthening might have even started a few cycles before the onset. High-precision carbon-14 data for around the onset of the Spoerer Minimum indicated that at least two cycles were lengthened before the onset (Moriya et al. 2019). Further analyses on solar cycles for various types of grand minima would shed light on what determines the duration of grand minima.

We also developed a new methodology for reconstructing past solar and cosmic ray variations using carbonate deposits called travertines (Xu et al. 2019; Miyahara et al. 2020). Travertines form clear annual layers and contain beryllium-10 produced by cosmic rays. Ice-core beryllium-10 data often accompany a few years of dating uncertainty; therefore, travertine beryllium-10 record may largely contribute to the reconstruction of annual event or of decadal-scale solar cycles in the past.

Long-term solar variability based on contemporary historical documents

The long-term solar variability in the past has been directly evaluated with sunspot group number, which have fairly good correlations with physical parameters such as sunspot area and radio emissions of F10.7. In this project, the long-term solar variability was analyzed with contemporary historical documents (Hayakawa et al. 2020a). Within the coverage of direct solar observations, we have two clear minima: The Maunder Minimum (1645–1715) and the Dalton Minimum (1797–1827). Analyses of these periods have been challenging, as the sunspot observations at that time are not abundant and have left significant uncertainty in their reconstructions. Consequently, the Dalton Minimum has been controversially understood, either as just a secular minimum vs one of grand minima.

In this context, Derfflinger’s original sunspot records in 1802–1824 at the Kremsmünster Monastery have been subjected to thorough analyses (Hayakawa et al. 2020b), showing that the sunspot group number was revised and its long-term trend was updated, with omission of existing contaminations from the solar altitude observations. The sunspot positions were derived from his manuscript and shown in both solar hemispheres. These results are in contrast with extremely suppressed solar cycles, southward concentration of sunspot distribution during the Maunder Minimum (Hayakawa et al. 2020b). Moreover, total eclipse drawings in 1806 show significant coronal streamers unlike the apparent loss of coronal streamers during the Maunder Minimum (Hayakawa et al. 2020c). These results show that the mechanism of the Dalton Minimum is not probably something comparable to that of the Maunder Minimum but probably significantly different from that of the Maunder Minimum.

Paleoclimate simulations using MRI Earth System Model

A couple of paleoclimate numerical experiments were performed by using the Earth System Model of the Meteorological Research Institute (MRI-ESM1) to investigate the impact of interactive stratospheric ozone chemistry to the surface climate through the solar ultraviolet spectral modulation associated with variations in the Earth's orbital elements by the Milankovitch cycles. The time-slice results of interactive ozone chemistry runs for the mid-Holocene (6 kyr B.P.), and preindustrial (PI, 1850 AD) periods were compared with those of the corresponding runs in which the ozone distribution was prescribed to the PI level (Noda et al. 2017). The impact of the interactive ozone chemistry reveals a significant anomaly of up to + 1.7 K in the Antarctic region for the annual mean surface air temperature (SAT) as shown in Fig. 13. This impact on the surface climate is explained by a similar mechanism to the cooling influence of the Antarctic ozone hole but opposite in sign: Weakening of the westerly jet associated with the Southern Annular Mode provides weakening of equatorward ocean surface current, sea ice retreat, and then warm sea surface temperature (SST) and SAT. All the previous mid-Holocene runs with prescribed ozone distribution had a cold bias in SST when compared with geological proxy data, whereas the bias was reduced in our simulations by using interactive ozone chemistry.

Fig. 13
figure 13

Impact of interactive ozone chemistry in climate change simulations between mid-Holocene and preindustrial control period. Latitudinal distributions of the annual mean zonal mean surface air temperature (K) for each contribution are plotted: ALL consists of the contributions of the variations of orbital elements and the interactive chemical processes, whereas no-CHEM consists of only the contribution of the former by using the same ozone distribution prescribed in both simulations for mid-Holocene and preindustrial control. Contribution of the chemical processes, CHEM, is defined by ALL minus no-CHEM under the assumption of linear superposition. See Noda et al. (2018) for more detail

Another series of numerical experiments on the Last Glacial Maximum (21 kyr B.P.) were also performed by using the same MRI-ESM1 to investigate the impact of interactive ozone chemistry (Noda et al. 2018). The impact was a significant warming of SAT, + 0.5 K (~ 20%) in the tropics and up to + 1.6 K in high latitudes. The stronger mitigation of cooling in high latitudes is associated with sea ice retreat, which has the same sign to and is consistent with our mid-Holocene experiments. Most previous Last Glacial Maximum simulations with the prescribed ozone profile showed cold bias in the tropics compared with geological proxy data, whereas this bias is reduced in our simulations through the use of interactive ozone chemistry. Thus, it is recommended for these paleoclimate simulations that climate models should include interactive sea ice and ozone distribution that are consistent with paleosolar insolation.

Concluding remarks

The PSTEP has achieved many scientific research results and built several new schemes for space weather forecasting. The notable achievements of the PSTEP are listed as follows:

  1. 1.

    We developed the first-ever physics-based scheme (κ-scheme) to predict large solar flares and discovered that the distribution of magnetic twist flux density near a magnetic polarity inversion line on the solar surface plays a crucial role in determining the onset and properties of solar flares.

  2. 2.

    We developed a new solar imaging system (SDDI) that can observe the three-dimensional velocity of filament eruption in the solar corona and discovered that the product of maximum ascending velocity and length of erupting filament remarkably well correlate with the occurrence of CME.

  3. 3.

    We developed a CME arrival time forecasting system based on the assimilation of the IPS observational data and the global MHD simulation, SUSANOO-CME, and verified that this system significantly improves the CME arrival prediction.

  4. 4.

    We proposed a new model for solar wind and radiation belt coupling that considers wave–particle interactions of various nonlinear processes.

  5. 5.

    We developed a three-dimensional simulation model to describe the propagation of electromagnetic fields in the atmosphere, the ground, and the transmission lines to predict the GIC during space weather disturbing phases and evaluated the predictability by measuring the GIC in cooperation with Japanese power companies.

  6. 6.

    We discovered that the atmosphere–ionosphere coupling model could predict the possibility of equatorial plasma bubbles and sporadic E layer occurrence.

  7. 7.

    We developed a high-resolution simulation of the solar global convection and the dynamo and discovered the role of small-scale magnetic field to produce large-scale magnetic field in turbulence. We also predicted the solar dynamo activity of the next solar cycle (Cycle 25) based on a SFT model.

  8. 8.

    We investigated the causal relationship between EPP on the atmosphere and ozone reduction in the upper stratosphere through NOx and HOx production due to particle-induced ionization.

  9. 9.

    We established “Space Weather Users Committee Meeting” for discussing the needs–seeds matching in space weather services.

  10. 10.

    We developed new systems of space weather forecast: the radio propagation simulator (HF-START), the space environment customized risk estimation for satellites (SECURES), and the estimation system of satellite charging, and the warning system for aviation exposure to solar energetic particles (WASAVIES).

  11. 11.

    We published Japan’s first space weather benchmarks to evaluate a space weather disaster's social impact.

The PSTEP produced many research results and finished in March 2020. Through the PSTEP, we have demonstrated that physics-based predictions can work well and be very informative for predicting and understanding solar–terrestrial environment dynamics. However, research and development to apply these results for daily space weather forecasts remain as future tasks. For instance, we need higher speed computing to use the physics-based flare prediction (κ-scheme) to the daily operational forecast of solar flares, and we have to create a network system which can connect the real-time observations and the physics-based prediction models. We should continue our efforts to do so. The activities of PSTEP have created the basis for the next-generation space weather forecast and demonstrated how important is the synergistic development between operational forecast and basic research of the solar–terrestrial environment for the future study of space weather.

Availability of data and materials

This is a summary report of research collaborations under PSTEP. If necessary, all datasets used for PSTEP research would be provided by the corresponding authors of each cited paper.

Abbreviations

AGW:

Atmospheric gravity waves

CDAW:

Coordinated Data Analysis Workshop

CFC:

Chlorofluorocarbon

CGCM:

Coupled General Circulation Model

CME:

Coronal mass ejection

CMIP:

Coupled Model Intercomparison Project

DeFN:

Deep flare net

Dst:

Disturbance storm-time

EEJ:

Equatorial electrojet

EMAC:

ECHAM/MESSy atmospheric chemistry

EPB:

Equatorial plasma bubbles

EPP:

Energetic particle precipitation

ESA:

Earth Sensor Assembly

ESA:

European Space Agency

ESD:

Electrostatic discharge

ESM:

Earth System Model

EUV:

Extreme ultraviolet

FAI:

Field-aligned irregularity

FM-CW:

Frequency modulated continuous wave

FPI:

Fabry–Perot interferometer

GAIA:

Ground-to-topside model of atmosphere and ionosphere for aeronomy

GEONET:

GPS network in Japanese area

GIC:

Geomagnetically induced current

GLE:

Ground level enhancement

GNSS:

Global Navigation Satellite System

GOES:

Geostationary Operational Environmental Satellite

GPS:

Global Position System

H2RG:

HAWAII-2RG

HF-START:

HF simulator targeting for all users’ regional telecommunications

IMF:

Interplanetary magnetic field

IPS:

Interplanetary scintillation

ISEE:

Institute for Space-Earth Environmental Research

LANL:

Los Alamos National Laboratory

LASER:

Low-cost Amateur receiver System Employing RTL-SDR

MAGDAS:

MAGnetic Data Acquisition System

MHD:

Magnetohydrodynamics

MIROC:

Model for Interdisciplinary Research on Climate

MPA:

Magnetospheric Plasma Analyzer

MRI:

Meteorological Research Institute

MSTID:

Medium-scale traveling ionospheric disturbance

MTM:

Midnight temperature maximum

MUSCAT:

Multi-utility spacecraft charging analysis tool

NAOJ:

National Astronomical Observatory of Japan

NICT:

National Institute of Information and Communications Technology

PHITS:

Particle and Heavy Ion Transport code System

PI:

Preindustrial

PSTEP:

Project for Solar-Terrestrial Environment Prediction

R2D2:

Radiation and reduced speed of sound technique for deep dynamics

SAT:

Surface air temperature

SDDI:

Solar dynamics Doppler imager

SDO:

Solar Dynamic Observatories

SECURES:

Space environment customized risk estimation for satellites

SEP:

Solar energetic particle

SFT:

Surface flux transport

SI:

Sudden impulse

SOLARIS-HEPPA:

Solar influences for SPARC (stratospheric processes and their role in climate)-high energy particle precipitation in the atmosphere

SPIS:

Spacecraft plasma interaction system

SSC:

Sudden storm commencement

SST:

Sea surface temperature

SSW:

Sudden stratospheric warming

SUSANOO:

Space weather forecast Usable System Anchored by Numerical Operations and Observations

TEC:

Total electron content

TID:

Traveling ionospheric disturbance

UV:

Ultraviolet

WASAVIES:

Warning system for aviation exposure to solar energetic particles

WPIA:

Wave particle interaction analyzer

References

Download references

Acknowledgements

This work was supported by JSPS KAKENHI Grant, 15H05812, 15K21709, 15H05813, 15H05814, 15H05815, 15H05816.

Funding

Grant-in-Aid for Scientific Research (KAKENHI) on Innovative Areas from the Ministry of Education, Culture, Sports, Science and Technology of Japan for “Solar-Terrestrial Environment Prediction as Science and Social Infrastructure (PSTEP)” is the main source of funding, under the Grant numbers of 15H05812, 15K21709, 15H05813, 15H05814, 15H05815, and 15H05816.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to write each subsubsection or paragraph(s) of the manuscript, and the first five authors (KK, KI, MI, YM, and SY) made arrangements of those in each section. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kanya Kusano.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kusano, K., Ichimoto, K., Ishii, M. et al. PSTEP: project for solar–terrestrial environment prediction. Earth Planets Space 73, 159 (2021). https://doi.org/10.1186/s40623-021-01486-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40623-021-01486-1

Keywords