# Using an atmospheric turbulence model for the stochastic model of geodetic VLBI data analysis

- Sebastian Halsig
^{1}Email authorView ORCID ID profile, - Thomas Artz
^{1}, - Andreas Iddink
^{1}and - Axel Nothnagel
^{1}

**Received: **7 March 2016

**Accepted: **2 June 2016

**Published: **21 June 2016

## Abstract

Space-geodetic techniques at radio wavelength, such as global navigation satellite systems and very long baseline interferometry (VLBI), suffer from refractivity of the Earth’s atmosphere. These highly dynamic processes, particularly refractivity variations in the neutral atmosphere, contribute considerably to the error budget of these space-geodetic techniques. Here, microscale fluctuations in refractivity lead to elevation-dependent uncertainties and induce physical correlations between the observations. However, up to now such correlations are not considered routinely in the stochastic model of space-geodetic observations, which leads to very optimistic standard deviations of the derived target parameters, such as Earth orientation parameters and station positions. In this study, the standard stochastic model of VLBI observations, which only includes, almost exclusively, the uncertainties from the VLBI correlation process, is now augmented by a variance–covariance matrix derived from an atmospheric turbulence model. Thus, atmospheric refractivity fluctuations in space and time can be quantified. One of the main objectives is to realize a suitable stochastic model of VLBI observations in an operational way. In order to validate the new approach, the turbulence model is applied to several VLBI observation campaigns consisting of different network geometries leading the path for the next-generation VLBI campaigns. It is shown that the stochastic model of VLBI observations can be improved by using high-frequency atmospheric variations and, thus, refining the stochastic model leads to far more realistic standard deviations of the target parameters. The baseline length repeatabilities as a general measure of accuracy of baseline length determinations improve for the turbulence-based solution. Further, this method is well suited for routine VLBI data analysis with limited computational costs.

## Keywords

## Introduction

The importance of space-geodetic techniques, such as global navigation satellite systems (GNSS) or very long baseline interferometry (VLBI), for the understanding of the Earth’s atmosphere is steadily increasing. In particular, near real-time global positioning system (GPS) data can be used for numerical weather prediction applications (e.g., Crewell et al. 2008; Deng et al. 2011; Dousa and Bennitt 2013). However, at the same time dynamic processes in the neutral atmosphere critically affect the error budget of these space-geodetic techniques. For this reason, it is urgently necessary to use an adequate model for atmospheric conditions, in both the deterministic and stochastic components of the data analysis. Further, it is of great importance to provide an approach for operational and not just for experimental purposes.

The VLBI observable, the so-called delay, is given as the difference in arrival time of the observed signal from an extragalactic radio source at two different radio telescopes. The radio signal passes through the different atmospheric layers and, therefore, is affected by meteorological conditions. First, the ionosphere (between 80 and 1000 km above the Earth’s atmosphere) is a dispersive medium, i.e., the phase velocity of a signal depends on its frequency. Thus, the delay due to the ionosphere can be corrected for using two frequencies in X-band (\(f_{\rm X} = 8.4\,\hbox {GHz}\)) and S-band (\(f_{\rm S}=2.3\,\hbox {GHz}\)), respectively. In contrast to the ionosphere, the situation looks different in the neutral part of the atmosphere, particularly in the so-called troposphere, which is referred to the lower 10–15 km of the Earth’s atmosphere. On the way through the troposphere, the radio signal is affected by the integral over all refractive indices along the signal path. Since the index of refraction is not equal to the refraction index in vacuum, the signal is subject to an additional delay as well as to bending and attenuation effects relative to a theoretical path in vacuum.

*h*) and a wet (index

*w*) part, expressed as

The order of magnitude of the hydrostatic component in zenith direction is about 2.3 m extra path length, and the additional zenith wet delay ranges from 0 cm in dry regions to 50 cm in the wet tropics. Thus, it is indispensable to account for this tropospheric delay in the VLBI data analysis. Actually, to go even further, atmospheric refraction is the limiting factor of any further improvements of the accuracy of telescope positions or Earth orientation parameters. However, today only long-periodic effects in the range of years to hours are considered routinely by the IVS. In contrast, small-scale refractivity fluctuations of minutes to sub-seconds due to turbulent swirls (or eddies) in the troposphere, in particular in the atmospheric boundary layer and in the free atmosphere, are largely ignored.

Further, dynamic processes in the neutral atmosphere induce spatial and temporal correlations between the observations. Concerning the stochastic model in the routine VLBI data analysis of the IVS, those correlations are also not taken into account. As a consequence, the standard deviations of the derived target parameters, such as telescope coordinates or Earth orientation parameters, are too optimistic.

To overcome this deficiency, in traditional VLBI data analysis the standard deviations derived from the VLBI cross-correlation process are inflated. This is achieved by adding either a constant term to the variances of the observations or doing a baseline-dependent re-weighting until the \(\chi ^2\) value, defined as the quotient of the a posteriori and a priori variance factor, is approximately one.

On the theoretical side, more sophisticated strategies have been developed to improve the stochastic model of space-geodetic observations. For instance, Schön and Kutterer (2005) focus on the modeling of uncertainties due to remaining systematic errors of GPS data processing. In the case of VLBI, Tesmer (2004) and Tesmer and Kutterer (2004) propose a refinement of the routine stochastic model of VLBI observations by means of estimating variance and covariance components. Gipson et al. included station-dependent delay noise to the data analysis leading to more realistic standard deviations. For this purpose, they have distinguished two different types of delay noise: a constant additional component to deal with the clock behavior and an elevation-dependent noise term to consider atmospheric characteristics (Gipson 2006, 2007; Gipson et al. 2008).

To allow for a physically more reliable modeling of the stochastic properties in the VLBI data analysis, we now directly consider small-scale dynamic processes in the atmosphere. For this purpose, the stochastic model of VLBI observations is augmented by additional correlations due to high-frequency refractivity fluctuations which can be best described stochastically using the widely known Kolmogorov turbulence theory. Based on this turbulence theory, a few turbulence models have been developed over the last decades, which make either use of the so-called structure function or a power spectrum representation (cf. “Turbulence description” section). Treuhaft and Lanyi (1987) have pioneered turbulence modeling for space-geodetic techniques leading to a turbulence-based variance–covariance matrix for tropospheric delays in VLBI. The model follows the Kolmogorov turbulence theory and describes the stochastic variations of the refractivity around its mean value. Romero-Wolf et al. (2012) presented a simplified modification of this model applied to observations of the VLBA (very-long baseline array) network. The Treuhaft and Lanyi (1987) model was also used by Pany et al. (2011) and Nilsson and Haas (2010) for extended simulation studies. In the latter one, particular consideration was also given to parametrization of specific station-dependent turbulence parameters, e.g., the structure constant \(C_n^2\).

In addition, turbulence investigations have been carried out for GNSS observations. For instance, Schön and Brunner (2008) developed the so-called SIGMA-C model for GPS carrier phases, a variance–covariance model which also follows the turbulence theory of Kolmogorov and is based on the time-dependent integrated separation distance. In contrast to other applications, where the turbulent medium is generally assumed to be homogeneous and isotropic, inhomogeneity and anisotropy can be taken into account in this model. Halsig et al. (2014) used a SIGMA-C adapted model to investigate the stochastic model of VLBI observations. The main problem of turbulence modeling for most of these applications is obvious: Due to the necessary volume of integrations, which can only be solved numerically, they are mathematically difficult to handle and lead to large computational costs. By proposing an extension of the SIGMA-C model and using the so-called Matérn covariance family, Kermarrec and Schön (2014) developed a model which overcomes this issue.

In our endeavor to develop an operationally efficient method for turbulence modeling in routine mass analysis of VLBI observing sessions, we devise a VLBI-specific version of the Kermarrec and Schön (2014) model. With this, we generate a suitable variance–covariance matrix in the stochastic model of VLBI data analysis and, therefore, far more realistic standard deviations of the derived target parameters within the parameter estimation process. So, one of the key objectives of this paper is to develop a suitable strategy to consider atmosphere-based correlations between VLBI observations in an operational way, i.e., it must be guaranteed that the model is mathematically easy to handle and the use of a fully populated variance–covariance matrix is feasible without to much computational effort.

This contribution is organized as follows. In “Turbulence description” section, an introduction to the Kolmogorov turbulence theory and strategies for modeling atmospheric turbulence are presented. It is followed by “Data analysis setup” section on the description of the data analysis setup. In “Results” section, the results of the VLBI data analysis using a modified stochastic model with external physical correlations are illustrated for several VLBI observation campaigns consisting of different network geometries and for different solution setups. Finally, a conclusion and ideas for future work are given in “Conclusions” section.

## Turbulence description

Electromagnetic waves originating from natural or artificial sources, such as extragalactic radio sources or satellites, pass through the atmosphere to an antenna on the Earth’s surface. These waves are affected by atmospheric conditions leading to attenuation, scintillation and delay of the signal. In this context, the atmosphere is subdivided into its main components, the neutral atmosphere and the ionosphere. The effects of the ionosphere caused by the ionization by solar radiation are frequency dependent and can therefore be considered using two different frequencies. In contrast, the neutral atmosphere is a non-dispersive medium and the long-periodic variations as well as small-scale fluctuations caused by atmospheric turbulence cannot be calibrated by in situ measurements. For this reason, the long-periodic effects are considered in the routine VLBI and GNSS data analysis in a deterministic sense within the parameter estimation procedure. The short-periodic fluctuations on the other hand mainly depend on variations of the refractive index induced by turbulent motions. These are generally regarded as randomly varying in space and time and thus have to be described stochastically (Ishimaru 1991).

*n*, it is separated into two components \(n = \bar{n} + \Delta n\) (as first proposed by Reynolds in 1895, cf. Tatarskii 1971). While \(\bar{n}\) describes the mean value in steady state and defines a deterministic part, \(\Delta n\) is characterized by rapid fluctuations and defines a stochastic component. The phenomena described by \(\Delta n\) are referred to turbulence and can be represented as the interaction or superposition of turbulent swirls of different length scales, so-called eddies, i.e., an arbitrary flow pattern characterized by its size (Batchelor 1950). According to Wheelon (2004, p. 83), the shape and size of the eddies depend on the altitude. In the atmospheric boundary layer (0–2 km of altitude), the eddies are assumed to be small and not far from symmetrical, while the irregularities in the free atmosphere are highly anisotropic, i.e., the eddies become more flattened in horizontal direction (see Fig. 1).

According to Wheelon (2004, p. 205f), the free atmosphere plays the dominant role for interferometry based on microwave signals, since it contains most of the ray path. The turbulent eddies are highly anisotropic, i.e., highly flattened in the horizontal plane, and exhibit significant correlations over hundreds of kilometers.

### Modeling atmospheric turbulence

*a*,

*b*and

*c*describe the flattening of the eddies in both the horizontal and the vertical directions, leading to

*t*and \(t+\tau\), respectively, has to be identical to the spatial correlation between these rays with separation distance \(\mathbf {d} = \mathbf {v}\tau\) (see Fig. 3). Thus, the spatial covariance function can be extended by this additional displacement, yielding

*v*to be non-varying and \(C_n^2\) to be constant up to the tropospheric height

*H*and vanishing above. Anisotropy and homogeneity are taken into account. Kermarrec and Schön (2014) found that the corresponding covariance,

Equations (16) and (15) are used to generate a variance–covariance matrix based on high-frequency refractivity fluctuations in the neutral atmosphere, which is then, in a next step, incorporated in the VLBI estimation procedure. The turbulence-based variance–covariance matrix is therefore added to the routine variance–covariance matrix of the Gauß Markov model, which is currently a pure diagonal matrix and includes, almost exclusively, the uncertainties from the VLBI correlation process.

### Turbulence parametrization

The most crucial point in the turbulence-based model is the determination of the turbulence parameters, particularly the “scaling parameters” \(C_n^2\), *H* and *a*, *b*, *c* as well as the wind parametrization. Although the structure constant decreases with height from \(C_n^2 = 10^{-18}\,\hbox {m}^{-\frac{2}{3}}\) at 10 km height to \(C_n^2 = 10^{-14}\,\hbox {m}^{-\frac{2}{3}}\) at 1 km height, \(C_n^2\) can be assumed to be constant up to the tropospheric height \(H \approx 1000\)–2000 m and zero above (e.g., Schön and Brunner 2008). In principle, there are different methods to estimate the structure constant at the specific VLBI site, e.g., from water vapor radiometer, radiosonde or GPS data (Nilsson and Haas 2010). However, for a suitable description of the turbulent behavior over a VLBI station, such sensors have to be available near to these radio telescopes, which is usually only the case for GPS sensors, if at all. However, particularly with regard to the VLBI Global Observing System (VGOS, e.g., Niell et al. 2013), the next-generation VLBI system, which leads to a significant increase of observations and a better coverage, the estimation of \(C_n^2\) parameters may be possible using VLBI observations. Here, especially short baselines of so-called twin telescopes in local networks should be used to determine turbulence effects assuming that other atmospheric effects could be neglected in such local applications. The parameters *a*, *b* and *c* describing the flattening of the turbulent media are chosen to \(a = b > c\) due to the increasing horizontal flattening with height up to \(a = b = 100\,c\) (Wheelon 2004).

The wind is parametrized as a constant horizontal wind velocity and a wind direction, which is defined by the separation distance \(d_H(t)\) between the two radio signals at height *H*. Assuming the so-called free atmosphere from 1000 to 3000 m to be crucial inducing physical correlations between the observations and determining \(v \approx 8\,\frac{m}{s}\), which corresponds approximately to the geophysical wind at that height, these parametrization may be sufficient.

However, when additionally considering the atmospheric boundary layer below 1000 m, which is easy possible with this model, or when considering more global network geometries, which is the standard case in VLBI, the parametrization described above should be specified, because the meteorological conditions may not be the same at two VLBI stations of a baseline. This issue will be investigated further in the near future, but is not part of this study.

## Data analysis setup

In the following, our VLBI data analysis setup will be briefly described. Here, the VLBI target parameters such as telescope positions or Earth orientation parameters (EOP) are estimated in a least-squares method using a Gauss Markov model (Koch 2013). In addition to the target parameters, necessary clock and atmospheric model parameter corrections are estimated as well. In the case, which is currently standard, the weight matrix of the Gauss Markov model is a pure diagonal matrix.

The analysis of the observed group delays is performed following the conventions of the International Earth Rotation and Reference Systems Service (IERS, Petit and Luzum 2010). The parametrization setup for single-session VLBI data analysis has been chosen with respect to the routine data analysis strategies of the IVS. First, the coordinates of the radio telescopes and EOPs are estimated with respect to the current version of the International Terrestrial Reference Frame (ITRF, Altamimi et al. 2011). In order to eliminate the datum defect, i.e., to remove the natural VLBI rank deficiency, additional no-net-rotation (NNR) and no-net-translation (NNT) conditions (Angermann et al. 2004) have been applied. Polar motion and UT1-TAI are parametrized with offsets and rates, while radio source coordinates are not estimated, but fixed to the International Celestial Reference Frame (ICRF2, Fey et al. 2015).

In addition to the target parameters, we need to estimate further auxiliary quantities such as clock and atmospheric model correction parameters. The clock parameters are modeled by a second-order polynomial and additional continuous piecewise linear functions (CPWLF), i.e., linear splines (De Boor 1978), with a temporal resolution of 60 min. Finally, the wet component of the atmospheric delay is estimated in zenith direction and parametrized as an offset as well as CPWLFs with a resolution of 60 min. For the mapping of the tropospheric wet delay from zenith to the slant direction (i.e., the line of sight), the Vienna Mapping Function 1 (VMF1, Böhm et al. 2004) is used, which is derived from a numerical weather model of the European Centre for Medium-Range Weather Forecast (ECMWF). Further, azimuthal gradients are estimated as daily CPWLFs. In order to stabilize the equation system, the clock, ZWD and gradient parameters are supplemented by additional constraints which affect the equation system as weighted pseudo-observations.

The model parameters describing the state of the turbulent atmosphere have been kept very simple and have been chosen to be the same for all stations. A constant structure constant \(C_n^2 \approx 1e^{-14}\,\hbox {m}^{-\frac{2}{3}}\) is used, the effective tropospheric height is set to \(H = 2000\,\hbox {m}\) , and a constant wind velocity \(v = 8\,\frac{m}{s}\) in horizontal direction is assumed. The stretching factors describing the flattening of the turbulent eddies have been chosen to \(a, b= 1\) and \(c = 0.01\) to consider for anisotropy in the free atmosphere. Of course, these values are based on a model parametrization, which is only an approximation to the truth. However, they are suited to demonstrate the general functionality of the turbulence-based approach based on experience-related values. Again, the influence of the parametrization will be investigated further in the future, but is not part of this study.

## Results

Different solution setups including the reference solution and different strategies to refine the stochastic model of VLBI observations

Solution type | \(\chi ^2\) (–) | WRMS (ps) | |
---|---|---|---|

A | Reference solution | 2.32 | 34.53 |

B | Constant additional noise: 1 cm | 0.86 | 42.46 |

C | Gipson et al. (2006–2008) constant and elevation-dependent noise | 1.13 | 36.24 |

D | Turbulence-based correlations | 1.18 | 34.93 |

To validate the turbulence model, we made use of about 2700 VLBI sessions between 1993 and 2014, provided by the IVS (Nothnagel et al. 2015). These include several observation campaigns consisting of different network geometries. In addition to the routine 24 h IVS VLBI sessions, specially designed observation campaigns are set up at the Geodetic Observatory Wettzell (Bavarian Forest, Germany). These so-called WHISP sessions (Wettzell high-speed VLBI session) consist of only one short 123-m-long baseline between the 20-m radio telescope Wettzell (RTW) and the north antenna of the twin telescope Wettzell (TTW-1, Schüler et al. 2015). The advantage of these WHISP sessions is the large number of observations per telescope compared with other VLBI sessions. Further, these sessions allow for a validation of the turbulence model in a local application.

For all VLBI data, we computed several solutions with different setups (see Table 1). Since the traditional stochastic model of VLBI observations only consists of uncertainties due to the VLBI correlation process and an additional noise term (see “Introduction” section), we made use of different noise term strategies to validate our turbulence-based approach. First, we generate a simple approach without using any kind of additional noise term, referred to as reference solution (A) in the following. The most simple approach (B) of re-weighting the observations is to add the same constant noise term for all observations and sessions, which is chosen to \(\approx\)1 cm. However, this strategy is applied here not only for validation purposes; it is common practice in some widely spread VLBI software packages.

A further solution has been processed following the model of Gipson et al. (2008), who added station-dependent noise, which then leads to an increase in the standard deviations. Here, a constant and an elevation-dependent noise terms are added to the standard deviations, which correspond to the clock and troposphere model parameter, respectively. The order of magnitude of both noise terms is related to the analyses in Gipson (2006), Gipson (2007) and Gipson et al. (2008). Finally, we formed a solution incorporating our fully populated turbulence-induced variance–covariance matrix (D) in the stochastic model of VLBI observations. In contrast to the other solution setups, here the observations are not weighted by any additional noise terms. Concerning the turbulence description, we used the same model parametrization for all stations (see “Turbulence parametrization” section)

*f*gives the degrees of freedom.

The \(\chi ^2\) values and WRMS post-fit residuals are shown in Fig. 5a, b, respectively. The reference solution is illustrated as black crosses, purple triangles denote the setup adding 1-cm constant noise terms for all observations. The approach following Gipson et al. (2008) is marked as green circles. Finally, the turbulence-based solution is represented by brown stars. In addition, Table 1 shows the WRMS post-fit residuals of the delay observables as well as the \(\chi ^2\) values as mean values per solution setup over the 2700 VLBI sessions.

Compared with the reference solution (black, \(\chi ^2 \approx\) 2–5), the \(\chi ^2\) values are generally reduced as soon as an arbitrary refinement strategy is used. However, considering the mean values in Table 1, it becomes obvious that in case of the easiest approach (purple) \(\chi ^2 < 1\) indicating an overestimation in the data analysis. In this context, overestimation means that the a priori model is too idealistic in the sense of too enthusiastic initial weights, which is compensated for in the estimation procedure. Conversely, underestimation would imply a too pessimistic a priori modeling and too unpromising initial weights. Although only a very simple model is used in this case, the \(\chi ^2\) values are quite close to one. Similarly positive results can be obtained by the turbulence-based solution (brown) and the Gipson et al. (2008) approach (green), where the \(\chi ^2\) values are approximately one indicating a realistic adjustment, but they are still slightly to high. However, in case of the turbulence model, this is not surprising when recalling the fact that only atmospheric effects are considered in the stochastic model, which are the dominant but not sole error source in VLBI data analysis. For instance, the uncertainties of clock behavior are neglected in the stochastic model. Additionally, the parameters describing the atmospheric turbulence, \(C_n^2\), *H*, *a*, *b*, *c* and *v* are quite simple up to now.

Considering the WRMS post-fit residuals, it is obvious that, compared with the other refinement strategies, the use of a turbulent variance–covariance matrix produces the lowest WRMS post-fit residuals. Expressed in numbers and, for instance, compared with the Gipson et al. (2008) approach, the turbulence-based solution improves by 9.5 ps in quadrature. Nevertheless, both solutions are significantly better than the solution adding constant noise terms only, where the mean WRMS value is degraded by about 24 and 22 ps in quadrature with respect to the turbulent-based and Gipson et al. (2008) approach, respectively. Surprisingly perhaps, the WRMS post-fit residuals for the reference solution are on the same level as for the turbulence-based solution. However, keeping in mind that the \(\chi ^2\) values are too high by the factor of two or even more, it should be discouraged to use the different validation criteria separately.

In addition to the traditional VLBI networks, we analyzed two short baselines in Hobart, Tasmania, and Wettzell, Germany. Since the turbulence model of Kermarrec and Schön (2014) was originally developed for small-scale networks, these sessions are an opportunity to validate the VLBI-adapted turbulence model for local VLBI networks as well.

First, we made use of two specially designed so-called WHISP sessions observed on August 27, 2014, and October 23, 2014, respectively, which only consists of one short baseline between the 20-m radio telescope and the north antenna of the twin telescope at the Geodetic Observatory in Wettzell. Table 2 lists the \(\chi ^2\) values and WRMS post-fit residuals for these sessions. The results look different to the global analysis. The \(\chi ^2\) values derived from the reference solution are approximately 1.3 and 1.8. Introducing a constant term to the variances of the observations or following the Gipson et al. (2008) model, the \(\chi ^2\) values are clearly too small, particularly in case of the WHISP001 session (\(\chi ^2 < 0.5\)), leading to an overestimation in these solutions. Using the turbulence model, the \(\chi ^2\) values are again approximately one. Regarding the WRMS post-fit residuals, the situation appears similar to the global case, at least for WHISP002. In contrast, the WRMS post-fit residuals for WHISP001 are sharply improved using the turbulence-based solution in comparison with all other approaches including the reference solution.

Different solution setups including the reference solution and different strategies to refine the stochastic model of VLBI observations

Solution type | \(\chi ^2\) (–) | WRMS (ps) | |||
---|---|---|---|---|---|

WHISP001 | WHISP002 | WHISP001 | WHISP002 | ||

A | Reference solution | 1.27 | 1.76 | 14.23 | 22.26 |

B | Constant additional noise: 1 cm | 0.32 | 0.48 | 15.01 | 23.29 |

C | Gipson et al. (2006–2008) constant and elevation-dependent noise | 0.47 | 0.79 | 13.61 | 23.51 |

D | Turbulence-based correlations | 0.96 | 1.02 | 11.55 | 22.53 |

It is worth mentioning that, of course, we could vary the amount of re-weighting the variances of observations in the other models until the \(\chi ^2 \approx 1\). However, it should in fact be pointed out that there is no valid general approach and solely the turbulence-based solution is able to handle this situation in global and local networks.

Usually, the use of a fully populated variance–covariance matrix in the stochastic model represents the restrictive factor keeping the computational costs to a limited extent. In this regard, we made use of several VLBI sessions with different quantities of data to validate our approach. In a small network consisting of three stations and about 400 observations, there is almost no loss in time. Regarding for instance the WHISP sessions with over 1000 observations on one baseline, there is hardly no difference between the solutions with and without turbulent correlations. Increasing the number of observation (i.e., 5000 and more), the loss of time is increasing up to the factor 5. In this case, the turbulence-based solution also requires a little more time than the other strategies taken for validation purposes (i.e., the Gipson et al. (2008) model and the approach with constant additional noise), which is of course due to the correlations only taken into account by the turbulence-based model. However, the maximum computational effort is still not higher than 60 s in these cases. Thus, the turbulence model is feasible for common VLBI sessions without too much computational effort. However, in case of the new VGOS networks and the significantly increasing number of observations, further optimization strategies have to be found to adapt the model to the new challenges. For instance, block diagonal variance–covariance matrices could be obtained, when assuming that the spatial and temporal correlations are restricted to certain distances and time periods, respectively.

The turbulence-based model is generally suitable for different network geometries and can be used for traditional long baselines as well as for local approaches as the baseline lengths repeatabilities could be improved and the mean \(\chi ^2\) values are approximately between 1 and 1.2 in all cases. However, we could see that the results in the local case are even better than those of global applications. Keeping in mind that only the turbulence model considers correlations between the co-located stations in a proper way, it becomes obvious that the differences between the results of the solution setups are larger in local VLBI applications where high spatial and temporal correlations are found. In the case of traditional VLBI sessions, the distances between the stations are significantly larger and the spatial correlations disappear almost completely and only temporal correlations between successive observations are present. Due to the fact that we used the same turbulence parametrization at both stations of a baseline, it could be expected that this assumption is valid in local but not in global applications with baseline lengths ranging up to several hundreds of kilometers. Furthermore, please note that the additional variance–covariance matrix of high-frequency atmospheric variations in the stochastic model of VLBI observations only consists for atmospheric effects but not for other uncertainty sources such as, for instance, the clock behavior. Since the VLBI observations are always differential, this effect has, of course, also more impact on long distances than on short baselines. We can conclude that using an atmospheric turbulence model in the stochastic model of geodetic VLBI data analysis leads to an improvement of the solution with regard to the baseline length repeatabilities, the \(\chi ^2\) values, the WRMS post-fit residuals as well as more realistic standard deviations of the target parameters. Further investigations are, however, necessary concerning the turbulence parameters of the different stations of a baseline to guarantee the best possible characterization of the turbulence behavior over a VLBI site. Moreover, the computational costs are kept to a limited extent for common VLBI sessions, which is a not inconsiderable factor in the data analysis.

## Conclusions

One main goal of this paper is to ensure an operationally sufficient method to deal with correlations between the observations due to high-frequency refractivity variations in the neutral atmosphere as the dominant error source in the VLBI data analysis. In particular, this includes that the incorporation of a fully populated variance–covariance matrix in the stochastic model of VLBI observations is feasible without too much computational effort. This was accomplished using the Kermarrec and Schön (2014) turbulence model based on the Matérn covariance family and the widely spread Kolmogorov turbulence theory. This model, originally developed for GPS carrier phases, was adapted and modified for observations of very long baseline interferometry.

The turbulence-based solution was validated against different solution strategies, including a reference solution in which no additional noise was added to the variances of the observations, an empirical model of Gipson et al. (2008) as well as an approach in which a constant additional noise term was included. In contrast to the other refining strategies, the turbulence-based model is able to describe the meteorological and climatological conditions in a more plausible way without adding arbitrary noise terms to the variances of the observations in any form.

Investigating about 2700 VLBI sessions between 1993 and 2014, we showed that the \(\chi ^2\) values as an indicator whether the global test of the least-squares adjustment is fulfilled or not reduces sharply when using additional stochastic information in any form. Considering global and local applications, the best results could be obtained by the turbulence-based solution. For local application, \(\chi ^2 \approx 1\) is valid for all sessions, while for global networks, however, the \(\chi ^2\) is only slightly too high. This can be explained by the fact that, first, only uncertainties due to refractivity fluctuations in the atmosphere are taken into account, which are the dominant but not solely error source in the VLBI data analysis, and, second, the parametrization of the turbulence-describing parameter is quite simple. For instance, we used the same turbulence parameters for both stations of a baseline, which, of course, is only valid for small network geometries. This issue has to be further investigated in the near future, but was not part of this paper.

Moreover, we showed that the baseline length repeatabilities as a general measure of accuracy of baseline length determinations improve for the turbulence-based solution. In comparison with the reference solution and other refinement strategies, up to 50 % of the baselines are improved by at least 1 mm, whereas only a few baselines are degraded. With this approach, also far more realistic standard deviations of the derived target parameters, such as station coordinates or Earth orientation parameters, were achieved.

Due to the limited computational costs for common VLBI sessions, the method is generally suited for routine data analysis and mass processing, which was one of the key objectives of this development.

## Declarations

### Authors' contributions

SH is the corresponding author of this study and wrote the main paper. He was responsible for the VLBI-adapted and modified turbulence model as well as refining the stochastic model of VLBI observations. TA collaborated in the design and coordination of the study and was working on the implementation of the different approaches used for comparison purposes. AI helped to draft the paper and participated in its design. AN helped to draft the manuscript and supervised the project. All authors discussed the results and commented on the manuscript at all stages. All authors read and approved the final manuscript.

### Acknowledgements

S. Halsig thanks the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) for its financial support (Project No. 318/10-1). We acknowledge the use of observations provided by the International VLBI Service for Geodesy and Astrometry (IVS).

### Competing interests

The authors declare that they have no competing interests.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- Abramowitz M, Segun IA (1964) Handbook of mathematical functions. Dover Publications, New YorkGoogle Scholar
- Altamimi Z, Collilieux X, Métivier L (2011) ITRF2008: an improved solution of the international terrestrial reference frame. J Geodesy 85(8):457–473. doi:10.1007/s00190-011-0444-4 View ArticleGoogle Scholar
- Angermann D, Drewes H, Krügel M, Meisel B, Gerstl M, Kelm R, Müller H, Seemüller W, Tesmer V (2004) ITRS combination center at DGFI: a terrestrial reference frame realization 2003. Deutsche Geodätische Kommission Bayer Akad Wiss München, Reihe B 313:1–141. ISSN:3-7696-8593-8, ISBN:0065-5317Google Scholar
- Batchelor GK (1950) The application of the similarity theory of turbulence to atmospheric diffusion. Q J R Meteorol Soc 76:133–146. doi:10.1002/qj.49707632804 View ArticleGoogle Scholar
- Böckmann S, Artz T, Nothnagel A (2010) VLBI terrestrial reference frame contributions to ITRF2008. J Geodesy 84(3):201–219. doi:10.1007/s00190-009-0357-7 View ArticleGoogle Scholar
- Böhm J, Schuh H (2004) Vienna mapping functions in VLBI analyses. Geophys Res Lett 31:L0163. doi:10.1029/2003GL018984
- Crewell S, Mech M, Reinhardt T, Selbach S, Betz HD, Brocard E, Dick G, O’Connor EJ, Fischer J, Hanisch T, Hauf T, Huenerbein A, Delobbe L, Mathes A, Peters G, Wernli H, Wiegner M, Wulfmeyer V (2008) the general observation period 2007 within the priority program on quantitative precipitation forecasting: concept and first results. Meteorol Z 17(6):849–866View ArticleGoogle Scholar
- Davis JL, Herring TA, Shapiro II, Rogers AEE, Elgered G (1985) Geodesy by radio interferometry—effects of atmospheric modeling errors on estimates of baseline length. Radio Sci 20(6):1593–1607. doi:10.1029/RS020i006p01593 View ArticleGoogle Scholar
- De Boor C (1978) A practical guide to splines. Applied Mathematical Sciences, vol 27. Springer, New YorkGoogle Scholar
- Deng Z, Bender M, Zus F, Ge M, Dick G, Ramatschi M, Wickert J, Löhnert U, Schön S (2011) Validation of tropospheric slant path delays derived from single and dual frequency GPS receivers. Radio Sci. doi:10.1029/2011RS004687 Google Scholar
- Dousa J, Bennitt GV (2013) Estimation and evaluation of hourly updated global GPS Zenith total delays over ten months. GPS Solut 17(4):453–464. doi:10.1007/s10291-012-0291-7 View ArticleGoogle Scholar
- Elgered GK (1982) Tropospheric wet path-delay measurements. IEEE Trans Antennas Prop 30(3):502–505View ArticleGoogle Scholar
- Fey AL, Gordon D, Jacobs CS, Ma C, Gaume RA, Arias EF, Bianco G, Boboltz DA, Böckmann S, Bolotin S, Charlot P, Collioud A, Engelhardt G, Gipson J, Gontier AM, Heinkelmann R, Kurdubov S, Lambert S, Lytvyn S, MacMillan DS, Malkin Z, Nothnagel A, Ojha R, Skurikhina E, Sokolova J, Souchay J, Sovers OJ, Tesmer V, Titov O, Wang G, Zharov V (2015) THE SECOND REALIZATION OF THE INTERNATIONAL CELESTIAL REFERENCE FRAME BY VERY LONG BASELINE INTERFEROMETRY. The Astronomical Journal 150(2)(58), doi:10.1088/0004-6256/150/2/58
- Gipson J, MacMillan D, Petrov L (2008) Improved Estimation in VLBI through Better Modeling and Analysis. In: Finkelstein A, Behrend D (eds) IVS 2008 General Meeting Proceedings, “Measuring the Future”, 3–6 March 2008, St. Petersburg, Russia, pp 157–162Google Scholar
- Gipson JM (2006) Correlation Due to Station Dependent Noise in VLBI. In: Behrend D, Baver KD (eds) IVS 2006 General Meeting Proceedings, 9–11 January 2006. Conceptión, Chile, pp 286–290Google Scholar
- Gipson JM (2007) Incorporating correlated station dependent noise improves VLBI estimates. In: Boehm J, Pany A, Schuh H (eds) Proceedings of the 18th European VLBI for geodesy and astrometry working meeting, 12–13 April 2007, Vienna, Geowissenschaftliche Mitteilungen, Heft Nr. 79, Schriftenreihe des Studienrichtung Vermessung und Geoinformation, Technische Universität Wien, pp 129–134. ISSN 1811-8380Google Scholar
- Halsig S, Artz T, Leek J, Nothnagel A (2014) VLBI analyses using covariance information from turbulence models. In: Behrend D, Baver KD, Armstrong K (eds) IVS 2014 general meeting proceedings, “VGOS: the new VLBI network, 2–7 March 2014, Shanghai, China. Science Press, Beijing, pp 272–276. ISBN 978-7-03-042974-2Google Scholar
- Ishimaru A (1991) Wave propagation and scattering in random media and rough surfaces. Proc IEEE 79(10):1359–1366. doi:10.1109/5.104210 View ArticleGoogle Scholar
- Kermarrec G, Schön S (2014) On the Mátern covariance family: a proposal for modeling temporal correlations based on turbulence theory. J Geodesy 88(11):1061–1079. doi:10.1007/s00190-014-0743-7 View ArticleGoogle Scholar
- Koch KR (2013) Parameter estimation and hypothesis testing in linear models. Springer, BerlinGoogle Scholar
- Kolmogorov A (1941) The local structure of turbulence in incompressible viscous fluid for very large Reynolds’ numbers. Akad Nauk SSSR Dokl 30:301–305Google Scholar
- MacMillan DS, Ma C (1997) Atmospheric gradients and the VLBI terrestrial and celestial reference frames. Geophys Res Lett 24(4):453–456View ArticleGoogle Scholar
- Matérn B (1960) Spatial variation—stochastic models and their application to some problems in forest ssurvey and other sampling investigations. Meddelanden Från Statens SkogsforskningsinstitutGoogle Scholar
- Niell A, Beaudoin C, Cappallo R, Corey B, Titus M (2013) First results with the GGAO12M VGOS system. In: Zubko N, Poutanen M (eds) 21st meeting of the European VLBI group for Geodesy and Astronomy, held in Espoo, Finland, March 5–8, 2013, Reports of the Finnish Geodetic Institute, pp 29–32Google Scholar
- Nilsson T, Haas R (2010) Impact of atmospheric turbulence on geodetic very long baseline interferometry. J Geophys Res. doi:10.1029/2009JB006579 Google Scholar
- Nothnagel A, International VLBI Service for Geodesy and Astrometry (IVS) et al (2015) The IVS data input to ITRF2014. International VLBI Service for Geodesy and Astrometry. GFZ Data Services. doi:10.5880/GFZ.1.1.2015.002
- Pany A, Böhm J, MacMillan D, Schuh H, Nilsson T, Wresnik J (2011) Monte Carlo simulations of the impact of troposphere, clock and measurement errors on the repeatability of VLBI positions. J Geodesy 85(1):39–50. doi:10.1007/s00190-010-0415-1 View ArticleGoogle Scholar
- Petit G, Luzum B (2010) IERS conventions 2010. IERS technical note 35, Verlag des Bundesamtes für Kartographie und Geodäsie, Frankfurt am Main. ISSN:1019-4568Google Scholar
- Romero-Wolf A, Jacobs CS, Ratcliff JT (2012) Effects of tropospheric spatio-temporal correlated noise on the analysis of space geodetic data. In: Behrend D, Baver KD (eds) IVS 2012 general meeting proceedings, “Launching the next-generation IVS network, 4–9 March 2012, Madrid, Spain, pp 231–235Google Scholar
- Schön S, Brunner F (2008) Atmospheric turbulence theory applied to GPS carrier-phase data. J Geodesy 82(1):47–57. doi:10.1007/s00190-007-0156-y View ArticleGoogle Scholar
- Schön S, Kutterer H (2005) Realistic uncertainty measures for GPS observations. In: Sanso F (ed) A window on the future of Geodesy, International Association of Geodesy Symposia, vol 128, Springer, Berlin, Heidelberg, pp 54–59. doi:10.1007/3-540-27432-4_10
- Schuh H, Behrend D (2012) VLBI: a fascinating technique for geodesy and astrometry. J Geodyn 61:68–80. doi:10.1016/j.jog.2012.07.007 View ArticleGoogle Scholar
- Schüler T, Kronschnabel G, Plötz C, Neidhardt A, Bertarini A, Bernhart S, la Porta L, Halsig S, Nothnagel A (2015) Initial results obtained with the first TWIN VLBI radio telescope at the Geodetic Observatory Wettzell. Sensors 15(8):18,767–18,800;. doi:10.3390/s150818 View ArticleGoogle Scholar
- Tatarskii V (1971) The effects of the turbulent atmosphere on wave propagation. NOAA (TT-68-50464)Google Scholar
- Taylor GI (1938) The Spectrum of Turbulence. Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences 164(919):476–490. doi:10.1098/rspa.1938.0032 View ArticleGoogle Scholar
- Tesmer V (2004) Das stochastische Modell bei der VLBI-Auswertung. Dissertation, Bayerischen Akademie der Wissenschaften, MünchenGoogle Scholar
- Tesmer V, Kutterer H (2004) An advanced stochastic model for VLBI observations and its application to VLBI data analysis. In: Vandenberg NR, Baver KD (eds) IVS 2004 general meeting proceedings, 9–11 February 2004 Ottawa, Canada, pp 296–300Google Scholar
- Treuhaft RN, Lanyi GE (1987) The effect of the dynamic wet troposphere on radio interferometric measurements. Radio Sci 22(2):251–265. doi:10.1029/RS022i002p00251 View ArticleGoogle Scholar
- Wheelon AD (2004) Electromagnetic scintillation, vol 1. Cambridge University Press, Cambridge Books Online, CambridgeGoogle Scholar