the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
The time derivative of the geomagnetic field has a short memory
Mirjam Kellinsalmi
Ari Viljanen
Liisa Juusola
Sebastian Käki
Download
- Final revised paper (published on 30 Aug 2022)
- Preprint (discussion started on 01 Feb 2022)
Interactive discussion
Status: closed
-
CC1: 'Comment on angeo-2022-4: Methodology and circular mean', Spencer Hatch, 04 Feb 2022
I am having a hard time understanding the motivation for the methodology described on Lines 81–90 of the manuscript. Why do the authors resort to constructing a histogram of eight bins of directional values, identifying an "approximate direction," and finally calculating a mean direction based on a (possibly small) subset of their statistics, when there are established statistical methods (e.g., the circular mean, circular variance and standard deviation, vector mean, covariance matrix) for dealing with circular statistics?
I have the feeling that the authors may be inadvertently reinventing the wheel, but perhaps I have misunderstood what the authors wish to accomplish with this alternative methodology.
Kind regards,
Spencer Hatch
University of BergenReferences
Engineering Statistics Handbook §6.5.4.1. Mean Vector and Covariance Matrix (https://www.itl.nist.gov/div898/handbook/pmc/section5/pmc541.htm)
Directional statistics (Wikipedia; https://en.wikipedia.org/wiki/Directional_statistics)
Circular mean (Wikipedia; https://en.wikipedia.org/wiki/Circular_mean)
Citation: https://doi.org/10.5194/angeo-2022-4-CC1 -
AC1: 'Reply on CC1', Mirjam Kellinsalmi, 04 Feb 2022
Thank you for your interest in our work and for the great question.
As it was briefly mentioned in the Discussion section 4.2.1, we also tried a few other methods, including some basic circular mean functions and Davis (2002) method, but these proved to be unreliable with the very scattered distributions. In these cases the circular mean functions tend to give mean directions that visibly are not in agreement with the distribution polar plots (see attached figure). Because of this, we decided to first do this selection of the subset of data, and after that we are able to use the circular mean [1] with reliable results.
There most likely are also other methods for getting a meaningful mean direction for these kinds of distributions, but the method we used was the first one to work reliably with this data. We understand your worry of using only a subset of the values, but in practice, this subset is at least 50% of all the directional values, since we are using data in the semicircle surrounding the approximate direction. Also, since these time derivative distributions are generally bimodal (roughly speaking, symmetrical), we think that relevant information is not lost. We should still discuss this in more detail in the Discussion section, since it clearly raises some questions.
Attached is an example figure comparing these two methods. Top figure: mean direction using our method, bottom: mean direction using only circular mean. Mean direction, [deg], is given on top of the polar plots and also shown as a black bar in the plot.
References
Davis, J. C.: Statistics and data analysis in geology, Wiley, New York, 3rd ed. edn., 2002.
[1] https://docs.astropy.org/en/stable/_modules/astropy/stats/circstats.html#circmean
Citation: https://doi.org/10.5194/angeo-2022-4-AC1 -
CC2: 'Reply to AC1', Spencer Hatch, 07 Feb 2022
I now appreciate that with such a heavily bimodal distribution as the authors show in their attached figure, the circular mean and other standard tools and statistics for working with circular data are really not very helpful.
I have spent some time searching, but have not been able to locate any standard, accepted tools for analyzing bimodal circular data. Given this lack, the authors' approach seems sensible.
Citation: https://doi.org/10.5194/angeo-2022-4-CC2
-
CC2: 'Reply to AC1', Spencer Hatch, 07 Feb 2022
-
AC1: 'Reply on CC1', Mirjam Kellinsalmi, 04 Feb 2022
-
RC1: 'Comment on angeo-2022-4', Anonymous Referee #1, 15 Feb 2022
General Comments
This manuscript extends several previous studies by the FMI group of the geomagnetic perturbations that can cause geomagnetically induced currents, using multi-year observations from the IMAGE magnetometer network. An extension of previous analyses involves distinguishing internal and external parts of the observed vector magnetic field for events exceeding a |dH/dt| threshold of 1 nT/s (later extended to 0.5 nT/s) and analyzing separately both their amplitude and direction of their perturbations and that of their derivatives. As might be expected, the angular distributions of both the perturbations and their derivatives are larger for the internal part of the vector magnetic field, because of inhomogeneities in the underlying or regional conductivity at different stations. The main new result claimed is the large and quickly reached (~2 min) asymptotic value of the standard deviation of the time-averaged angle of dH/dt. However, no specific interpretation or mechanism for this result is provided.
The “main new result” of this paper, that the direction of the geomagnetic field time derivative has a very short “reset time,” was anticipated by Belakhovsky et al. (2018), as the authors note, but also in significant detail in a recent study of similar events in Arctic Canada by Weygand et al. (2021).
Weygand, J. M., Engebretson, M. J., Pilipenko, V. A., Steinmetz, E. S., Moldwin, M. B., Connors, M. G., et al. (2021). SECS analysis of nighttime magnetic perturbation events observed in Arctic Canada. Journal of Geophysical Research: Space Physics, 126, e2021JA029839. https://doi.org/10.1029/2021JA029839
Specific Comments
- Line 150: The text incorrectly states that “Figures 10 and 11 show Δθ“ but these figures and their captions make it clear that what is shown is the standard deviation of Δθ, not Δθ .
- Lines 152-153: Given the above confusion between Δθ and the standard deviation of Δθ, it is not clear to this reviewer whether or not “standard deviation” belongs in this sentence. It is also not clear what is meant by their “mean values” yielding similar results. Over what variable and range are these mean values (Δθ or std (Δθ)) calculated?
- Lines 185-186: The westward electrojet also produces southward magnetic field perturbations before magnetic midnight. See, for example, Table 3 of the SECS analysis of large ( >6 nT/s) pre- and post-midnight magnetic field perturbations reported by Weygand et al. (2021).
- Lines 215-218: The time scale of 80 s to 100 s for the behavior of dH/dt is clear in the Pulkkinen et al. (2006) paper, but is asserted without any specific documentation or quantification as being a result of the analysis presented in this paper. This statement needs to either be adequately justified or removed.
- Lines 217-218: The manuscript does not provide any explanation for this time scale, other than that “The size, motion, and lifetime of the dH/dt structures may contribute to the observed time scale.” The Weygand et al. (2021) paper provides detailed information at higher time resolution than provided in this study that may be helpful in developing such an explanation.
Figure 2 of Weygand et al. shows a histogram of the duration of all dB/dt derivative amplitudes above 6 nT/s observed at two Canadian stations during 2015. The peak of the distribution of the durations of derivative amplitudes |dB/dt| ≥ 6 nT/s, which are different from the duration of the magnetic perturbations (ΔB), was between 10 and 15 s, but the range was between a few seconds (most common for MPEs with peaks only slightly above 6 nT/s) up to 71 s.
This figure, based on 10x higher sampling rate data than was used in this manuscript, provides a corrective to the statement in lines 232-233 that “the amplitude of the derivative tends to decrease immediately after reaching the threshold value.” The amplitude of course must increase immediately after reaching whatever threshold is used, whether 1 nT/s or 6 nT/s, if it is ever to reach a much higher value (which is often observed) but this figure quantifies the distribution of durations; it is short (not immediate) only relative to durations quantized by 10-s sampling. This rapid falloff of durations above 20 s provides a ready explanation (with a correction) for the statements in lines 230-233 and agrees with the statement on in lines 234-235 that it is rare for the derivative amplitude to remain at high values for long periods.
Weygand et al. (2021) also examined the dB/dt durations above 6 nT/s as a function of three categories of time delay Δtso after the most recent prior substorm. For Δtso ≤ 30 min category the mean duration was 19.0 ± 0.9 s, for 30 < Δtso < 60 min the duration was 17.7 ± 2.1 s, and for Δtso ≥ 60 min the mean duration was 12.8 ± 1.8 s where the uncertainty given is the error of the mean.
In addition, Weygand et al. (2021) presented several example events, combining multistation magnetometer observations with SECS analyses and in some cases auroral images, that showed that short-lived and highly localized vertical currents and associated localized ionospheric currents were associated with large perturbations and dB/dt values at individual stations. The location of these currents relative to the measuring stations determined details of the orientation of the observed magnetic perturbations and their vector derivatives as well as the extent of their duration. No issue of memory needs to be invoked.
Technical Corrections
Line 209: This line contains two minor errors. First, as in line 150, the words “standard deviation of” need to be added before “Δθ.” Second, the values “104 to 110” do not agree with the values of “105 to 109” stated in line 155 in reference to Figure 13.
Citation: https://doi.org/10.5194/angeo-2022-4-RC1 -
AC2: 'Reply on RC1', Mirjam Kellinsalmi, 25 Feb 2022
Thank you for the comments regarding our manuscript. We appreciate bringing the Weygand et al. (2021) article to our attention. We find it useful in providing explanations to some of our findings, and will add it to the references of our manuscript. Specific replies (in bold) to the referee comments:
“... The main new result claimed is the large and quickly reached (~2 min) asymptotic value of the standard deviation of the time-averaged angle of dH/dt. ... “
The standard deviation is calculated of the change in the direction ( Δθ) of dH/dt, not of the angle of dH/dt.
“The “main new result” of this paper, that the direction of the geomagnetic field time derivative has a very short “reset time,” was anticipated by Belakhovsky et al. (2018), as the authors note,”
These authors show examples illustrating how dB/dt varies clearly more rapidly in direction than B. However, no quantitative characteristic time scale is given in this paper.
“… but also in significant detail in a recent study of similar events in Arctic Canada by Weygand et al. (2021) ... “
The time scale that Weygand et al. discuss is different from ours. However, their study provides useful insight which is relevant also to our manuscript.
Specific Comments
-
Line 150: The text incorrectly states that “Figures 10 and 11 show Δθ“ but these figures and their captions make it clear that what is shown is the standard deviation of Δθ, not Δθ .
The figures show the standard deviation of Δθ. The text will be corrected accordingly.
-
Lines 152-153: Given the above confusion between Δθ and the standard deviation of Δθ, it is not clear to this reviewer whether or not “standard deviation” belongs in this sentence. It is also not clear what is meant by their “mean values” yielding similar results. Over what variable and range are these mean values (Δθ or std (Δθ)) calculated?
Here, the mean is calculated as: mean(|Δθ|). This will be clarified in the text.
-
Lines 185-186: The westward electrojet also produces southward magnetic field perturbations before magnetic midnight. See, for example, Table 3 of the SECS analysis of large ( >6 nT/s) pre- and post-midnight magnetic field perturbations reported by Weygand et al. (2021).
This is correct, and was also shown by Viljanen et al. (2001): Fig. 9. Text will be reformulated.
-
Lines 215-218: The time scale of 80 s to 100 s for the behavior of dH/dt is clear in the Pulkkinen et al. (2006) paper, but is asserted without any specific documentation or quantification as being a result of the analysis presented in this paper. This statement needs to either be adequately justified or removed.
Figures 11 and B2 show examples of this time scale. As stated in the text (line 152), this is seen at all studied stations. Also a lower threshold for the activity level of dH/dt does not change the result (line 170, and Appendix B). std(Δθ) reaches an asymptotic value after about 2 minutes, and this is of the same order as the time scale shown in Pulkkinen et al (2006) study. Attached (supplement) are also figures from eight other stations. The behavior of std(Δθ) is similar at all of them. We may add these figures in the Appendix, and also emphasize this more in the text.
-
Lines 217-218: The manuscript does not provide any explanation for this time scale, other than that “The size, motion, and lifetime of the dH/dt structures may contribute to the observed time scale.” The Weygand et al. (2021) paper provides detailed information at higher time resolution than provided in this study that may be helpful in developing such an explanation.
Additional discussion will be added based on Weygand et al (2021).
Figure 2 of Weygand et al. shows a histogram of the duration of all dB/dt derivative amplitudes above 6 nT/s observed at two Canadian stations during 2015. The peak of the distribution of the durations of derivative amplitudes |dB/dt| ≥ 6 nT/s, which are different from the duration of the magnetic perturbations (ΔB), was between 10 and 15 s, but the range was between a few seconds (most common for MPEs with peaks only slightly above 6 nT/s) up to 71 s.
This figure, based on 10x higher sampling rate data than was used in this manuscript, provides a corrective to the statement in lines 232-233 that “the amplitude of the derivative tends to decrease immediately after reaching the threshold value.” The amplitude of course must increase immediately after reaching whatever threshold is used, whether 1 nT/s or 6 nT/s, if it is ever to reach a much higher value (which is often observed) but this figure quantifies the distribution of durations; it is short (not immediate) only relative to durations quantized by 10-s sampling.
We will add clarification of the fact that amplitude tends to decrease soon, not immediately, relative to the 10s data that is used in this study, and the standard deviation is large (Fig. 14). There are great amounts of larger, as well as smaller, values of dH/dt after reaching the threshold.
The statement that “The amplitude of course must increase immediately after reaching whatever threshold is used ” does not always hold true for our data set. Attached (supplement) is a figure of dH/dt tot (Sodankylä, SOD, 20170219) with values above the threshold marked with red dots. This shows that values after reaching threshold can fall below the threshold.
This rapid falloff of durations above 20 s provides a ready explanation (with a correction) for the statements in lines 230-233 and agrees with the statement on in lines 234-235 that it is rare for the derivative amplitude to remain at high values for long periods.
Weygand et al. (2021) also examined the dB/dt durations above 6 nT/s as a function of three categories of time delay Δtso after the most recent prior substorm. For Δtso ≤ 30 min category the mean duration was 19.0 ± 0.9 s, for 30 < Δtso < 60 min the duration was 17.7 ± 2.1 s, and for Δtso ≥ 60 min the mean duration was 12.8 ± 1.8 s where the uncertainty given is the error of the mean.
In addition, Weygand et al. (2021) presented several example events, combining multistation magnetometer observations with SECS analyses and in some cases auroral images, that showed that short-lived and highly localized vertical currents and associated localized ionospheric currents were associated with large perturbations and dB/dt values at individual stations.
We agree. This shows that predicting dH/dt is a big challenge. There is a still a general question of which characteristics of the near-space ultimately determine the observed features of H and dH/dt.
The location of these currents relative to the measuring stations determined details of the orientation of the observed magnetic perturbations and their vector derivatives as well as the extent of their duration. No issue of memory needs to be invoked.
The “issue of memory” is merely a lighthearted and easily accessible way of describing one of our results. We find it important to emphasise the difference between H and dH/dt. H has a longer "memory", i.e. its direction changes clearly more slowly than of dH/dt. As is visually obvious (as illustrated by Weygand et al.), the magnitude of H also changes slowly. So, if we know the present value of H, its (near-)future values (the next few minutes or later) will not be very different from the present. On the contrary, the next value of dH/dt (<1 min from the present) can be completely different, both by magnitude and direction.
This difference is clear also if we consider attempts to forecast different magnetic activity measures. Just as a single example of an empirical approach, the lower auroral electrojet index (AL), related to the north component of the field, can be reasonably well predicted as a time-series based on solar wind observations (Amariutei and Ganushkina, 2012).
A similar way does not work for dB/dt as shown, for example, by Wintoft et al. (2015). Instead of time series, they considered the 30-min maximum of |dH/dt|.
First-principle physics methods (simulations) also still have a major work to become really accurate (Kwagala et al.,2020).
Technical Corrections
Line 209: This line contains two minor errors. First, as in line 150, the words “standard deviation of” need to be added before “Δθ.” Second, the values “104 to 110” do not agree with the values of “105 to 109” stated in line 155 in reference to Figure 13.
Will be corrected in the new version.
References
Viljanen, A., Nevanlinna, H., Pajunpää, K., and Pulkkinen, A.: Time derivative of the horizontal geomagnetic field as an activity indicator, Annales Geophysicae, 19, 1107–1118, https://doi.org/10.5194/angeo-19-1107- 2001, 2001.
Amariutei, O. A. and Ganushkina, N. Yu.: On the prediction of the auroral westward electrojet index, Ann. Geophys., 30, 841–847, https://doi.org/10.5194/angeo-30-841-2012, 2012.
Kwagala, N.G., M. Hesse, T. Moretto, P. Tenfjord, C. Norgren, G. Tóth, T. Gombosi, H.M. Kolstø and S.F. Spinnangr, 2020: Validating the Space Weather Modeling Framework (SWMF) for applications in northern Europe. Ground magnetic perturbation validation. J. Space Weather Space Clim. 2020, 10, 33, doi:10.1051/swsc/2020034.
Wintoft P., M. Wik & A. Viljanen. Solar wind driven empirical forecast models of the time derivative of the ground magnetic field. J. Space Weather Space Clim., 5, A7, 2015, DOI: 10.1051/swsc/2015008.
-
-
RC2: 'Comment on angeo-2022-4', Anonymous Referee #2, 03 Mar 2022
General comments:
The present manuscript describes results based on the analysis of several quantities derived from the horizontal projection of the magnetic field throughout the high-latitude IMAGE magnetometer network. The study has a clear precedent in the valuable article by Juusola et al., 2020 (which they cite). To carry out the present analysis, the authors rely on the equivalent source method of Spherical Elementary Current Systems (SECS), with nodes in the ionosphere and subsurface to perform the external/internal separation of the modeled magnetic field. Based on this separation, they analyze different aspects of the behavior of both the horizontal projection of the magnetic field and its time derivative, such as preferent directionality and associated persistence in time, change in amplitude, etc., always distinguishing between external and internal components. One of the main conclusions of their analysis -as the title immediately reveals- is that the direction of the time derivative of the horizontal magnetic field during disturbed times does not persist beyond a couple of minutes.
Even if this result is significant in itself, I have serious doubts that it is sufficiently relevant to merit an exclusive publication, especially if this subject has already been investigated by other researchers, who reached similar conclusions, though perhaps using different methods and parameters (Belakhovsky et al., 2018; Weygand et al., 2021, Pulkkinen et al., 2006). Furthermore, the present study is based entirely on reliance on the external/internal separation of the geomagnetic field provided by the SECS technique; however, no assessment is made of the uncertainty of this separation, as the authors themselves acknowledge. For these reasons, I strongly recommend including additional, substantial material based on the following
Specific comments:
- The authors argue that their findings are important to the subject of GIC (this word is repeated a number of times along the manuscript) but they do not substantiate this argument based on GIC measurements of any type. Could the authors provide evidence that their conclusions are somehow reflected in GIC measurements? For example, is it expected that the GIC (which depends on the time derivative of the horizontal magnetic field) has a typical lifetime of two minutes, comparable to the directional persistence of dH/dt? If not, is it because the infrastructures (e.g., power network or oil/gas pipelines) where the GIC is expected to flow have not a preferent direction (e.g., N-S or E-W)? Also, the authors point that the final aim is to forecast GIC. I guess GIC can be predicted by trying to anticipate the ground magnetic variations based on IMF/solar wind observations, along with accurate models of the ground conductivity. Can they specify more clearly how is it expected that the main conclusion of the manuscript (i.e., the “short memory” of the time derivative) helps in this endeavor? Perhaps they refer to “evaluating a potential GIC risk level by means of the dH/dt proxy” rather than “forecasting GIC”?
- The present study is entirely based on the reliance on the external/internal separation of the geomagnetic field provided by the SECS technique; however, the effectiveness of this method is subject to different aspects, such as the nature of the primary/secondary sources, the density of ground magnetometers, or the election of the cutoff parameter for the singular values of the singular value decomposition (SVD) typically used in the context of SECS, among others. The authors have ample experience on this technique, so they should be able to provide an estimate of the uncertainty of the modeled magnetic field and of its external/internal separation in particular. I’m not aware of many articles where this important subject is treated, but perhaps the following thesis can help: https://open.uct.ac.za/handle/11427/35593 (see section 7.2). If this implementation is not feasible, I encourage the authors to at least apply the alternative method of field separation they refer to in Section 4.1 in order to assess how much of the separation depends on the method utilized.
Technical corrections:
- L19: I would suggest: “Space weather events, eventually produced by eruptive phenomena in the Sun, can have harmful effects on Earth, for example via …”
- L33: Faraday’s induction law.
- Figure 1 is somewhat naïve, and in my opinion unnecessary -just consider my comment as a recommendation. In its place (though perhaps not as Figure 1), I would find more useful to illustrate the concept of Δθ(H) and, if possible, that of Δθ(dH/dt), which is central to this manuscript. I think the horizontal projection of the geomagnetic field can be represented at times t and t + T as two arrows, and then represent the corresponding variation in θ.
- L62 “2D SECS”: I guess you have used internal and external nodes for the field separation. Is there a specific designation for this modality to differentiate it from the use of external nodes only (which would be the case to model the total horizontal field when there is no need for external/internal separation)?
- L75: The IMAGE time resolution is 10 s. Does the threshold of 1 nT/s refer to a mean variation computed as 10 nT in those 10 s? If so, I think the authors should state it.
- The authors always refer to Bx, By and H whereas section 2.1 specifies that baselines are subtracted from the data using a certain automatic method. In consequence, they work with variations of those quantities. I think this point is important and the nomenclature currently used may give rise to confusion. Properly speaking, the studied quantities are ΔBx, ΔBy and ΔH (where, e.g., ΔH = H – Hb, with Hb the baseline value). I strongly recommend using the deltas before these quantities everywhere.
- Table 1, in 2nd line replace H with |ΔH|; and in 4th line replace dH/dt with |dH/dt|.
- L96: Bx and By should not be in bold face. Idem for caption of Figure 3.
- L98: Replace dH/dt with |dH/dt|.
- Caption of Figure 3: I would recommend to state “Figure 3. Plot of different quantities related with the horizontal magnetic field at Tromsø, …”. 4) Amplitude of the time derivative …
- L116: No mention is made of stations in Svalbard and surroundings, which do not appear in Figures 4, 5 and Table 2 (and indeed anywhere except for the map in Figure 2). Are they only used for the purpose of the SECS-based external/internal separation?
- Caption of Table 2. Say the stations are ordered by latitude.
- L124: “… over the years”?
- Figure 6: The number of data points in SOD for 2017 shows 32443 against the 32436 of Table 2. Isn't that an inconsistency?
- Figure 7 and others: I would use “dH/dt” instead of “dH”, as in the text.
- Draw the line corresponding to the even distribution of Δθ in figure 10a.
- L149: Figures 10 and 11 show the standard deviation of …
- What is the meaning of the last sentence in the paragraph L149 – L153?
- L154: Figure 13 is referred before Figure 12. I would recommend following the logical ordering.
- Figure 8: Show a title for the x- and y-axis for at least one of the subplots, e.g., “MLT (h)” and “# of events”. Also, MLT = 25 sounds bad. Please, place ticks at 0, 12 and 24 h.
- Figure 9: y-axis is missing a “mean θ” (or equivalent) followed by the station name, e.g., <θ> KIL.
- Figures 10, 11 and 13: Likewise, y-axis is missing a “Δθ”.
- Figure 14: y-axis is missing an “R”. Caption: Specify that the bars indicate the std of R.
- Paragraph L185-189: Only Figure 8 is mentioned, but the fact that the magnetic field is predominantly southward is shown in Figure 9.
- L191-193: Please, refer to a specific figure the reader should look at. Do the authors refer to Figure 5 (right) here? If so, I don’t see an especially narrow distribution at MAS station (unless I get confused with nearby stations); instead, other nearby stations like IVA show a yet narrower distribution.
- In the context of the discussion of the coast effect (L193), comment that the distributions of dHint/dt at DON and RVK have a significant component perpendicular to the coast.
- Section 4.2.1: I suggest removing the discussion on how you have achieved the mean direction of dH/dt here. This has been defined in Section 2.2 (Methods section). Move the mention of the Davis (2002) method to section 2.2.
- L234: Figure 3, panel 4)
- Section 4.5: The reader is left with the idea that, despite the efforts made in this manuscript, forecasting GIC is still an equally distant undertaking. Do they really want to transmit this notion, perhaps in line with the conclusion of Pulkkinen et al., 2006, that “dBx/dt and dBy/dt fluctuations are not even in principle predictable in a deterministic way”? Moreover, please note that forecasting GIC (title) is not equivalent to forecasting dH/dt (first line). Did the authors mean “dH/dt” in the title instead of “GIC”? Also, L151-153 are especially confusing to me. For these reasons, I would recommend either rewriting this section more clearly or consider removing it.
Citation: https://doi.org/10.5194/angeo-2022-4-RC2 -
AC3: 'Reply on RC2', Mirjam Kellinsalmi, 15 Mar 2022
We greatly appreciate these comments. They are extremely helpful in stimulating further discussion in the manuscript. We understand a few chapters in our manuscript need more elaborating, especially we should focus on explaining the significance of the magnetic field separation, and dH/dt relation to GIC. Here are our specific responses (in bold) to the referee comments:
Even if this result is significant in itself, I have serious doubts that it is sufficiently relevant to merit an exclusive publication, especially if this subject has already been investigated by other researchers, who reached similar conclusions, though perhaps using different methods and parameters (Belakhovsky et al., 2018; Weygand et al., 2021, Pulkkinen et al., 2006).
Belakhovsky et al. applied the RB parameter, which describes the variability of a vector in time and space. No characteristic time scales are determined through this analysis. As previously replied to Ref-1, the time scale that Weygand et al. discuss is different from ours. They study the persistence of large time derivative values, whereas we study persistence in magnetic field directions. However, their study provides useful insight, which is relevant also to our manuscript. In the study by Pulkkinen et al., one difference in the methodology is that they consider the magnetometer network as a whole through a structure function, while we study explicitly H and dH/dt at single stations. Overall, they have a similar result using an entirely different method.
Furthermore, the present study is based entirely on reliance on the external/internal separation of the geomagnetic field provided by the SECS technique; however, no assessment is made of the uncertainty of this separation, as the authors themselves acknowledge. For these reasons, I strongly recommend including additional, substantial material based on the following.
Solar wind-magnetosphere-ionosphere interaction creates electric currents in the near-Earth space. The temporally varying "external" magnetic field of these currents drives induction in the conducting ground. The "internal" magnetic field of the induced electric currents is superposed to the external magnetic field, creating the measurable geomagnetic variations. If the driving external geomagnetic variations and a detailed model of the ground conductivity are given, 3D induction modeling can estimate the internal geomagnetic field and the geoelectric field (e.g., Marshalko et al., 2021). The geoelectric field is the driver of GIC in a conductor system, but the amplitude of the GIC is also affected by the parameters of the system.
Study of the characteristics of internal geomagnetic variations provides information on the complicated process of geomagnetic induction. Study of the characteristics of external geomagnetic variations, on the other hand, provides information on the solar wind-magnetosphere-ionosphere interaction. Global simulations typically estimate only this part of the geomagnetic field, and assessment of their abilities in this regard requires understanding of the characteristics of the external geomagnetic variations. Thus, study of the characteristics of both internal and external geomagnetic field can improve our ability to forecast space weather events that cause large GIC. The reliability of the method is discussed more in the specific comments below.
Specific comments:
- The authors argue that their findings are important to the subject of GIC (this word is repeated a number of times along the manuscript) but they do not substantiate this argument based on GIC measurements of any type.
We thank the referee for stimulating a more detailed discussion on the relation between GIC and dB/dt, and of forecasting GIC (and dB/dt). As shown in many previous studies, the temporal behavior of GIC typically follows dB/dt at a nearby location. So, dB/dt is a good proxy. A full modeling requires determination of the geoelectric field and including a model of the conductor system in question, but this is beyond the scope of our manuscript.
Could the authors provide evidence that their conclusions are somehow reflected in GIC measurements? For example, is it expected that the GIC (which depends on the time derivative of the horizontal magnetic field) has a typical lifetime of two minutes, comparable to the directional persistence of dH/dt?
When talking about a typical lifetime of GIC, some care is needed. An obvious choice is to consider the length of events when GIC exceeds a given threshold. The larger the threshold the longer the event. This was noted by Viljanen et al. (2014, Figs. 9-10) who considered the GIC sum in a large grid. Due to the close relation of GIC and dB/dt, we could as well consider the persistence of large dB/dt values. As expected, durations of large dB/dt events are short (e.g., Weygand et al., 2021, cf. comments by Ref-1). The same was also shown by Juusola et al. (2015) in terms of the time derivatives of equivalent currents.
If not, is it because the infrastructures (e.g., power network or oil/gas pipelines) where the GIC is expected to flow have not a preferent direction (e.g., N-S or E-W)?
There seems to be no specific direction to which a conductor system is most sensitive to GIC, at least at higher latitudes such as the IMAGE magnetometer network. Since the directional distribution of the total dH/dt (ext+int) is very scattered then the same holds true for the geoelectric field.
Also, the authors point that the final aim is to forecast GIC. I guess GIC can be predicted by trying to anticipate the ground magnetic variations based on IMF/solar wind observations, along with accurate models of the ground conductivity. Can they specify more clearly how is it expected that the main conclusion of the manuscript (i.e., the “short memory” of the time derivative) helps in this endeavor?
Ironically, our result does not evidently help in deterministic forecasting! We can only agree with Pulkkinen et al. (2006) that dB/dt "fluctuations are not even in principle predictable in a deterministic way; nature sets boundaries for the accuracy with which we can forecast the future"
There is a possibly interesting spin-off concerning simulations. A simulated ground magnetic field and its time derivative should show similar features as the measured field. So we could repeat our analysis for simulated fields and especially check whether the same time scale for dB/dt appears. If not then some fundamental physics is missing in the simulation. As a side note, simulations provide primarily only the external part of the ground field. So a proper reference from measurements is the separated external contribution.
Perhaps they refer to “evaluating a potential GIC risk level by means of the dH/dt proxy” rather than “forecasting GIC”?
Actually not. GIC risk level is obviously very much related to the magnitude of dH/dt (and the geoelectric field). This is a different aspect than trying to understand why dH/dt has a very complex behavior. Citing Pulkkinen et al. (2006, paragraph 42): "The most dramatic change in the observed dynamics occurred in the dBx/dt and dBy/dt fluctuations at temporal scales between 80 < t < 100 s. These scales are naturally linked to corresponding scales in the dynamics of the ionosphere-magnetosphere system. However, the link is all but self-evident and we postpone further speculations to forthcoming investigations." It seems that "the link" is still quite much unsolved.
- The present study is entirely based on the reliance on the external/internal separation of the geomagnetic field provided by the SECS technique;
Even if there are uncertainties in the field separation, the main result concerning the time scale of dH/dt does not change. It could also be determined without the field separation. E.g. Δθ timescale is visible in both, external and internal dH/dt, so it is also visible in the total dH/dt. See attached figure.
however, the effectiveness of this method is subject to different aspects, such as the nature of the primary/secondary sources, the density of ground magnetometers, or the election of the cutoff parameter for the singular values of the singular value decomposition (SVD) typically used in the context of SECS, among others. The authors have ample experience on this technique, so they should be able to provide an estimate of the uncertainty of the modeled magnetic field and of its external/internal separation in particular. I’m not aware of many articles where this important subject is treated, but perhaps the following thesis can help: https://open.uct.ac.za/handle/11427/35593 (see section 7.2). If this implementation is not feasible, I encourage the authors to at least apply the alternative method of field separation they refer to in Section 4.1 in order to assess how much of the separation depends on the method utilized.
In our application of the 2D SECS method, the cutoff parameter for singular values of the singular values decomposition is zero. As a consequence, all components of the observed geomagnetic field are perfectly reproduced at all stations used in the analysis. In this study we do not use interpolated values between stations, so considering the reliability of the solution away from the stations, as is in done in the thesis suggested by the reviewer, would not help. Measurement errors of the magnetometers are also very small. Of course, the separation of the geomagnetic field is not perfect and is affected by the density of the magnetometers as well as the boundary conditions, as discussed by Juusola et al. (2020). Unfortunately, estimating this uncertainty is not at all simple. Implementing another separation method does not affect these sources of error.
The internal part of the separated field has been shown to follow well the known structure of the ground conductivity (Juusola et al., 2020) and correlation between the electrojet currents derived simultaneously from IMAGE and low-orbit satellite have been shown to significantly improve when the separation is carried out (Juusola et al., 2016). These results indicate that the separation should be fairly reliable.
Technical corrections:
- L19: I would suggest: “Space weather events, eventually produced by eruptive phenomena in the Sun, can have harmful effects on Earth, for example via …”
Will be reformulated
- L33: Faraday’s induction law.
Will be reformulated
- Figure 1 is somewhat naïve, and in my opinion unnecessary -just consider my comment as a recommendation. In its place (though perhaps not as Figure 1), I would find more useful to illustrate the concept of Δθ(H) and, if possible, that of Δθ(dH/dt), which is central to this manuscript. I think the horizontal projection of the geomagnetic field can be represented at times t and t + T as two arrows, and then represent the corresponding variation in θ.
We will consider changing this figure.
- L62 “2D SECS”: I guess you have used internal and external nodes for the field separation. Is there a specific designation for this modality to differentiate it from the use of external nodes only (which would be the case to model the total horizontal field when there is no need for external/internal separation)?
We will add a slightly longer description of the 2D SECS method in the manuscript to clarify this point.
- L75: The IMAGE time resolution is 10 s. Does the threshold of 1 nT/s refer to a mean variation computed as 10 nT in those 10 s? If so, I think the authors should state it.
Yes, this is correct, and we will define it more precisely in the text.
- The authors always refer to Bx, By and H whereas section 2.1 specifies that baselines are subtracted from the data using a certain automatic method. In consequence, they work with variations of those quantities. I think this point is important and the nomenclature currently used may give rise to confusion. Properly speaking, the studied quantities are ΔBx, ΔBy and ΔH (where, e.g., ΔH = H – Hb, with Hb the baseline value). I strongly recommend using the deltas before these quantities everywhere.
Ignoring ∆ is a common practice within space physics community, and makes notations a little simpler. We will add a mention of this in the text.
- Table 1, in 2nd line replace H with |ΔH|; and in 4th line replace dH/dt with |dH/dt|.
Will be revised.
- L96: Bx and By should not be in bold face. Idem for caption of Figure 3.
Will be revised.
- L98: Replace dH/dt with |dH/dt|.
Will be revised.
- Caption of Figure 3: I would recommend to state “Figure 3. Plot of different quantities related with the horizontal magnetic field at Tromsø, …”. 4) Amplitude of the time derivative
Will be reformulated.
- L116: No mention is made of stations in Svalbard and surroundings, which do not appear in Figures 4, 5 and Table 2 (and indeed anywhere except for the map in Figure 2). Are they only used for the purpose of the SECS-based external/internal separation?
The Svalbard stations are included in our analysis, e.g. Fig. 13. They were not included in the maps (Fig. 4 & 5) to make the plots easier to read.
- Caption of Table 2. Say the stations are ordered by latitude.
Will be added.
- L124: “… over the years”?
Will be revised.
- Figure 6: The number of data points in SOD for 2017 shows 32443 against the 32436 of Table 2. Isn't that an inconsistency?
Will be checked and corrected.
- Figure 7 and others: I would use “dH/dt” instead of “dH”, as in the text
Will be revised.
- Draw the line corresponding to the even distribution of Δθ in figure 10a.
Will be added.
- L149: Figures 10 and 11 show the standard deviation of …
Will be revised.
- What is the meaning of the last sentence in the paragraph L149 – L153?
Will be explained more clearly.
- L154: Figure 13 is referred before Figure 12. I would recommend following the logical ordering.
Will be revised.
- Figure 8: Show a title for the x- and y-axis for at least one of the subplots, e.g., “MLT (h)” and “# of events”. Also, MLT = 25 sounds bad. Please, place ticks at 0, 12 and 24 h.
Will be revised.
- Figure 9: y-axis is missing a “mean θ” (or equivalent) followed by the station name, e.g., <θ> KIL.
Will be revised.
- Figures 10, 11 and 13: Likewise, y-axis is missing a “Δθ”.
Will be revised.
- Figure 14: y-axis is missing an “R”. Caption: Specify that the bars indicate the std of R.
Will be revised.
- Paragraph L185-189: Only Figure 8 is mentioned, but the fact that the magnetic field is predominantly southward is shown in Figure 9.
Text will be revised to also mention Fig. 9.
- L191-193: Please, refer to a specific figure the reader should look at. Do the authors refer to Figure 5 (right) here? If so, I don’t see an especially narrow distribution at MAS station (unless I get confused with nearby stations); instead, other nearby stations like IVA show a yet narrower distribution.
Attached is Fig. 5 of the manuscript, with MAS and IVA station locations indicated (right). MAS has a more narrow distribution.
- In the context of the discussion of the coast effect (L193), comment that the distributions of dHint/dt at DON and RVK have a significant component perpendicular to the coast
This is a good point, mention of this will be added.
- Section 4.2.1: I suggest removing the discussion on how you have achieved the mean direction of dH/dt here. This has been defined in Section 2.2 (Methods section). Move the mention of the Davis (2002) method to section 2.2.
Will be modified.
- L234: Figure 3, panel 4)
Will be modified.
- Section 4.5: The reader is left with the idea that, despite the efforts made in this manuscript, forecasting GIC is still an equally distant undertaking. Do they really want to transmit this notion, perhaps in line with the conclusion of Pulkkinen et al., 2006, that “dBx/dt and dBy/dt fluctuations are not even in principle predictable in a deterministic way”?
Yes, this is what our results indicate. See also previous comments. We thank the referee for opening the discussion. We will add some further discussion on this in section 4.5.
- Moreover, please note that forecasting GIC (title) is not equivalent to forecasting dH/dt (first line). Did the authors mean “dH/dt” in the title instead of “GIC”? Also, L151-153 are especially confusing to me. For these reasons, I would recommend either rewriting this section more clearly or consider removing it.
Major additions and modifications will be made in this section. See also previous comments.
References
Juusola, L., Kauristie, K., Vanhamäki, H., Aikio, A., and van de Kamp, M. (2016), Comparison of auroral ionospheric and field-aligned currents derived from Swarm and ground magnetic field measurements, J. Geophys. Res. Space Physics, 121, 9256– 9283, doi:10.1002/2016JA022961.
Peer review completion
reset time, about 2 min. We conclude that this result gives insight on the current systems high in Earth’s atmosphere, which are the main driver behind the time derivative’s behavior and GIC formation.