grey layout spacer                                                 NEAR REAL-TIME       NOTIFICATIONS       PRODUCTS      
print page
 

Specification of the ASCII data file format -- GOME-2 data

The daily data at coordinates of the measurements by the satellite instrument are delivered in the form of ASCII files, one for each orbit file with spectral data. Measurements of GOME-2 come in principle as one file per orbit, but it happens quite often that files span only a part of an orbit, or even the end of one orbit and the beginning of the next. The data files are delivered via the website as zip-files containing all orbit files of a given day.
See the main Data format specification page
for some general notes on the data formats.
For a given day, the orbits treated are those orbits that have a start time during that day; this is the time mentioned in the name of the data file. The name of the SO2 data files contains the orbit date YYYYMMDD and the start time HHMMSS, both taken from the name of the original measurement file:
   gome2_YYYYMMDD_HHMMSS.dat
These files contain the SO2 slant column data (SCD) and the SO2 vertical column density (VCD) derived with an appropriate air-mass factor, and the cloud cover fraction.
 

File header

Each data file has a header with comment lines (starting with the # mark), giving orbit and analysis information, as well as a list of the data columns. Also given is for format of each data fields, and the full data format for reading the data lines. A typical data file header for data files looks as follows. Some remarks regarding the entries in the file header are given below the file header.

# SO2 column density (DLR/BIRA-IASB)
# ----------------------------------
#
# Product status  : NRT data
# Process version : X.Y
#
# Instrument      : GOME-2
# Orbit date/time : 20100701_003007
# Orbit number    : 19184
#
# Analysis date   : 2010/07/01
# Cloud cover data: GOME-2
# AMF & VCD values: yes
#
# Nr plume heights:  3
# Nr data columns : 47
#
# Data columns                                      [format]
#
# --- Ground pixel data
#     1 = measurement date as YYYYMMDD              [a8]
#     2 = measurement time as HHMMSS.SSS            [1x,a10]
#     3 = pixel id: 0=forward, 3=backscan           [i4]
#   4-7 = pixel corner latitudes                    [4f9.3]
#     8 = pixel center latitude                     [f9.3]
#  9-12 = pixel corner longitudes                   [4f9.3]
#    13 = pixel center longitude                    [f9.3]
#    14 = solar    zenith  angle (SZA) at TOA       [f9.3]
#    15 = viewing  zenith  angle (VZA) at TOA       [f9.3]
#    16 = relative azimuth angle (RAA) at TOA       [f9.3]
#
# --- Slant column data
#    17 = SO2 slant column density (SCDret; in DU)  [f9.3]
#         without background correction
#    18 = SO2 slant column density (SCDbgc; in DU)  [f9.3]
#         with background correction
#
# --- Vertical column data
#    19 = SO2 vertical column density value         [f9.3]
#         used for the notification status (VCDalt; in DU)
#    20 = SO2 column value index (SVI)              [i4]
#         = -1 : no  VCDalt available
#         =  0 : SO2 VCDalt <= 1.5 DU
#         =  1 : SO2 VCDalt >  1.5 DU, no notification issued
#         =  2 : SO2 VCDalt >  1.5 DU, notification issued for state
#    21 = AMF quality index (AQI)                   [i4]
#         = -1 : no AMF calculation selected
#         =  0 : successful AMF calculation
#         = +1 : no cloud cover data available
#         > +1 : error computing AMF
#    22 = AMF profile shape number (1 or 2)         [i4]
#     --- using plume height:  2.5 km above surface
#    23 = SO2 slant column density (SCDtmp; in DU)  [f9.3]
#         with temp./height dependency correction
#    24 = SO2 vertical column density (VCD; in DU)  [f9.3]
#         determined from SCDtmp and AMFtot
#    25 = Total air-mass factor  (AMFtot)           [f9.3]
#    26 = AMF for clear-sky part (AMFclr)           [f9.3]
#    27 = AMF for cloudy part    (AMFcld)           [f9.3]
#     --- using plume height:  6.0 km
#    28 = SO2 slant column density (SCDtmp; in DU)  [f9.3]
#         with temp./height dependency correction
#    29 = SO2 vertical column density (VCD; in DU)  [f9.3]
#         determined from SCDtmp and AMFtot
#    30 = Total air-mass factor  (AMFtot)           [f9.3]
#    31 = AMF for clear-sky part (AMFclr)           [f9.3]
#    32 = AMF for cloudy part    (AMFcld)           [f9.3]
#     --- using plume height: 15.0 km
#    33 = SO2 slant column density (SCDtmp; in DU)  [f9.3]
#         with temp./height dependency correction
#    34 = SO2 vertical column density (VCD; in DU)  [f9.3]
#         determined from SCDtmp and AMFtot
#    35 = Total air-mass factor  (AMFtot)           [f9.3]
#    36 = AMF for clear-sky part (AMFclr)           [f9.3]
#    37 = AMF for cloudy part    (AMFcld)           [f9.3]
#
# --- Cloud and Surface data
#    38 = cloud cover index (CCI)                   [i4]
#         = 0 : no cloud cover data
#         = 1 : clear sky mode
#         = 2 : normal FRESCO mode
#         = 3 : snow/ice FRESCO mode
#         = 4 : missing or invalid FRESCO data
#    39 = cloud fraction                            [f9.3]
#    40 = cloud top pressure (in hPa)               [f9.3]
#    41 = cloud top height   (in km)                [f9.3]
#    42 = cloud top albedo                          [f9.3]
#    43 = surface pressure   (in hPa)               [f9.3]
#    44 = surface elevation  (in km)                [f9.3]
#    45 = surface albedo                            [f9.3]
#
# --- Additional gound pixel data
#    46 = pixel centre inside SAA: 1 = yes, 0 = no  [i4]
#    47 = SO2 flag of pixel:                        [i4]
#         = 0 : success
#         = 1 : SZA > 75 -- processing already limited SZAlimit
#         = 2 and/or 3 : SO2 data not available
#
#
# Full data format: (a8,x,a10,i4,16(f9.3),3(i4),15(f9.3),i4,7(f9.3),2(i4))
#
#

Which is followed by two lines spanning all columns and giving a header to each column. Then follow the data lines themselves. The very end of the file is marked by:

#
# --- end of file.

The first part of the comments gives some general information on the orbit and retrieval. The number of data columns in the file depends on the number of plume heights used for computing the AMF and VCD, hence both these numbers are given here. The first 22 columns are always present. Then follow sets times five lines, one set for each plume height. And the last 9 columns are always present.
 

Remarks

Remarks regarding some of the entries in the above file header:
  • The zenith and azimuth angles (columns 14, 15 and 16) are given at the top-of-atmosphere (TOA) for the centre of the ground pixel.

  • The error value given in column 18 is the error following from the DOAS slant column retrieval. Its value is based on the RMS of the fit between the measured and the fitted spectrum. The chi-square in column 19 is also a measure of the quality of the fit. In fact, these three quantities are all interlinked: chi-square = RMS * RMS, and the relationship between the slant column error and the RMS is assumed to be linear. To assist data users in their analysis, both the slant column error and the chi-square are written to the data file.

  • The "slant column value index" (SVI) in column 20 is meant to give the user a quick look facility on the SO2 slant column value. For more information, see the chapter on the criteria for the notifications on exceptional SO2 concentrations.

  • If an AMF and VCD have been computed, the "AMF quality index" (AQI) in column 21 indicates success of the AMF computation, and if successful the VCD was computed. The relevant AQI values are listed in the file header; more details are given on a separate page.

  • Column 22 gives the number of the profile used for the AMF computation, which depends on the SO2 concentration: '1' for low concentrations, '2' for high concentrations; more details are given on the Air-mass factor using look-up tables info page.

  • In order to compute the AMF, a height must be given of the SO2 plume. As this height is not known automatically, a number of assumed heights are used, in this case three. For each assumed plume hieght, the data file gives five quantities: the SO2 vertical column, an estimate of the error on it (based on the error given in column 18), and the three components of the AMF; more details are given on the Air-mass factor using look-up tables info page.

  • If cloud cover data is included, the "cloud cover index (CCI)" in column 38 in the above example indicates success of this inclusion. The relevant CCI values are listed in the file header; some more details are given on a separate page.

  • Data fields for which no value was (successfully) computed are given the "no data" value -99.
 
Link naar de website van het Federaal Wetenschapsbeleid      grey layout spacer Link naar de Federale Portaalsite
 
TEMIS Home Page  PROMOTE Home Page  O3M SAF Home Page Last update on 14 Mar 2013