Ongoing projects

 

Sensitivity Tests and Performances

of the KLIMA-IASI Forward and Retrieval Models

 

 

The core activity of Phase 1 consisted in the sensitivity study carried out to determine the best trade-offs between accuracy and efficiency of the KLIMA-IASI algorithm, to implement them in a final version of the code, hereafter indicated as KLIMA-IASI Accelerated Retrieval Model (ARM), and to evaluate the ARM performances for the  retrieval of carbon dioxide from IASI radiances.
Two major drivers and the associated requirements oriented the sensitivity study:

 

 

 
  • to obtain ultimate performances for CO2 retrieval from single IASI spectra, in order to limit the extent of spatial and temporal averaging necessary to achieve the level of accuracy required for OCO and GOSAT validation – A target accuracy of 0.3% (1 ppm out of 370 ppm) on regional scales (1000 x 1000 km) at monthly intervals was established, which is consistent with observational requirements of both the NASA and JAXA missions.

     

 

  • to limit the overall size of the program, as well as the computing time required for processing single IASI spectra, in sight of future integration with the ESA G-POD system – We have assumed 1.0 Gbyte as the maximum size allowed for the integration into the G-POD system. The requirement on maximum computing time has been relaxed to 1 day for the iterative retrieval process from single spectrum. Assuming an average number of 4 iterations and a factor of two between the computing times of a forward model run with and without Jacobian calculation, this can be translated into a requirement of maximum computing time allowed for the FM calculation of a single spectrum without Jacobian equal to 180 min.

 

The sensitivity study was carried out in two steps:

 

Sensitivity Tests on KLIMA-IASI Forward Model

A series of approximations was introduced to improve the efficiency of the code and to meet the requirements on program size and computing time. The impact of these approximations on the accuracy of the forward model was evaluated and the results were used for fine-tuning individual choices and implementing an overall procedure optimally suited for the selected target.

 

Sensitivity Tests on KLIMA-IASI Retrieval Model

 

Subsequent sensitivity tests conducted on the ARM version of the KLIMA-IASI code aimed at quantifying the bias on CO2 retrieval products due to the forward model approximations implemented by the trade-off process.

 

KLIMA-IASI upgrades in forward and inverse modeling

 

The main upgrades introduced in the KLIMA-IASI code with respect to the MARC and REFIR retrieval systems concerned:

  • The implementation of a new interface (the pre-processor) between the input data required for the inversion of IASI spectra and the KLIMA-IASI processor (i.e., IASI Level 1b and Level 2 products and auxiliary data)
  • The modifications of the FM and RM modules, aimed at improving the accuracy of the simulation (e.g., use of a band dependant surface emissivity), at modelling the instrumental features of the IASI spectrometer (Instrument Spectral Response Function, Radiometric Noise, Field of View) and at providing, as part of the retrieval products, CO2 column values and errors.

 

Here we focus on the new features of the KLIMA–IASI processor, which are individually described in the following sub-sections.

 

Use of an atmospheric vertical grid expressed in terms of pressure

The stratification of the atmosphere adopted for the RT calculations and the vertical retrieval grid are both expressed in terms of pressure levels. The corresponding altitude levels can be reconstructed from the temperature profile, assuming hydrostatic equilibrium. This choice facilitate the comparison with the assimilated profiles generally provided on a pressure grid (e.g., ECMWF fields, Carbon Tracker model output). Moreover, the pressure grid is independent on the orography of the surface, and the information provided by IASI L2 on the pressure at the Earth surface is sufficient to reconstruct the stratified atmospheric structure.

 

Surface Emissivity

The Earth’s surface emissivity model has been modified, in order to exploit the band dependent emissivity information available from IASI L2 operational products. IASI emissivity values are provided as average values over 12 spectral bands from ~770 cm-1 (13 mm) to ~2777 cm-1 (3.6 mm). The KLIMA-IASI code has been designed to perform forward model calculations over the IASI spectral range subdivided in 47 independent band 45 cm-1 wide. The spectral radiance measured in each band can thus be simulated using the corresponding Earth’s surface emissivity value as obtained from IASI L2 products (whenever a valid IASI L2 emissivity value is not provided, surface emissivity equal to 1 is assumed). A band dependent value of Earth’s surface temperature is accordingly retrieved, when this quantity is included in the state vector.

 

Retrieval of columnar values

Columnar values have been added to the standard output of the inversion process, in order to provide direct access to the information on total and partial columns of the retrieved atmospheric constituents and, in particular, of carbon dioxide. For each retrieved species the KLIMA code outputs the differential column profile on the atmospheric grid on which the forward model performs the radiative transfer calculation. Taking into account the linear relationship between the vertical VMR profile of a species xvmr and the associated profile of differential columns ycolumn, it is straightforward to calculate the VCM of the latter:

ycolumn = J xvcm

 

where J is the Jacobian matrix of the differential column profile with respect to the VMR profile.

If we indicate with VCMy and VCMx the variance-covariance matrix of the differential column and of the VMR profile, respectively, we can write:

 

VCMy = J VCMx JT

 

The total column can be calculated by adding up all the elements of the differential column profile vector (or, for partial columns, of the elements in the pressure range of interest). Correspondingly the VCM of the total column is the sum of all the elements of the differential column VCM. If a multi-target retrieval approach is adopted, including the interfering species as part of the state vector and other uncertainties on FM parameters in the a priori VCM, the VCM of the retrieved products accounts for the total error budget. This property holds also for the VCM of the differential column profile.

 

 

Measurement Space Solution Method

The standard output of the KLIMA-IASI processor provides the set of input data required to perform the calculations of the Measurement Space Solution Method. A detailed descritpion of the method can be found in the paper by (Ceccherini et al., 2009).

 

 

IASI Instrument Spectral Response Function

The IASI Instrument Spectral Response Function (ISRF) may be calculated from the data provided by EUMETSAT, via the UMARF archive, in the file:

 

IASI_SDB_xx_M02_20070705200000Z_20070705200000Z_20070705161317Z_IAST_IASISPECDB.nat

 

As explained in detail in IASI Level 1 product guide, the ISFR depends on the IFOV number, the corner cube direction and on wave number. Figure 1 shows the average ISRF between ±16 cm-1.

Figure 2 shows the standard deviation of the ISRF with respect to the IFOV number, the corner cube direction and averaged on the wave number. The standard deviations are always less than 1%. As a consequence, the dependence on the IFOV number and on the corner cube direction can be neglected, and only the wave number dependence is taken into account by the KLIMA-IASI FM.

figure 1.jpg

Figure 1

IASI ISRF averaged on all the dependences between ± 16 cm-1

 

 

klima_figure 2.jpg

 

Figure 2

Standard deviation of the ISRF with respect to the IFOV number,

the corner cube direction and averaged on the wave number between ± 16 cm-1

 

 

The sounder spectra database provides an undersampled ISRF (typical spectral sampling interval 15 cm-1).

Figure 3 shows some example of the under-sampled ISRF. The associated standard deviations with respect to the IFOV number, the corner cube direction are shown in Figure 4. This figure shows that the standard deviation increases with increasing wave number, but is always less than 3%. These smooth functions can now be used to over-sample every needed wave number. The KLIMA algorithm interpolates the under-sampled ISRF to obtain a frequency dependent ISRF.

 

klima_figure 3.jpg

Figure 3

IASI ISRF provided for 650, 1350, 2055, and 2700 cm-1

 

klima_figure 4.jpg

Figure 4

Standard deviation of the IASI ISRF with respect to the IFOV number,

he corner cube direction related to the wave numbers reported in Figure 3

 

 

IASI Field of View

The IASI Instantaneous Field of View (IFOV) has a diameter of 14.65 mrad, which corresponds to a ground resolution of 12 km at nadir and a satellite altitude of 819 km (see IASI Level 1 Products Guide). For homogenous horizontal atmosphere and homogenous surface, the FOV effect is negligible. In Figure 5 we show the difference between simulated spectral radiance at nadir and at +5 deg from nadir (corresponding to a FOV with ground resolution of 50 km). The difference is compared with the nominal noise of IASI instrument.

 

 

klima_figure 5.jpg

Figure 5

IASI Field of View Effect

 

 

Basic features of KLIMA

forward and inverse models

 

 

The KLIMA algorithm consists of two distinct modules, that can operate independently to produce simulated observations or be combined for inverse processing of real or synthetic data: the Forward Model and the Retrieval Model. The Forward Model (FM) simulates wideband nadir radiances measured at the top of the atmosphere using line-by-line Radiative Transfer (RT) calculation. The code computes the radiance that reaches the instrument, and simulates the instrumental effects. Assuming a uniform layered atmosphere, the RT is implemented using the Curtis-Godson (Houghton, 2002) values of temperature and pressure for each species in each layer. The atmospheric line-shapes are modelled with a modified Voigt profile in which the Lorentz function is replaced with the Van Vleck-Weisskopf function (Van Vleck and Weisskopf, 1945). The spectroscopic database used for the simulations is HITRAN 2004 (Rothman et al., 2005) with recent updates for the air broadened half widths provided by Gordon et al. (2007). The atmospheric continuum is modelled according to the work by Clough et al. (2005) considering the contribution of water vapour lines external to the region of 25 cm-1 from the line centre.

For CO2 a dedicated spectroscopic database and line-shape has been adopted in order to take into account the line-mixing effect (Niro et al., 2005a,b). The retrieval procedure (Carli et al., 2007) is designed as a global-t, multi-target retrieval, based on the constrained Non-linear Least-Square Fit (NLSF) approach: the cost function to be minimized takes into account the a priori information (Optimal Estimation approach) and the Marquardt parameter (Rodgers, 2000). Tsimultaneously he retrieval algorithm enables us to fit the wideband spectrum to find more quantities (multi-target retrieval) in order to best account for the errors due to the interfering unknowns. Alternatively, the systematic effects can be taken into account using the complete variance-covariance matrix (VCM) defined as the VCM of the measurement errors plus the VCM of the errors in the estimates of the FM parameters (systematic errors).Von Clarmann et al. (2001) have demonstrated that in a retrieval that converges at the first iteration the two procedures provide the same results for the single target. Retrieval tests have also shown that in the case of strong interferences the non-linear effects become significant and that the properties demonstrated by von Clarmann, which are valid for a single iteration, are no longer verified. In this case, the non-linearities of the inversion problem are better handled by using the multi-target retrieval approach. The results of these tests are in agreement with the conclusions reached by Livesey et al., (2006) who account for the interference of the temperature error in the VCM of the retrieval, but adopt at the same time a two-step retrieval, in order to make sure that a single iteration is sufficient in the second step. Therefore, for the adaptation of the KLIMA algorithms to the processing of IASI data we will implement this second procedure. A procedure that adopts multi-target retrieval for the interfering species and a complete VCM for the other FM uncertainties does reduce the effects of systematic errors (because the retrieval procedure weights the individual measurements according to their total error and correlations) and makes possible the exploitation of broad band measurements (because the systematic errors are no longer a constraint that imposes the use of microwindows).

Heritage of the MARC and REFIR

retrieval codes

The KLIMA algorithm, which has been adapted for processing IASI data, is the Millimetre-Wave Atmospheric Retrieval Code (MARC) (Carli et al., 2007) originally written to analyze the Millimetre-wave Airborne Receiver for Spectroscopic CHaracterization of Atmospheric Limb-Sounding (MARSCHALS) measurements (Oldfield et al., 2001). The MARC software was designed for the analysis of limb-sounding observations in the millimetre-waves and substantial modifications were required to extend its capabilities to the processing of data acquired by passive sensors that operate at higher frequencies and with a different viewing geometry. An upgraded version of the code was implemented and tested for application to the inversion of nadir-sounding observations performed in the middle/far infrared spectral region by the balloon-borne FT spectrometer REFIR-PAD (Palchetti et al., 2007 and Bianchini et al., 2007). The code was used to retrieve temperature and water vapour information by simultaneously fitting the water vapour profile, the temperature profile and the Earth skin brightness temperature using the spectrum from 100 to 1000 cm-1 (Del Bianco et al., 2007). The new features introduced in the MARC code for the analysis of the REFIR-PAD measurements were mostly driven by the need to extend the forward model capabilities to the frequency range (100-1400 cm-1) and to viewing mode (nadir sounding) of the instrument. Accordingly, the MARC code was modified to read the HITRAN database (Rothman et al., 2005 and Gordon et al., 2007), and the related atmospheric continuum was implemented (Clough et al., 2005), while to take into account the CO2 line-mixing a dedicated database and line-by-line cross section routines was used (Niro et al., 2005a,b).

Moreover, the new observation geometry required the implementation of the retrieval of surface temperature. As for the MARC code, the surface was modelled as a black body multiplied by a frequency independent emissivity. Different instrumental features had to be modelled: the side band effects included in the model of the MARSCHALS heterodyne spectrometer were neglected and new pertinent ILS and FOV functions were taken into account. Spectral radiance and frequency units commonly adopted in the millimetre-wave range (Kelvin and GHz, respectively) and used therefore in the original version of the code were modified in the REFIR version, where frequency is expressed in cm-1 and spectral radiance in nW/(cm2 sr cm−1) . The evolution of the MARC code into the version used for the analysis of REFIR spectra constituted the basis for the development of the retrieval code labelled as KLIMA and aimed at processing Level 1 IASI data. The KLIMA-IASI code is the result of further upgrading of both the forward model, to perform accurate and efficient RT calculation taking into account the IASI instrument characteristics, and of the inverse model to retrieve CO2 concentration.

In Table 1 the main differences between the REFIR and IASI instrument are reported.

 

REFIR

IASI

Type of Instrument

Balloonborne FT spectrometer

Spaceborne FT spectrometer

Spectral  Range

100 - 1400 cm-1

645 - 2700 cm-1

Spectral Resolution

0.475 cm-1

0.250 cm-1

Viewing Geometry

Nadir

Nadir ±48.3°

Viewing Altitude

35 km

(stratospheric balloon)

817 km

(MetOp-A satellite)

IFOV

133 mrad

(5 km)

14.65 mrad

(12 km at nadir)

NESR (at 800 cm-1)

200 nW/cm2/cm-1/sr

40 nW/cm2/cm-1/sr

Interferogram

acquisition time

32 s

151 ms

Table 1 - Main differences between REFIR and IASI instruments

In Table 2 the target products retrieved from the two instruments using the KLIMA inversion algorithm are listed.

 

Retrieval Product

REFIR

IASI

Temperature Profile

YES

YES

Water Vapour Profile

YES

YES

Ozone Column

NO

YES

Earth skin temperature

YES

YES

Carbone Dioxide Profile

NO

YES

Table 2 - Main differences between REFIR and IASI target products

 

 

 

 

 

The KLIMA-IASI Retrieval Code

 

 

In this section, a general overview of the KLIMA-IASI prototype software system, as resulting from the adaptation and optimisation work undertaken during Phase 1 of the project, is presented. A brief description of the retrieval code is given, summarizing the basic features of the forward and inverse models. along with the heritage of previously developed codes which have been designed and implemented for different applications. The characteristics of the program, which are directly inherited from existing algorithms, are identified and reference is made to technical documentation and to scientific literature for background information and more detailed description of common choices adopted for forward and inverse modelling by both the KLIMA-IASI and its precursors. The main focus of the section is on the elements of innovation introduced in the KLIMA-IASI retrieval code and on new methodologies that are proposed for both data analysis and diagnostic purposes.