Prepared document w/ Piers.
Objective is to share data in coherent and consistent manner.
Tasks:
Map data level definitions (also need to note degree of public availability as function of data level)
Define procedure for dataset cross-calibration
Standardization of data format, esp. metadata and ancillary data – location, response functions, calibration reports
Define data exchange services – real-time and archival access
Manik: How selecting metadata? IR instruments follow WMO.
Hugh: PRBEM is a good starting point. Often response functions and cal reports (esp. beam results) are not available for distribution.
Jesse: SWx metadata doc at WMO very limited.
Hugh: please send WMO metadata catalog.
Jesse: which level? inside files vs. data mgmt. systems
Hugh: location in files; response functions & cal reports outside files. Rely on pre-launch calibrations, can be changed based on post-launch simulations and cross-calibrations – a living process.
Ingmar: define procedure for selecting reference data set to be used. This would be time-dependent. Cross-calibration should be performed at the lowest level in order to prevent errors in one channel from affecting the entire spectrum in a retrieval
Hugh: this should be a living document.
Assign different parts to different people (2 people per part):
- Map data level definitions: Nagatsuma & TBD
- Define xcal procedure: Ingmar & Juan
- Ancillary data: Jesse & Hugh
- Data Exchange Services: TBD – NOAA or ESA experience?