#########################################################################
# This README file provides general information regarding the Aeolus data archive (aeolus-dataset)
#
#       This archive is hosted by the SSEC at UW-Madison.
#       This archive is managed by NOAA/NESDIS/STAR. Team members include:
#               Katherine Lukens (STAR, UMD/ESSIC/CISESS)
#               Kevin Garrett (STAR)
#               Kayo Ide (UMD)
#               Ross N. Hoffman (STAR, UMD/ESSIC/CISESS)
#               Hui Liu (STAR, UMD/ESSIC/CISESS)
#
#       For questions, please contact: Dr. Katherine Lukens at katherine.lukens@noaa.gov
#
# Last updated: 2022-09-12	Katherine E. Lukens	NOAA/NESDIS/STAR
#
#########################################################################

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
Size of Archive, as of last update
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

../../aeolus/bufr	=  85 G 
../../aeolus/EE-format	= 821 G
../../aeolus/netcdf	=  19 G

====================================
GENERAL INFORMATION
====================================

Aeolus L2B data files are contained within this archive, and are:
	- Pulled directly from ESA's FTP site (EE-format) or the ECMWF FTP site (BUFR).
	- Saved in a variety of formats, including:
		- BUFR (Binary Universal Form for the Representation of meteorological data)
		- EE-format (Earth Explorer format)
		- NetCDF: 
			- Saved in daily files stratified by Aeolus wind regime as indicated in file name (e.g., Aeolus.L2B.RayClear.1day.20190801.nc)
			- Converted from EE-format, metadata retained.
			- Only data flagged as VALID are converted to NetCDF.
			- Off-orbit profiles are removed prior to format conversion. See /docs/README.Offorbit_Profiles for more information.
			- Duplicate profiles are removed prior to format conversion. See /docs/README.Duplicate_Profiles for more information. 
			- Aeolus QC flag is added based on ESA-recommended QC decisions. See /docs/README.Quality_Controls (from 2020-08-31 Technical Note).

To view NetCDF:
	Type 'ncl_filedump FILENAME' on command line to view metadata information, where FILENAME is the name of the NetCDF file you wish to view.
	Type 'ncview FILENAME' on command line to view variables graphically, where FILENAME is the name of the NetCDF file you wish to view.

Glossary of select terms used in this document:
	{BASELINE}	= Aeolus dataset baseline directory name, used to track processing and other updates
	DD		= day
	{MAIN}		= main Aeolus data archive path
	MM		= month
	YYYY 		= year

====================================
PATHS 
====================================

Aeolus main archive {MAIN}
	on S4-submit:								/scratch/aeolus-dataset
	on S4-bastion: 								/s4scratch/aeolus-dataset

Data Formats
  BUFR
	original (not reprocessed): 						{MAIN}/bufr/original/YYYY/MM/DD
	reprocessed:								{MAIN}/bufr/reprocessed/{BASELINE}/YYYY/MM/DD
	reprocessed, trimmed to +/- 3 hours about cycle 00z,06z,12z,18z:	{MAIN}/bufr/trim3hr/reprocessed/{BASELINE}/YYYY/MM/DD

  EE-format
	original (not reprocessed):						{MAIN}/EE-format/original/YYYY/MM/DD
	reprocessed:								{MAIN}/EE-format/reprocessed/{BASELINE}/YYYY/MM/DD

  NetCDF
	original (not reprocessed):						{MAIN}/netcdf/original/YYYY/MM
	reprocessed:								{MAIN}/netcdf/reprocessed/{BASELINE}/YYYY/MM

====================================
AEOLUS BASELINE INFORMATION
====================================
The following list provides details on Aeolus L2B dataset baselines. Date format in list: YYYY-MM-DD

  Baseline...	Details...

	2B06
		FM-B laser, original dataset
		Applied to 2019-06-28 to 2019-10-31

	2B07 
		FM-B laser, original dataset
		Applied to 2019-10-31 to 2020-04-02

	2B08 
		FM-B laser, original dataset
		Applied to 2020-04-02 to 2020-04-20

	2B10
		FM-B laser
		Usage of M1 mirror temperature correction in L2B processor enabled.
		Regeneration of B09 into B10 completed. (B09 is equivalent to B10.)
		Operational on 2020-04-20
		Also used to reprocess 2019-06-28 to 2019-12-31 (with April 2020 processor versions (L1bP 7.08.2, L2AP 3.10.1, L2BP 3.30.1))

	2B11 
		FM-B laser
		L2B processor v3.40.2
		Operational on 2020-10-08
		Also used to reprocess data for 2019-06 to 2020-10 (with October 2020 processor versions)

	2B12
		FM-B laser
		L2B processor v3.50
		Operational on 2021-05-26

	2B13
		FM-B laser
		L2B processor v3.60
		Operational on 2021-12-06

	2B14
		FM-B laser
		L2B processor v3.70
		Operational on 2022-04-04

        2B15
                FM-B laser
                L2B processor v3.15
                Operational on 2022-09-13

====================================

NOTES
1. 2019-06-16: Start of switch from original laser (Flight Module-A (FM-A)) to backup laser (Flight Module-B (FM-B)) due to FM-A losing power.
2. 2022-10-03: Switched off FM-B. Began process to switch on FM-A.
3. 2022-11-29: Completed switch to FM-A, including commissioning.
4. 2023-04-30: End of Aeolus operations.

#########################################################################