Merge pull request #686 from tiffanycmeyer13/unidata_20.3.2

GOES Documentation Updates

docs/cave/goes-16-17-satellite.md

@@ -1,24 +1,34 @@
-# GOES 16/17
+# GOES East/West Satellite Products
 
-The ***goesr*** EDEX decoder supports the ingest of GOES products coming over NOAAPort and Unidata's IDD. These include [**single channel imagery**](#individual-channels), [**derived products**](#derived-products) (Level 2b netCDF files), gridded [**Geostationary Lightning Mapper**](#geostationary-lightning-mapper-glm) (GLM) products (produced by Eric Bruning at Texas Tech), [**CIRA created RGB**](#cira-geocolor) specific products, and [**vertical temperature/moisture profiles**](#vertical-temperature-and-moisture-profile). Using derived parameters, additional [**RGB**](#rgb-composites) and [**channel difference**](#channel-differences) products can be loaded. The ***dmw*** EDEX decoder supports the ingest of GOES [**derived motion winds**](#derived-motion-winds).
+The ***goesr*** EDEX plugin decoder supports the ingest of GOES products coming over NOAAPort and NSF Unidata's IDD. These products include:
+- [single channel imagery](#individual-channels)
+- [derived products](#derived-products) (Level 2b netCDF files)
+- [CIRA created RGB](#cira-geocolor) specific products
+- [vertical temperature/moisture profiles](#vertical-temperature-and-moisture-profile). 
+- Using derived parameters, additional [RGB](#rgb-composites) and [channel difference](#channel-differences) products can be loaded.
+
+The ***dmw*** EDEX plugin decoder supports the ingest of GOES:
+  - [derived motion winds](#derived-motion-winds)
+  - [Geostationary Lightning Mapper](#geostationary-lightning-mapper-glm) (GLM) gridded products
+  - GLM Parallax corrected Flash Points
 
 ![](../images/GOESEW.png)
 
-GOES East and West products are accessible in the **Satellite** menu.  The menu is broken into sections starting with common CONUS GOES East/West Combo products. There are submenus for each of the separate geospatial sectors:
+GOES East and West products are accessible from the **Satellite** menu.  The menu is broken into sections starting with common CONUS GOES East/West Combo products. There are submenus for each of the separate geospatial sectors:
 
-* East Full Disk
 * East CONUS
+* East Full Disk
 * East Mesoscale Sectors (x2)
-* West Full Disk
 * West CONUS
+* West Full Disk
 * West Mesoscale Sectors (x2)
-* Hawaii
+* GOES OCONUS
   * Alaska
   * Puerto Rico
   
-Each sector submenu has products for individual channels and vertical profiles, as well as submenus for derived products, channel differences, RGB Composites, GLM data, and derived motion winds. GLM data can also be found with its own submenu option a little lower down the menu and under the **Surface** menu.
-
-!!! warning "The RGB products are not available on MacOS or in a Virtual Machine running CAVE."
+Each sector submenu has products for individual channels and vertical profiles, as well as submenus for derived products, channel differences, RGB Composites, GLM data, and derived motion winds where applicable. Additional documentation on specific products and quick guides can be found:
+  - [CIMSS Quick Guides](https://cimss.ssec.wisc.edu/goes/GOESR_QuickGuides.html)
+  - [CIRA Reference Material](https://rammb2.cira.colostate.edu/training/visit/quick_reference/#tab17)
 
 ![](../images/satelliteMenuNew.png)
 
@@ -26,7 +36,7 @@ Each sector submenu has products for individual channels and vertical profiles,
 
 ## LDM Pattern Actions
 
-The Unidata IDD redistributes both the NOAAPort/SBN GOES tiled products as well as stitched together GOES products. While AWIPS can decode and ingest both, it's important to only be requesting from one or the other so you aren't creating duplicate processing.  The entries that should be used for GOES data are shown below which is found in the LDM's pqact.conf file, located in `/awips2/ldm/etc`.   (For the full list of pqact entries, you can view [this](https://github.com/Unidata/awips2/blob/unidata_18.2.1/rpms/awips2.upc/Installer.ldm/patch/etc/pqact.goesr) file).
+NSF Unidata's IDD redistributes both the NOAAPort/SBN GOES tiled products as well as stitched together GOES products. While our AWIPS can decode and ingest both, it's important to only be requesting from one or the other so you aren't creating duplicate processing.  The entries that should be used for GOES data are shown below which is found in the LDM's pqact.conf.priority file, located in `/awips2/ldm/etc`.   (For the full list of pqact entries, you can view [this](https://github.com/Unidata/awips2/blob/unidata_20.3.2/rpms/awips2.upc/Installer.ldm/patch/etc/pqact.goesr) file).
 
     # GOES 16/17 Single Channel (ABI) via Unidata IDD
     NIMAGE	^/data/ldm/pub/native/satellite/GOES/([^/]*)/Products/CloudAndMoistureImagery/([^/]*)/([^/]*)/([0-9]{8})/([^/]*)(c[0-9]{7})(..)(.....).nc
@@ -34,13 +44,9 @@ The Unidata IDD redistributes both the NOAAPort/SBN GOES tiled products as well
 
     # GOES 16/17 derived products + derived motion wind via SBN
     HDS	^(IXT.[8-9]9) (KNES) (..)(..)(..)
-        FILE	-close -edex	/awips2/data_store/GOES/(\3:yyyy)(\3:mm)\3/\4/derivedProducts-SBN/\1_KNES_\2\3\4\5-(seq)
+	    FILE	-close -edex	/awips2/data_store/GOES/(\3:yyyy)(\3:mm)\3/\4/derived-SBN/\1_KNES_\2\3\4\5-(seq)
     NOTHER	^(IXT[WXY]01) (KNES) (..)(..)(..)
-        FILE	-close -edex	/awips2/data_store/GOES/(\3:yyyy)(\3:mm)\3/\4/derivedProducts-SBN/\1_KNES_\2\3\4\5-(seq)
-    
-    # GOES 16 GLM Gridded Products via Texas Tech-->Unidata IDD 
-    NIMAGE	^/data/ldm/pub/native/satellite/GOES/([^/]*)/Products/GeostationaryLightningMapper/([^/]*)/([0-9]{8})/([^/]*)(c[0-9]{7})(..)(.....).nc
-        FILE	-close -edex	/awips2/data_store/GOES/\3/\6/GLM-IDD/\4\5\6\7.nc4
+	    FILE	-close -edex	/awips2/data_store/GOES/(\3:yyyy)(\3:mm)\3/\4/derived-SBN/\1_KNES_\2\3\4\5-(seq)
     
     # GOES CIRA derived products 
     NIMAGE	^/data/ldm/pub/native/satellite/GOES/([^/]*)/Products/GeoColor/([^/]*)/([^/]*)/([0-9]{8})/([^/]*)(c[0-9]{7})(..)(.....).nc
@@ -50,17 +56,36 @@ The Unidata IDD redistributes both the NOAAPort/SBN GOES tiled products as well
     NIMAGE	^/data/ldm/pub/native/satellite/GOES/([^/]*)/Products/CloudSnow/([^/]*)/([^/]*)/([0-9]{8})/([^/]*)(c[0-9]{7})(..)(.....).nc
         FILE	-close -edex	/awips2/data_store/GOES/\4/\7/CIRA/CloudSnow/\5\6\7\8.nc4
 
+    #GOES GLM Stitched gridded products via ISatSS
+    SPARE|NIMAGE	^/data/ldm/pub/native/satellite/GOES/([^/]*)/Products/GLMISatSS/Level[23]/([^/]*)/([0-9]{8})/(OR_GLM-L[23]-GLMF-M6_G(..)_s(.......)(..).*)
+        FILE	-close -edex	/awips2/data_store/GOES/\3/\7/GLMISatSS-Stitched/\4
 ---
 
 ## Individual Channels
 
 All geospatial sectors have 16 individual channel products that can be viewed.  Below are samples of Channel 14 (11.20μm) for each of the sectors.
+  - Channel 1 (0.47μm)
+  - Channel 2 (0.64μm)
+  - Channel 3 (0.86μm)
+  - Channel 4 (1.38μm)
+  - Channel 5 (1.61μm)
+  - Channel 6 (2.25μm)
+  - Channel 7 (3.90μm)
+  - Channel 8 (6.19μm)
+  - Channel 9 (6.95μm)
+  - Channel 10 (7.34μm)
+  - Channel 11 (8.50μm)
+  - Channel 12 (9.61μm)
+  - Channel 13 (10.35μm)
+  - Channel 14 (11.20μm)
+  - Channel 15 (12.30μm)
+  - Channel 16 (13.30μm)
 
-### East CONUS 1km
+### East CONUS
 
 ![](../images/goes-econus.png)
 
-### East Full Disk 6km
+### East Full Disk
 
 ![](../images/goes-efd.png)
 
@@ -70,7 +95,7 @@ Two floating mesoscale sectors (location will vary day to day from image shown)
 
 ![](../images/goes-emeso12.png)
 
-### West CONUS 1km
+### West CONUS
 
 ![](../images/goes-wconus.png)
 
@@ -88,10 +113,6 @@ Two floating mesoscale sectors (location will vary day to day from image shown)
 
 ![](../images/goes-ak.png)
 
-### Hawaii
-
-![](../images/goes-hi.png)
-
 ### Puerto Rico (PRREGI)
 
 ![](../images/goes-pr.png)
@@ -100,16 +121,20 @@ Two floating mesoscale sectors (location will vary day to day from image shown)
 
 ## RGB Composites
 
-RGB Composites are made by combining 3 channels and are available for each sector. Quite a few new RGB products have been added in Unidata's 18.2.1 release. These products are generated **on the fly in AWIPS** using the existing channel products from EDEX.
+RGB Composites are made by combining 3 channels (including derived parameter calculated channels) and are available for each sector. RGB products are always being added and updated. These products are generated **on the fly in AWIPS** and typically take a little bit of extra time to load.
 
 !!! warning "GOES RGB Imagery is NOT SUPPORTED on macOS or within a Virtual Machine"
 
 	OpenGL Shading Language limitations prevent multi-channel imagery from displaying correctly on Mac or in a Virtual Machine.  Please use the Linux or Windows installs to view RGB products.
 
-### Day Cloud Phase
+### Day Cloud Phase Distinction
 
 ![](../images/RGB-01-DayCloudPhase.png)
 
+### Day Cloud Type
+
+![](../images/RGB-DayCloudType.png)
+
 ### Fire Temperature
 
 ![](../images/RGB-02-FireTemperature.png)
@@ -126,6 +151,10 @@ RGB Composites are made by combining 3 channels and are available for each secto
 
 ![](../images/RGB-05-DayLandCloudFires.png)
 
+### Day Fire
+
+![](../images/RGB-DayFire.png)
+
 ### VIS/IR Sandwich
 
 ![](../images/RGB-06-VISIRSandwich.png)
@@ -134,6 +163,14 @@ RGB Composites are made by combining 3 channels and are available for each secto
 
 ![](../images/RGB-07-SimpleWaterVapor.png)
 
+### Day Rocket Plume
+
+![](../images/RGB-DayRocketPlume.png)
+
+### Night Rocket Plume
+
+![](../images/RGB-NightRocketPlume.png)
+
 ### Air Mass
 
 ![](../images/RGB-08-AirMass.png)
@@ -190,17 +227,21 @@ RGB Composites are made by combining 3 channels and are available for each secto
 
 ![](../images/RGB-21-DaytimeComp5.png)
 
+
+>Note: Additionally there is a submenu for RGB products with Derived Products (DP) readouts
+
 ---
 
 ## Channel Differences
 
 Channel differences are the result of subtracting one channel from another to produce a new product.  These products are generated **on the fly in AWIPS** using the existing channel products from EDEX.
 
-There currently 10 channel differences that are offered in CAVE:
+These are the channel differences currently available in CAVE:
 
 * Split Window (10.3 - 12.3 μm)
 * Split Cloud Top Phase (11.2 - 8.4 μm)
 * Night Fog (10.3 - 2.9 μm)
+* Night Fog (11.2 - 2.9 μm)
 * Day Fog (3.9 - 10.3 μm)
 * Split Fire (2.2 - 1.6 μm)
 * Split Ozone (9.6 - 10.3 μm)
@@ -209,69 +250,84 @@ There currently 10 channel differences that are offered in CAVE:
 * Vegetation (0.64 - 0.87 μm)
 * Upper Level Info (11.2 - 6.19 μm)
 
-!!! note "The rendering of these products uses the **Jep** package in Python, which has specific [install instructions](http://127.0.0.1:8000/install/install-cave/#method-1-direct-windows-install) for Windows."
-
 ---
 
 ## Derived Products
 
-Derived products are also known as **Level 2+** products.  Currently there are only derived products from GOES East available in AWIPS. Each sector has a different set of products available. To find out some more information on some of the products please the [**Quick Guides**](http://rammb.cira.colostate.edu/training/visit/quick_guides/) compiled by CIRA.
+Derived products are also known as **Level 2+** products. Not all sectors have the same set of products available. To find out some more information on some of the products visit the [**Quick Guides**](http://rammb.cira.colostate.edu/training/visit/quick_guides/) compiled by CIRA.
 
-!!! note "These may not all be available for each sector."
+The current products offered in CAVE are listed below and to the right is which GOES East/West sector they are available for (F=Full Disk, C=CONUS, M=Mesoscale):
 
-The current products offered in CAVE are listed below and to the right is which GOES East sector they are available for (F=Full Disk, C=CONUS, M=Mesoscale):
-
-* Aerosol Detection - F,C,M
-* Aerosol Optical Depth - F,C
-* Clear Sky Mask - F,C,M
-* Cloud Optical Depth - F,C
-* Cloud Particle Size -F,C,M
-* Cloud Top Height -F,C,M
-* Cloud Top Phase -F,C,M
-* Cloud Top Pressure -F,C
-* Cloud Top Temperature - F,M
-* Derived CAPE - F,C,M
-* Derived K-Index - F,C,M
-* Derived Lifted Index - F,C,M
-* Derived Showalter Index - F,C,M
-* Derived Total Totals - F,C,M
-* Fire Area - F,C
-* Fire Power - F,C
-* Fire Temperature - F,C
-* Instrument Flight Rule (IFR) Probability - C
-* Low IFR Probability - C
-* Marginal Visual Flight Rules (MVFR) Probability - C
-* Cloud Thickness - C
-* Land Skin Temperature - F,C,M
-* RR/QPE - F
-* Sea Surface Temperature - F
-* Total Precip Water - F,C,M
+|Derived Product|East|West|
+| ------------- | ---- | ---- |
+|Aerosol Dust Detection High |F,C,M|F,C,M|
+|Aerosol Dust Detection Low|F,C,M|F,C,M|
+|Aerosol Dust Detection Med|F,C,M|F,C,M|
+|Aerosol Optical Depth|F,C|F,C|
+|Aerosol Smoke Detection (High)|F,C,M|F,C,M|
+|Aerosol Smoke Detection (Low)|F,C,M|F,C,M|
+|Aerosol Smoke Detection (Med)|F,C,M|F,C,M|
+|All Cloud Layers|F,C,M|F,C,M|
+|Clear Sky Mask|F,C,M|F,C,M|
+|Cloud Layer Fraction (050-100)|F,C,M|F,C,M|
+|Cloud Layer Fraction (100-180)|F,C,M|F,C,M|
+|Cloud Layer Fraction (180-240)|F,C,M|F,C,M|
+|Cloud Layer Fraction (>=240)|F,C,M|F,C,M|
+|Cloud Layer Fraction (Sfc-050)|F,C,M|F,C,M|
+|Cloud Optical Depth|F,C||
+|Cloud Thickness|C|C|
+|Cloud Top Height|F,C,M|F,C,M|
+|Cloud Top Phase|F,C,M|F,C,M|
+|Cloud Top Pressure|F,C||
+|Cloud Top Temperature|F,M|F,M|
+|Clout Particle Size|F,C,M||
+|Derived CAPE|F,C,M|F,C,M|
+|Derived K-Index|F,C,M|F,C,M|
+|Derived Lifted Index|F,C,M|F,C,M|
+|Derived Showalter Index|F,C,M|F,C,M|
+|Derived Total Totals|F,C,M|F,C,M|
+|Fire Area|F,C,M|F,C,M|
+|Fire Mask|F,C,M|F,C,M|
+|Fire Power|F,C,M|F,C,M|
+|Fire Temp|F,C,M|F,C,M|
+|Fog an Low Stratus (Instrument Flight Rules) |C|C|
+|Fog and Low Stratus (Low Instrument Flight Rules) |C|C|
+|Fog and Low Stratus (Marginal Visual Flight Rules) |C|C|
+|Ice Age Category 3|F|F|
+|Ice Age Category 8|F|F|
+|Ice Concentration|F|F|
+|Ice Mask (Day/Night)|F|F|
+|Ice Surface Temp|F|F|
+|Ice Thickness|F|F|
+|Land Surface Temp|F,C,M|F,C,M|
+|Rainfall Rate/QPE|F|F|
+|Sea Surface Temp (F)|F|F|
+|Sea Surface Temp|F|F|
+|Snow Cover|F|F|
+|Total Cloud Fraction|F,C,M|F,C,M|
+|Total Precip Water|F,C,M|F,C,M|
 
 ---
 
 ## Geostationary Lightning Mapper (GLM)
 
-Dr. Eric Bruning at Texas Tech has taken the raw GLM data and coded up some new gridded products that can be ingested and displayed in AWIPS.
+Currently, the 1-min GLM gridded products are coming over the SBN and operational sites are calculating the 5-min GLM gridded products locally. At NSF Unidata, we are receiving the 1 and 5-min gridded tiles from ISatSS (NWS) on the GOES East and West Full Disk scale, and we're stitching the tiles together locally before redistributing the full domain over our IDD/LDM feed. Current gridded products are available on the GOES East and West Full Disk Sectors:
 
 * Minimum Flash Area
-* Average Flash Area
 * Flash Extent Density
-* Group Extent Density
 * Total Optical Energy
 
+Additionally GLM flash points are available to plot as well. These are parallax corrected locations instead of the raw locations.
 
-GLM data are located in the menu structure: **Satellite** > **[SECTOR]** > **GLM Products**. You can also access the data from  **Surface** > **GLM - Geostationary Lightning Mapper** submenus.
-
-![Satellite GLM Menu](../images/goes-GLMMenu.png)
-
-![Surface GLM Menu](../images/goes-GLMMenu2.png)
+GLM data are located in the menu structure: **Satellite** > **GOES-[East/West] Full Disk** > **GLM Products**.
 
+![Satellite GLM Products](../images/GOES-GLMProducts.png)
 
 ---
 
 ## Derived Motion Winds
 
-Derived Motion Wind Vectors are produced using sequential ABI images and can provide information about winds at different levels. The wind vectors are computed using both visible and infrared imagery. Winds can be plotted by different pressure layers or individual channels. More information can be found [here](http://cimss.ssec.wisc.edu/goes/OCLOFactSheetPDFs/ABIQuickGuide_BaselineDerivedMotionWinds.pdf). Below is an image of the winds at different pressure layers.
+Derived Motion Wind Vectors are produced using sequential CONUS sector goesABI images and can provide information about winds at different levels. The wind vectors are computed using both visible and infrared imagery. Winds can be plotted by different pressure layers or individual channels. More information can be found [here](http://cimss.ssec.wisc.edu/goes/OCLOFactSheetPDFs/ABIQuickGuide_BaselineDerivedMotionWinds.pdf). Below is an image of the winds at different pressure layers.
 
 ![](../images/dmw.png)
 
@@ -279,33 +335,8 @@ Derived Motion Wind Vectors are produced using sequential ABI images and can pro
 
 ## Vertical Temperature and Moisture Profile
 
-Vertical Temperature and Moisture profiles are available in AWIPS. Similar to NUCAPS, when loaded in CAVE, a circle is displayed for each location that has a vertical profile available. When clicking on the circle, NSHARP will open with the vertical temperature and moisture profile. These profiles are GFS data that have been adjusted based on the satellite observations. More information can be found [here](https://rammb.cira.colostate.edu/training/visit/quick_guides/QuickGuide_GOES-R_Legacy_Temperature_Moisture%20Profiles.pdf).
+Vertical Temperature and Moisture profiles are available in AWIPS for the CONUS sectors. Similar to NUCAPS, when loaded in CAVE, a circle is displayed for each location that has a vertical profile available. When clicking on the circle, NSHARP will open with the vertical temperature and moisture profile. These profiles are GFS data that have been adjusted based on the satellite observations. More information can be found [here](https://rammb.cira.colostate.edu/training/visit/quick_guides/QuickGuide_GOES-R_Legacy_Temperature_Moisture%20Profiles.pdf).
 
 ![](../images/goes-VertProfileMap.png)
 
 ![](../images/goes-VertProfileSounding.png)
-
----
-
-## HDF5 Data Store
-
-Decoded GOES satellite data are stored in `/awips2/edex/data/hdf5/satellite/` under sector subdirectories:
-
-    drwxr-xr-x	awips	fxalpha	4096	AKREGI
-    drwxr-xr-x	awips	fxalpha	4096	Antarctic
-    drwxr-xr-x	awips	fxalpha	4096	Arctic
-    drwxr-xr-x	awips	fxalpha	4096	AREA0600
-    drwxr-xr-x	awips	fxalpha	4096	AREA0700
-    drwxr-xr-x	awips	fxalpha	4096	AREA3100
-    drwxr-xr-x	awips	fxalpha	4096	AREA3101
-    drwxr-xr-x	awips	fxalpha	12288	ECONUS
-    drwxr-xr-x	awips	fxalpha	4096	EFD
-    drwxr-xr-x	awips	fxalpha	4096	EMESO-1
-    drwxr-xr-x	awips	fxalpha	4096	EMESO-2
-    drwxr-xr-x	awips	fxalpha	4096	HIREGI
-    drwxr-xr-x	awips	fxalpha	4096	NEXRCOMP
-    drwxr-xr-x	awips	fxalpha	4096	PRREGI
-    drwxr-xr-x	awips	fxalpha	4096	WCONUS
-    drwxr-xr-x	awips	fxalpha	4096	WFD
-    drwxr-xr-x	awips	fxalpha	4096	WMESO-1
-    drwxr-xr-x	awips	fxalpha	4096	WMESO-2

mkdocs.yml

@@ -42,7 +42,7 @@ nav:
   #    - NCP Perspective: cave/ncp-perspective.md
       - NSHARP: cave/nsharp.md
       - WarnGen Walkthrough: cave/warngen.md
-      # - GOES 16/17: cave/goes-16-17-satellite.md
+      - GOES East/West: cave/goes-16-17-satellite.md
       - GIS and Shapefiles: cave/d2d-gis-shapefiles.md
       - Volume Browser: cave/d2d-gridded-models.md
       - Tools: cave/d2d-all-tools.md