xan/awips2
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

deploy: ea9c4ae42c

Browse source
This commit is contained in:
tiffanycmeyer13 2023-10-12 20:58:41 +00:00
parent 2c70b5e6de
commit cbf5e74fa2
4 changed files with 89 additions and 89 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
edex/distributed-computing/index.html
View file

@ -1075,8 +1075,8 @@
<p>AWIPS makes use of service-oriented architecture to request, process, and serve real-time meteorological data. While originally developed for use on internal NWS forecast office networks, where operational installations of AWIPS could consist of a dozen servers or more, the early Unidata releases were stripped of operations-specific configurations and plugins, and released as a standalone server. This worked, since (at the time) a single EDEX instance with an attached SSD could handle most of NOAAport. However, with GOES-R(16) coming online in 2017, and more gridded forecast models being created at finer temporal and spatial resolutions, there is now a need to distribute the data decoding across multiple machines to handle this firehose of data.</p>
<hr />
<h2 id="unidatas-current-edex-server">Unidata's Current EDEX Server<a class="headerlink" href="#unidatas-current-edex-server" title="Permanent link"></a></h2>
<p>Currently, with our specific EDEX server we use a Database/Request instance that also decodes and ingests a good portion of the data. It handles all data requests from CAVE users, as well as the majority of the decoding and ingesting for data feeds coming down on the LDM. The <strong>radar</strong> data has been specifically exluded (from the decoding and ingest) and it has its own <a href="#ingestdecode-server"><strong>Ingest/Decode Server</strong></a> which is explained in more detail below.</p>
<p>For our EDEX we have designated an instance of the ingest/decoding server to be dedicated to handling the radar data. Our <em>Radar-EDEX</em> recieves and decodes all radar down from the LDM and then stores it back on our main <a href="#databaserequest-server"><strong>Database/Request EDEX</strong></a> in the form of HDF5 data files and PostgreSQL metadata.</p>
<p>Currently, we use a distributed architecture comprised of three machines: 1 <strong>main EDEX</strong> machine and 2 <strong>ancillary EDEX</strong> machines. The main EDEX machine decodes and processes the majority of the data, while serving and storing all of the data. Our two ancillary machines -- one for radar data and one for satellite data -- each decode and process a subset of the data and send it back to the main EDEX for storage and requesting.</p>
<p>The main EDEX is an instance of our <a href="#databaserequest-server">Database and Request Server</a> and more information on our <a href="#ancillary-edex-server-ingestdecode-edex-server">ancillary EDEX machines</a> is below as well.</p>
<hr />
<h2 id="example-installation">Example Installation<a class="headerlink" href="#example-installation" title="Permanent link"></a></h2>
<p>This walkthrough will install different EDEX components on two machines in the XSEDE Jetstream Cloud, the first is used to <strong>store and serve</strong> while the second is used to <strong>ingest and decode</strong> data.</p>

2
search/search_index.json
View file

File diff suppressed because one or more lines are too long

172
sitemap.xml
View file

@ -2,432 +2,432 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>http://unidata.github.io/awips2/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/appendix-acronyms/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/appendix-cots/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/appendix-grid-parameters/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/appendix-wsr88d/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/common-problems/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/educational-resources/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/appendix/maps-database/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/bundles-and-procedures/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/cave-keyboard-shortcuts/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/cave-localization/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/cave-perspectives/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-edit-menus/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-gis-shapefiles/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-gridded-models/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-grids/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-hydro/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-map-resources/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-perspective/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-pointdata-surface-obs/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-radar-tools/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-radar/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-satellite/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-tools/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/d2d-uair/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/goes-16-17-satellite/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/hazard-services-alert/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/hazard-services-create/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/hazard-services-display/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/hazard-services-example/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/hazard-services-settings/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/import-export/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/localization-perspective/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/maps-views-projections/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/ncp-perspective/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/nsharp/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/pgen/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/unused-components/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/cave/warngen/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/dev/awips-development-environment/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/dev/build-datadelivery/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/devguide/data-flow/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/devguide/file-system/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/devguide/linux-tools/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/devguide/regular-expressions/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/archiver/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/case-studies/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-access-plugins/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-distribution-files/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-grids/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-plugins/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-purge/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-radar/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/data-satellite/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/derived-parameters/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/distributed-computing/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/edex-ingest-docker-container/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/edex-users/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/ldm-gempak/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/ldm/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/linux-tools/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/new-grid-grib1-old/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/new-grid/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/edex/settings/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-azure/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-cave-beta-v20/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-cave/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-distributed/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-edex-beta-v20/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/install-edex/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/start-edex/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/install/starting-services/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/pdf/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/awips-grids-and-cartopy/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/derived-parameters/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/map-resources-and-topography/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/maps-database/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/model-sounding-data/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/nexrad-level-3-radar/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/overview/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/python-awips-data-access/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/satellite-imagery/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/surface-obs-plot-metpy/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/python/upper-air-bufr-soundings/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/raytheon/cave_d2d/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
<url>
<loc>http://unidata.github.io/awips2/raytheon/smm/</loc>
<lastmod>2023-10-04</lastmod>
<lastmod>2023-10-12</lastmod>
<changefreq>daily</changefreq>
</url>
</urlset>

BIN
sitemap.xml.gz
View file

Binary file not shown.