xan/awips2
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
awips2/index.html
tiffanycmeyer13 1fc441ab3d deploy: 2bf83f06c8
2024-07-25 12:52:10 +00:00

1173 lines
No EOL
35 KiB
HTML
Raw Blame History

<!DOCTYPE html>
<html lang="en" class="no-js">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<meta http-equiv="x-ua-compatible" content="ie=edge">
<meta name="description" content="Documentation for all things AWIPS.">
<link rel="canonical" href="http://unidata.github.io/awips2/">
<meta name="author" content="support-awips@unidata.ucar.edu">
<link rel="shortcut icon" href="./images/favicon.ico">
<meta name="generator" content="mkdocs-1.3.0, mkdocs-unidata-2.0.3">
<title>NSF Unidata AWIPS Manual</title>
<script src="./assets/javascripts/modernizr-e826f8942a.js"></script>
<link rel="stylesheet" href="./assets/stylesheets/application-37fa87ea8f.css">
<link rel="stylesheet" href="./assets/stylesheets/application-624922a329.palette.css">
<link rel="stylesheet" href="https://fonts.googleapis.com/css?family=Roboto:300,400,400i,700|Roboto+Mono">
<style>body,input{font-family:"Roboto","Helvetica Neue",Helvetica,Arial,sans-serif}code,kbd,pre{font-family:"Roboto Mono","Courier New",Courier,monospace}</style>
<link rel="stylesheet" href="https://fonts.googleapis.com/icon?family=Material+Icons">
<link rel="stylesheet" href="css/extra.css">
</head>
<body data-md-color-primary="blue-grey" data-md-color-accent="light-blue">
<svg class="md-svg">
<defs>
<svg xmlns="http://www.w3.org/2000/svg" width="416" height="448" viewBox="0 0 416 448" id="github"><path fill="currentColor" d="M160 304q0 10-3.125 20.5t-10.75 19T128 352t-18.125-8.5-10.75-19T96 304t3.125-20.5 10.75-19T128 256t18.125 8.5 10.75 19T160 304zm160 0q0 10-3.125 20.5t-10.75 19T288 352t-18.125-8.5-10.75-19T256 304t3.125-20.5 10.75-19T288 256t18.125 8.5 10.75 19T320 304zm40 0q0-30-17.25-51T296 232q-10.25 0-48.75 5.25Q229.5 240 208 240t-39.25-2.75Q130.75 232 120 232q-29.5 0-46.75 21T56 304q0 22 8 38.375t20.25 25.75 30.5 15 35 7.375 37.25 1.75h42q20.5 0 37.25-1.75t35-7.375 30.5-15 20.25-25.75T360 304zm56-44q0 51.75-15.25 82.75-9.5 19.25-26.375 33.25t-35.25 21.5-42.5 11.875-42.875 5.5T212 416q-19.5 0-35.5-.75t-36.875-3.125-38.125-7.5-34.25-12.875T37 371.5t-21.5-28.75Q0 312 0 260q0-59.25 34-99-6.75-20.5-6.75-42.5 0-29 12.75-54.5 27 0 47.5 9.875t47.25 30.875Q171.5 96 212 96q37 0 70 8 26.25-20.5 46.75-30.25T376 64q12.75 25.5 12.75 54.5 0 21.75-6.75 42 34 40 34 99.5z"/></svg>
</defs>
</svg>
<input class="md-toggle" data-md-toggle="drawer" type="checkbox" id="drawer">
<input class="md-toggle" data-md-toggle="search" type="checkbox" id="search">
<label class="md-overlay" data-md-component="overlay" for="drawer"></label>
<header class="md-header" data-md-component="header">
<a href=".">
<div class="background-logo" style="background-image:url('./images/cave.png');background-repeat:no-repeat;height:107px">
<nav class="md-header-nav md-grid">
<div class="md-flex">
<div class="md-flex__cell md-flex__cell--shrink">
<a href="http://unidata.github.io/awips2/" title="NSF Unidata AWIPS Manual" class="md-header-nav__button md-logo">
<img src="./images/home.png" width="24" height="24">
</a>
</div>
<div class="md-flex__cell md-flex__cell--shrink">
<label class="md-icon md-icon--menu md-header-nav__button" for="drawer"></label>
</div>
<div class="md-flex__cell md-flex__cell--stretch">
<span class="md-flex__ellipsis md-header-nav__title">
NSF Unidata AWIPS Manual
</span>
</div>
<div class="md-flex__cell md-flex__cell--shrink">
<label class="md-icon md-icon--search md-header-nav__button" for="search"></label>
<div class="md-search" data-md-component="search" role="dialog">
<label class="md-search__overlay" for="search"></label>
<div class="md-search__inner">
<form class="md-search__form" name="search">
<input type="text" class="md-search__input" name="query" required placeholder="Search" autocapitalize="off" autocorrect="off" autocomplete="off" spellcheck="false" data-md-component="query">
<label class="md-icon md-search__icon" for="search"></label>
<button type="reset" class="md-icon md-search__icon" data-md-component="reset">&#xE5CD;</button>
</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search-result" data-md-component="result" data-md-lang-search="" data-md-lang-tokenizer="[\s\-]+">
<div class="md-search-result__meta" data-md-lang-result-none="No matching documents" data-md-lang-result-one="1 matching document" data-md-lang-result-other="# matching documents">
Type to start searching
</div>
<ol class="md-search-result__list"></ol>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="md-flex__cell md-flex__cell--shrink">
<div class="md-header-nav__source">
<a href="https://github.com/Unidata/awips2" title="Go to repository" class="md-source" data-md-source="github">
<div class="md-source__icon">
<svg viewBox="0 0 24 24" width="24" height="24">
<use xlink:href="#github" width="24" height="24"></use>
</svg>
</div>
<div class="md-source__repository">
GitHub
</div>
</a>
</div>
</div>
</div>
</nav>
</header>
<div class="md-container">
<main class="md-main">
<div class="md-main__inner md-grid" data-md-component="container">
<div class="md-sidebar md-sidebar--primary" data-md-component="navigation">
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
<nav class="md-nav md-nav--primary" data-md-level="0">
<label class="md-nav__title md-nav__title--site" for="drawer">
<a href="http://unidata.github.io/awips2/" title="NSF Unidata AWIPS Manual" class="md-nav__button md-logo">
<img src="./images/home.png">
</a>
NSF Unidata AWIPS Manual
</label>
<div class="md-nav__source">
<a href="https://github.com/Unidata/awips2" title="Go to repository" class="md-source" data-md-source="github">
<div class="md-source__icon">
<svg viewBox="0 0 24 24" width="24" height="24">
<use xlink:href="#github" width="24" height="24"></use>
</svg>
</div>
<div class="md-source__repository">
GitHub
</div>
</a>
</div>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item md-nav__item--active">
<input class="md-toggle md-nav__toggle" data-md-toggle="toc" type="checkbox" id="toc">
<label class="md-nav__link md-nav__link--active" for="toc">
Home
</label>
<a href="." title="Home" class="md-nav__link md-nav__link--active">
Home
</a>
<nav class="md-nav md-nav--secondary">
<label class="md-nav__title" for="toc">Table of contents</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="#download-and-install-cave" title="Download and Install CAVE" class="md-nav__link">
Download and Install CAVE
</a>
</li>
<li class="md-nav__item">
<a href="#download-and-install-edex" title="Download and Install EDEX" class="md-nav__link">
Download and Install EDEX
</a>
</li>
<li class="md-nav__item">
<a href="#work-with-python-awips" title="Work with Python-AWIPS" class="md-nav__link">
Work with Python-AWIPS
</a>
</li>
<li class="md-nav__item">
<a href="#license" title="License" class="md-nav__link">
License
</a>
</li>
<li class="md-nav__item">
<a href="#awips-data-in-the-cloud" title="AWIPS Data in the Cloud" class="md-nav__link">
AWIPS Data in the Cloud
</a>
</li>
<li class="md-nav__item">
<a href="#distributed-computing" title="Distributed Computing" class="md-nav__link">
Distributed Computing
</a>
</li>
<li class="md-nav__item">
<a href="#software-components" title="Software Components" class="md-nav__link">
Software Components
</a>
<nav class="md-nav">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#edex" title="EDEX" class="md-nav__link">
EDEX
</a>
</li>
<li class="md-nav__item">
<a href="#cave" title="CAVE" class="md-nav__link">
CAVE
</a>
</li>
<li class="md-nav__item">
<a href="#ldm" title="LDM" class="md-nav__link">
LDM
</a>
</li>
<li class="md-nav__item">
<a href="#edexbridge" title="edexBridge" class="md-nav__link">
edexBridge
</a>
</li>
<li class="md-nav__item">
<a href="#qpid" title="Qpid" class="md-nav__link">
Qpid
</a>
</li>
<li class="md-nav__item">
<a href="#postgresql" title="PostgreSQL" class="md-nav__link">
PostgreSQL
</a>
</li>
<li class="md-nav__item">
<a href="#hdf5" title="HDF5" class="md-nav__link">
HDF5
</a>
</li>
<li class="md-nav__item">
<a href="#pypies" title="PyPIES" class="md-nav__link">
PyPIES
</a>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="install/install-cave/" title="Install CAVE" class="md-nav__link">
Install CAVE
</a>
</li>
<li class="md-nav__item">
<a href="install/install-edex/" title="Install EDEX" class="md-nav__link">
Install EDEX
</a>
</li>
<li class="md-nav__item">
<a href="appendix/common-problems/" title="Common Problems" class="md-nav__link">
Common Problems
</a>
</li>
<li class="md-nav__item md-nav__item--nested">
<input class="md-toggle md-nav__toggle" data-md-toggle="nav-5" type="checkbox" id="nav-5">
<label class="md-nav__link" for="nav-5">
CAVE User Manual
</label>
<nav class="md-nav" data-md-component="collapsible" data-md-level="1">
<label class="md-nav__title" for="nav-5">
CAVE User Manual
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="cave/d2d-perspective/" title="D2D Perspective" class="md-nav__link">
D2D Perspective
</a>
</li>
<li class="md-nav__item">
<a href="cave/maps-views-projections/" title="Maps, Views, Projections" class="md-nav__link">
Maps, Views, Projections
</a>
</li>
<li class="md-nav__item">
<a href="cave/bundles-and-procedures/" title="Displays and Procedures" class="md-nav__link">
Displays and Procedures
</a>
</li>
<li class="md-nav__item">
<a href="cave/localization-perspective/" title="Localization Perspective" class="md-nav__link">
Localization Perspective
</a>
</li>
<li class="md-nav__item">
<a href="cave/nsharp/" title="NSHARP" class="md-nav__link">
NSHARP
</a>
</li>
<li class="md-nav__item">
<a href="cave/warngen/" title="WarnGen Walkthrough" class="md-nav__link">
WarnGen Walkthrough
</a>
</li>
<li class="md-nav__item">
<a href="cave/goes-16-17-satellite/" title="GOES East/West" class="md-nav__link">
GOES East/West
</a>
</li>
<li class="md-nav__item">
<a href="cave/d2d-gis-shapefiles/" title="GIS and Shapefiles" class="md-nav__link">
GIS and Shapefiles
</a>
</li>
<li class="md-nav__item">
<a href="cave/d2d-gridded-models/" title="Volume Browser" class="md-nav__link">
Volume Browser
</a>
</li>
<li class="md-nav__item">
<a href="cave/d2d-all-tools/" title="Tools" class="md-nav__link">
Tools
</a>
</li>
<li class="md-nav__item">
<a href="cave/d2d-edit-menus/" title="Editing Menus" class="md-nav__link">
Editing Menus
</a>
</li>
<li class="md-nav__item">
<a href="cave/cave-localization/" title="Change Localization" class="md-nav__link">
Change Localization
</a>
</li>
<li class="md-nav__item">
<a href="cave/import-export/" title="Import/Export" class="md-nav__link">
Import/Export
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item md-nav__item--nested">
<input class="md-toggle md-nav__toggle" data-md-toggle="nav-6" type="checkbox" id="nav-6">
<label class="md-nav__link" for="nav-6">
EDEX User Manual
</label>
<nav class="md-nav" data-md-component="collapsible" data-md-level="1">
<label class="md-nav__title" for="nav-6">
EDEX User Manual
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="install/start-edex/" title="EDEX Basic Commands" class="md-nav__link">
EDEX Basic Commands
</a>
</li>
<li class="md-nav__item">
<a href="edex/settings/" title="EDEX Settings" class="md-nav__link">
EDEX Settings
</a>
</li>
<li class="md-nav__item">
<a href="edex/distributed-computing/" title="Distributed EDEX" class="md-nav__link">
Distributed EDEX
</a>
</li>
<li class="md-nav__item">
<a href="edex/edex-ingest-docker-container/" title="Docker EDEX" class="md-nav__link">
Docker EDEX
</a>
</li>
<li class="md-nav__item">
<a href="edex/ldm/" title="LDM Feeds" class="md-nav__link">
LDM Feeds
</a>
</li>
<li class="md-nav__item">
<a href="edex/data-distribution-files/" title="Data Distribution Files" class="md-nav__link">
Data Distribution Files
</a>
</li>
<li class="md-nav__item">
<a href="edex/new-grid/" title="Ingest a New Grid" class="md-nav__link">
Ingest a New Grid
</a>
</li>
<li class="md-nav__item">
<a href="edex/data-purge/" title="Purging and Retention" class="md-nav__link">
Purging and Retention
</a>
</li>
<li class="md-nav__item">
<a href="edex/edex-users/" title="Monitor Users" class="md-nav__link">
Monitor Users
</a>
</li>
<li class="md-nav__item">
<a href="edex/data-plugins/" title="Data Plugins" class="md-nav__link">
Data Plugins
</a>
</li>
<li class="md-nav__item">
<a href="edex/case-studies/" title="Archive Case Studies" class="md-nav__link">
Archive Case Studies
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="python/overview/" title="Python-AWIPS" class="md-nav__link">
Python-AWIPS
</a>
</li>
<li class="md-nav__item">
<a href="appendix/educational-resources/" title="Educational Resources" class="md-nav__link">
Educational Resources
</a>
</li>
<li class="md-nav__item">
<a href="dev/awips-development-environment/" title="Development" class="md-nav__link">
Development
</a>
</li>
<li class="md-nav__item md-nav__item--nested">
<input class="md-toggle md-nav__toggle" data-md-toggle="nav-10" type="checkbox" id="nav-10">
<label class="md-nav__link" for="nav-10">
Appendix
</label>
<nav class="md-nav" data-md-component="collapsible" data-md-level="1">
<label class="md-nav__title" for="nav-10">
Appendix
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="appendix/appendix-grid-parameters/" title="AWIPS Grid Parameters" class="md-nav__link">
AWIPS Grid Parameters
</a>
</li>
<li class="md-nav__item">
<a href="appendix/maps-database/" title="Maps Database" class="md-nav__link">
Maps Database
</a>
</li>
<li class="md-nav__item">
<a href="appendix/appendix-acronyms/" title="Acronyms and Abbreviations" class="md-nav__link">
Acronyms and Abbreviations
</a>
</li>
<li class="md-nav__item">
<a href="appendix/appendix-wsr88d/" title="WSR-88D Product Table" class="md-nav__link">
WSR-88D Product Table
</a>
</li>
<li class="md-nav__item">
<a href="cave/cave-keyboard-shortcuts/" title="Keyboard Shortcuts" class="md-nav__link">
Keyboard Shortcuts
</a>
</li>
<li class="md-nav__item">
<a href="raytheon/cave_d2d/" title="Raytheon: CAVE User's Manual" class="md-nav__link">
Raytheon: CAVE User's Manual
</a>
</li>
<li class="md-nav__item">
<a href="raytheon/smm/" title="Raytheon: AWIPS System Manager's Manual" class="md-nav__link">
Raytheon: AWIPS System Manager's Manual
</a>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</div>
</div>
</div>
<div class="md-sidebar md-sidebar--secondary" data-md-component="toc">
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
<nav class="md-nav md-nav--secondary">
<label class="md-nav__title" for="toc">Table of contents</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="#download-and-install-cave" title="Download and Install CAVE" class="md-nav__link">
Download and Install CAVE
</a>
</li>
<li class="md-nav__item">
<a href="#download-and-install-edex" title="Download and Install EDEX" class="md-nav__link">
Download and Install EDEX
</a>
</li>
<li class="md-nav__item">
<a href="#work-with-python-awips" title="Work with Python-AWIPS" class="md-nav__link">
Work with Python-AWIPS
</a>
</li>
<li class="md-nav__item">
<a href="#license" title="License" class="md-nav__link">
License
</a>
</li>
<li class="md-nav__item">
<a href="#awips-data-in-the-cloud" title="AWIPS Data in the Cloud" class="md-nav__link">
AWIPS Data in the Cloud
</a>
</li>
<li class="md-nav__item">
<a href="#distributed-computing" title="Distributed Computing" class="md-nav__link">
Distributed Computing
</a>
</li>
<li class="md-nav__item">
<a href="#software-components" title="Software Components" class="md-nav__link">
Software Components
</a>
<nav class="md-nav">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#edex" title="EDEX" class="md-nav__link">
EDEX
</a>
</li>
<li class="md-nav__item">
<a href="#cave" title="CAVE" class="md-nav__link">
CAVE
</a>
</li>
<li class="md-nav__item">
<a href="#ldm" title="LDM" class="md-nav__link">
LDM
</a>
</li>
<li class="md-nav__item">
<a href="#edexbridge" title="edexBridge" class="md-nav__link">
edexBridge
</a>
</li>
<li class="md-nav__item">
<a href="#qpid" title="Qpid" class="md-nav__link">
Qpid
</a>
</li>
<li class="md-nav__item">
<a href="#postgresql" title="PostgreSQL" class="md-nav__link">
PostgreSQL
</a>
</li>
<li class="md-nav__item">
<a href="#hdf5" title="HDF5" class="md-nav__link">
HDF5
</a>
</li>
<li class="md-nav__item">
<a href="#pypies" title="PyPIES" class="md-nav__link">
PyPIES
</a>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</div>
</div>
</div>
<div class="md-content">
<article class="md-content__inner md-typeset">
<a href="https://github.com/Unidata/awips2/edit/unidata_20.3.2/docs/index.md" title="Edit this page" class="md-icon md-content__icon">&#xE3C9;</a>
<h1 id="nsf-unidata-awips-manual">NSF Unidata AWIPS Manual<a class="headerlink" href="#nsf-unidata-awips-manual" title="Permanent link"></a></h1>
<p><a href="https://www.unidata.ucar.edu/software/awips2">https://www.unidata.ucar.edu/software/awips2</a> </p>
<hr />
<p>The Advanced Weather Interactive Processing System (AWIPS) is a meteorological software package. It is used for decoding, displaying, and analyzing data, and was originally developed for the National Weather Service (NWS) by Raytheon. There is a division here at UCAR called the NSF Unidata Program Center (UPC) which develops and supports a modified non-operational version of AWIPS for use in research and education by <a href="http://president.ucar.edu/governance/members/universities-representatives">UCAR member institutions</a>. This is released as open source software, free to download and use by anyone.</p>
<p>AWIPS takes a unified approach to data ingest, where most data ingested into the system comes through the <a href="#ldm">LDM</a> client pulling data feeds from the <a href="https://www.unidata.ucar.edu/projects/#idd">NSF Unidata IDD</a>*. Various raw data and product files (netCDF, grib, BUFR, ASCII text, gini, AREA) are decoded and stored as HDF5 files and Postgres metadata by <a href="install/install-edex">EDEX</a>, which serves products and data over http.</p>
<blockquote>
<p><strong>*Note</strong>: Access to Unidata's IDD data feed is accessible by the University community but is not available to the public freely.</p>
</blockquote>
<p>We support two data visualization frameworks: <a href="install/install-cave">CAVE</a> (an Eclipse-built Java application which runs on Linux, Mac, and Windows), and <a href="python/overview">python-awips</a> (a python package).</p>
<blockquote>
<p><strong>Note</strong>: Our version of CAVE is a <strong>non-operational</strong> version. It does not support some features of NWS AWIPS. Warnings and alerts cannot be issued from our builds of CAVE. Additional functionality may not be available as well.</p>
</blockquote>
<p><img alt="CAVE" src="images/Unidata_AWIPS2_CAVE.png" /></p>
<hr />
<h2 id="download-and-install-cave"><a href="install/install-cave">Download and Install CAVE</a><a class="headerlink" href="#download-and-install-cave" title="Permanent link"></a></h2>
<hr />
<h2 id="download-and-install-edex"><a href="install/install-edex">Download and Install EDEX</a><a class="headerlink" href="#download-and-install-edex" title="Permanent link"></a></h2>
<hr />
<h2 id="work-with-python-awips"><a href="python/overview">Work with Python-AWIPS</a><a class="headerlink" href="#work-with-python-awips" title="Permanent link"></a></h2>
<hr />
<h2 id="license">License<a class="headerlink" href="#license" title="Permanent link"></a></h2>
<p>NSF Unidata AWIPS source code and binaries (RPMs) are considered to be in the public domain, meaning there are no restrictions on any download, modification, or distribution in any form (original or modified). NSF Unidata AWIPS license information can be found <a href="https://github.com/Unidata/awips2/blob/unidata_18.2.1/LICENSE">here</a>.</p>
<hr />
<h2 id="awips-data-in-the-cloud">AWIPS Data in the Cloud<a class="headerlink" href="#awips-data-in-the-cloud" title="Permanent link"></a></h2>
<p>NSF Unidata and XSEDE Jetstream have partnered to offer an EDEX data server in the cloud, open to the community. Select the server in the Connectivity Preferences dialog, or enter <strong><code>edex-cloud.unidata.ucar.edu</code></strong> (without <em>http://</em> before, or <em>:9581/services</em> after).</p>
<p><img alt="EDEX in the cloud" src="images/connectWindow.png" /></p>
<hr />
<h2 id="distributed-computing">Distributed Computing<a class="headerlink" href="#distributed-computing" title="Permanent link"></a></h2>
<p>AWIPS makes use of service-oriented architecture to request, process, and serve real-time meteorological data. Because AWIPS was originally developed for use on internal NWS forecast office networks, where operational installations of AWIPS can consist of a dozen servers or more, we have modified the package to be more applicable in the University setting. Our releases of AWIPS are stripped of operation-specific configurations and plugins. Originally, our EDEX installations were released specifically for standalone installation. This made sense given that a single EDEX instance with a Solid State Drive (SSD) could handle most of the entire NOAAport data volume. However, with GOES-R(16) now online, and more gridded forecast models being created at finer temporal and spatial resolutions, there was a need to distribute EDEX data decoding in order to handle this firehose of data.</p>
<ul>
<li>Read More: <a href="edex/distributed-computing">Distributed EDEX</a></li>
</ul>
<hr />
<p><img style="float:right;width:450px;" src="images/awips2_coms.png"></p>
<h2 id="software-components">Software Components<a class="headerlink" href="#software-components" title="Permanent link"></a></h2>
<ul>
<li><a href="#edex">EDEX</a></li>
<li><a href="#cave">CAVE</a></li>
<li><a href="#ldm">LDM</a></li>
<li><a href="#edexbridge">edexBridge</a></li>
<li><a href="#qpid">Qpid</a></li>
<li><a href="#postgresql">PostgreSQL</a></li>
<li><a href="#hdf5">HDF5</a></li>
<li><a href="#pypies">PyPIES</a></li>
</ul>
<h3 id="edex">EDEX<a class="headerlink" href="#edex" title="Permanent link"></a></h3>
<p>The main server for AWIPS. Qpid sends alerts to EDEX when data stored by the LDM is ready for processing. These Qpid messages include file header information which allows EDEX to determine the appropriate data decoder to use. The default ingest server (simply named ingest) handles all data ingest other than grib messages, which are processed by a separate ingestGrib server. After decoding, EDEX writes metadata to the database via Postgres and saves the processed data in HDF5 via PyPIES. A third EDEX server, request, feeds requested data to CAVE clients. EDEX ingest and request servers are started and stopped with the commands <code>edex start</code> and <code>edex stop</code>, which runs the system script <code>/etc/rc.d/init.d/edex_camel</code></p>
<ul>
<li><a href="install/install-edex">Read More: How to Install EDEX</a></li>
</ul>
<h3 id="cave">CAVE<a class="headerlink" href="#cave" title="Permanent link"></a></h3>
<p>Common AWIPS Visualization Environment. The data rendering and visualization tool for AWIPS. CAVE contains of a number of different data display configurations called perspectives. Perspectives used in operational forecasting environments include <strong>D2D</strong> (Display Two-Dimensional), <strong>GFE</strong> (Graphical Forecast Editor), and <strong>NCP</strong> (National Centers Perspective). CAVE is started with the command <code>/awips2/cave/cave.sh</code> or <code>cave.sh</code></p>
<ul>
<li><a href="install/install-cave">Read More: How to Install CAVE</a></li>
</ul>
<h3 id="ldm">LDM<a class="headerlink" href="#ldm" title="Permanent link"></a></h3>
<p><a href="https://www.unidata.ucar.edu/software/ldm/">https://www.unidata.ucar.edu/software/ldm/</a></p>
<p>The <strong>LDM</strong> (Local Data Manager), developed and supported by NSF Unidata, is a suite of client and server programs designed for data distribution, and is the fundamental component comprising the NSF Unidata Internet Data Distribution (IDD) system. In AWIPS, the LDM provides data feeds for grids, surface observations, upper-air profiles, satellite and radar imagery and various other meteorological datasets. The LDM writes data directly to file and alerts EDEX via Qpid when a file is available for processing. The LDM is started and stopped with the commands <code>edex start</code> and <code>edex stop</code>, which runs the commands <code>service edex_ldm start</code> and <code>service edex_ldm stop</code></p>
<h3 id="edexbridge">edexBridge<a class="headerlink" href="#edexbridge" title="Permanent link"></a></h3>
<p>edexBridge, invoked in the LDM configuration file <code>/awips2/ldm/etc/ldmd.conf</code>, is used by the LDM to post "data available" messaged to Qpid, which alerts the EDEX Ingest server that a file is ready for processing.</p>
<h3 id="qpid">Qpid<a class="headerlink" href="#qpid" title="Permanent link"></a></h3>
<p><a href="http://qpid.apache.org">http://qpid.apache.org</a></p>
<p><strong>Apache Qpid</strong>, the Queue Processor Interface Daemon, is the messaging system used by AWIPS to facilitate communication between services. When the LDM receives a data file to be processed, it employs <strong>edexBridge</strong> to send EDEX ingest servers a message via Qpid. When EDEX has finished decoding the file, it sends CAVE a message via Qpid that data are available for display or further processing. Qpid is started and stopped by <code>edex start</code> and <code>edex stop</code>, and is controlled by the system script <code>/etc/rc.d/init.d/qpidd</code></p>
<h3 id="postgresql">PostgreSQL<a class="headerlink" href="#postgresql" title="Permanent link"></a></h3>
<p><a href="http://www.postgresql.org">http://www.postgresql.org</a></p>
<p><strong>PostgreSQL</strong>, known simply as Postgres, is a relational database management system (DBMS) which handles the storage and retrieval of metadata, database tables and some decoded data. The storage and reading of EDEX metadata is handled by the Postgres DBMS. Users may query the metadata tables by using the termainal-based front-end for Postgres called <strong>psql</strong>. Postgres is started and stopped by <code>edex start</code> and <code>edex stop</code>, and is controlled by the system script <code>/etc/rc.d/init.d/edex_postgres</code></p>
<h3 id="hdf5">HDF5<a class="headerlink" href="#hdf5" title="Permanent link"></a></h3>
<p><a href="http://www.hdfgroup.org/HDF5/">http://www.hdfgroup.org/HDF5/</a></p>
<p><a href="http://www.hdfgroup.org/HDF5/"><strong>Hierarchical Data Format (v.5)</strong></a> is the primary data storage format used by AWIPS for processed grids, satellite and radar imagery and other products. Similar to netCDF, developed and supported by NSF Unidata, HDF5 supports multiple types of data within a single file. For example, a single HDF5 file of radar data may contain multiple volume scans of base reflectivity and base velocity as well as derived products such as composite reflectivity. The file may also contain data from multiple radars. HDF5 data is stored on the EDEX server in <code>/awips2/edex/data/hdf5/</code>.</p>
<h3 id="pypies">PyPIES<a class="headerlink" href="#pypies" title="Permanent link"></a></h3>
<p><strong>PyPIES</strong>, Python Process Isolated Enhanced Storage, (httpd-pypies) was created for AWIPS to isolate the management of HDF5 Processed Data Storage from the EDEX processes. PyPIES manages access, i.e., reads and writes, of data in the HDF5 files. In a sense, PyPIES provides functionality similar to a DBMS (i.e PostgreSQL for metadata); all data being written to an HDF5 file is sent to PyPIES, and requests for data stored in HDF5 are processed by PyPIES.</p>
<p>PyPIES is implemented in two parts: 1. The PyPIES manager is a Python application that runs as part of an Apache HTTP server, and handles requests to store and retrieve data. 2. The PyPIES logger is a Python process that coordinates logging. PyPIES is started and stopped by <code>edex start</code> and <code>edex stop</code>, and is controlled by the system script <code>/etc/rc.d/init.d/httpd-pypies</code>.</p>
</article>
</div>
</div>
</main>
<footer class="md-footer">
<div class="md-footer-nav">
<nav class="md-footer-nav__inner md-grid">
<a href="install/install-cave/" title="Install CAVE" class="md-flex md-footer-nav__link md-footer-nav__link--next" rel="next">
<div class="md-flex__cell md-flex__cell--stretch md-footer-nav__title">
<span class="md-flex__ellipsis">
<span class="md-footer-nav__direction">
Next
</span>
Install CAVE
</span>
</div>
<div class="md-flex__cell md-flex__cell--shrink">
<i class="md-icon md-icon--arrow-forward md-footer-nav__button"></i>
</div>
</a>
</nav>
</div>
<div class="md-footer-meta md-typeset">
<div class="md-footer-meta__inner md-grid">
<div class="md-footer-copyright">
<div class="md-footer-copyright__highlight">
Copyright &copy; 2023 NSF Unidata Program Center.
</div>
powered by
<a href="http://www.mkdocs.org" title="MkDocs">MkDocs</a>
and
<a href="http://squidfunk.github.io/mkdocs-material/" title="Material for MkDocs">
Material for MkDocs</a>
</div>
<div class="md-footer-social">
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css">
<a href="https://www.unidata.ucar.edu/software/awips2" class="md-footer-social__link fa fa-globe"></a>
<a href="https://github.com/Unidata/awips2" class="md-footer-social__link fa fa-github-alt"></a>
<a href="https://twitter.com/Unidata" class="md-footer-social__link fa fa-twitter"></a>
<a href="https://facebook.com/Unidata" class="md-footer-social__link fa fa-facebook"></a>
</div>
</div>
</div>
</footer>
</div>
<script src="./assets/javascripts/application-eaeb7b21e3.js"></script>
<script>app.initialize({url:{base:"."}})</script>
</body>
</html>
Reference in a new issue View git blame Copy permalink