Commit graph

  • 2360baeebf Fix coordinates for UNR main XANTRONIX Industrial 2025-02-22 22:50:07 -05:00
  • 6d784cb100 Rename from nexrad-archive to xmet XANTRONIX Industrial 2025-02-22 13:53:54 -05:00
  • 4f91172984 Fix order XANTRONIX Industrial 2025-02-21 20:46:10 -05:00
  • b1401a86c8 Set AFOS message WFO from product/wfo string XANTRONIX Industrial 2025-02-21 17:17:05 -05:00
  • 902ef26af3 Actually make 'call' primary key for nexrad_radar XANTRONIX Industrial 2025-02-21 17:16:42 -05:00
  • 9badc86e33 Do not attempt to guess zero VTEC timestamps XANTRONIX Industrial 2025-02-21 16:30:47 -05:00
  • 8fb9f67a25 Update nexrad-archive-init to populate nexrad_wfo table XANTRONIX Industrial 2025-02-21 16:30:19 -05:00
  • 3fa26aca83 Implement WFO database table, class XANTRONIX Industrial 2025-02-21 16:29:51 -05:00
  • bbb2a62636 Fix typos in WFO table XANTRONIX Industrial 2025-02-21 16:27:57 -05:00
  • 6d317f4037 Update doc/wfo.tsv with coordinates for every NWS office XANTRONIX Industrial 2025-02-21 15:57:39 -05:00
  • 03b4f3dd55 Rename doc/wfo.txt to wfo.tsv XANTRONIX Industrial 2025-02-21 14:18:47 -05:00
  • d46de60200 Whitespace XANTRONIX Industrial 2025-02-21 02:31:21 -05:00
  • c4458bbd63 Fix VTEC timestamp handling where either part is zero time XANTRONIX Industrial 2025-02-21 02:18:58 -05:00
  • 280845bf27 Make VTEC columns nullable; add nexrad-archive-afos-ingest XANTRONIX Industrial 2025-02-21 00:30:52 -05:00
  • 1876749907 Fully implement parsing of hydrological VTEC events XANTRONIX Industrial 2025-02-21 00:10:49 -05:00
  • 0516b2e48d No longer required XANTRONIX Industrial 2025-02-20 22:30:45 -05:00
  • 584642b61c Fix multi-line polygons XANTRONIX Industrial 2025-02-20 16:38:31 -05:00
  • 77804f5e1d Fix polygon parser bug XANTRONIX Industrial 2025-02-20 13:42:41 -05:00
  • 0aff86bc57 Rename parse_shape() to parse_poly() XANTRONIX Industrial 2025-02-20 13:38:09 -05:00
  • 44bd511347 Further simplify code XANTRONIX Industrial 2025-02-20 13:35:56 -05:00
  • 52978b267f Refactor parser into AFOSMessageParser XANTRONIX Industrial 2025-02-20 12:02:29 -05:00
  • 451a63d067 Anticipate the whims of nerdy forecasters XANTRONIX Industrial 2025-02-20 01:07:06 -05:00
  • a9bdab632d Become more aggressive in parsing XANTRONIX Industrial 2025-02-20 00:58:16 -05:00
  • 51009d942c Add yet another missing column XANTRONIX Industrial 2025-02-19 23:28:59 -05:00
  • f1b6733748 Add missing column XANTRONIX Industrial 2025-02-19 23:28:21 -05:00
  • 33ac8386b1 s/event/message/ re: ASOS messages XANTRONIX Industrial 2025-02-19 23:27:35 -05:00
  • d4c2585ec2 Fix typo XANTRONIX Industrial 2025-02-19 23:27:26 -05:00
  • 0dc2358a9b Add indices to nexrad_afos_message XANTRONIX Industrial 2025-02-19 23:27:13 -05:00
  • c12d250d3e Abandon Coord class in favor of shapely.Point XANTRONIX Industrial 2025-02-19 23:14:21 -05:00
  • 6a5a492cda Fix column name on nexrad_afos_message XANTRONIX Industrial 2025-02-19 22:10:45 -05:00
  • 469adad888 Ensure a few more fields are initialized XANTRONIX Industrial 2025-02-19 22:04:32 -05:00
  • c0257863ee Fix additional ASOS parsing issues XANTRONIX Industrial 2025-02-19 21:48:54 -05:00
  • 04c5692df1 Fix VTEC timestamp parsing XANTRONIX Industrial 2025-02-19 21:27:51 -05:00
  • 0de6a89408 Add missing attribute in VTECHydroEvent XANTRONIX Industrial 2025-02-19 20:51:47 -05:00
  • 16fea76b8c Remove trailing whitespace XANTRONIX Industrial 2025-02-19 20:50:43 -05:00
  • 2a0eef88fb use typing.Self XANTRONIX Industrial 2025-02-19 20:50:17 -05:00
  • a2a6f0dde1 Split VTEC string parsing from AFOS message parsing XANTRONIX Industrial 2025-02-19 20:45:42 -05:00
  • 90e98e0e1b Bring database schema in line with vtec.py XANTRONIX Industrial 2025-02-19 20:24:45 -05:00
  • 5528b43a57 Initial commit of list of WFOs XANTRONIX Industrial 2025-02-19 17:25:04 -05:00
  • 26a464e5e0 Implement parsing motion, time, azimuth tag XANTRONIX Industrial 2025-02-19 16:55:37 -05:00
  • 928fe6c71e Fix coordinates with more than 4 digits XANTRONIX Industrial 2025-02-19 16:24:17 -05:00
  • a96c982991 Implement VTEC event polygon parsing XANTRONIX Industrial 2025-02-19 15:51:47 -05:00
  • a43dc50c03 Toss out IEM Shapefile parsing in favor of new VTEC parser XANTRONIX Industrial 2025-02-19 15:28:16 -05:00
  • e7dc68d931 Improve formatting, Shapefile timestamp parsing XANTRONIX Industrial 2025-02-18 18:07:09 -05:00
  • 0ad95bf0d3 Add a few documents for VTEC decoding and handling reference XANTRONIX Industrial 2025-02-18 18:06:21 -05:00
  • c9889388a3 Fix marshaling of shapefile geometry to GeoJSON XANTRONIX Industrial 2025-02-17 23:01:33 -05:00
  • cc3e058d2e Initial (faulty) commit of VTEC polygon implementation XANTRONIX Industrial 2025-02-17 22:23:03 -05:00
  • 71d0d49ca7 Change nomenclature from 'storm report' to 'storm event' XANTRONIX Industrial 2025-02-17 11:05:21 -05:00
  • 38911cb694 Rename column/value read/write attributes to be consistent XANTRONIX Industrial 2025-02-17 10:58:24 -05:00
  • dc107537a4 Slight tweaks to README.md remarks on flags XANTRONIX Industrial 2025-02-17 10:41:09 -05:00
  • 2f7abbba4c Add support for _V04 products XANTRONIX Industrial 2025-02-16 21:31:34 -05:00
  • 6411d0516f Slight verbiage tweak in README.md XANTRONIX Industrial 2025-02-16 11:59:28 -05:00
  • d72e639ba7 Implement --type to only archive certain types of data XANTRONIX Industrial 2025-02-16 11:13:41 -05:00
  • 0046c0c4fb Indicate storm event type in output XANTRONIX Industrial 2025-02-15 21:51:22 -05:00
  • 231ae2dcca Add database indices for storm report query performance XANTRONIX Industrial 2025-02-15 21:51:07 -05:00
  • ee81af22f0 Rename RE_PRODUCT to RE_FILE for accuracy XANTRONIX Industrial 2025-02-15 20:34:06 -05:00
  • ae44b47a71 Inline links in README.md XANTRONIX Industrial 2025-02-15 19:45:28 -05:00
  • 513b6bf217 Shrink banner image a bit XANTRONIX Industrial 2025-02-15 17:42:52 -05:00
  • 8fbfb109c5 Update README.md header image XANTRONIX Industrial 2025-02-15 17:41:30 -05:00
  • 29372d9661 Don't call internal methods on ArchiveProduct XANTRONIX Industrial 2025-02-15 17:25:44 -05:00
  • 45a5ef6cbd Remove unnecessary import XANTRONIX Industrial 2025-02-15 17:22:14 -05:00
  • 312e3afeb2 Fix linter warnings XANTRONIX Industrial 2025-02-15 17:21:20 -05:00
  • fc81fa9b83 Implement ArchiveProduct class XANTRONIX Industrial 2025-02-15 17:10:42 -05:00
  • cef61dcc97 Use datetime.__str__(), not isoformat() XANTRONIX Industrial 2025-02-15 17:10:00 -05:00
  • 23bf0f3f8b Remove unwanted verbose output XANTRONIX Industrial 2025-02-15 15:06:27 -05:00
  • 14ef79f2c0 Change quoting style on SQLite3 load_extension() call XANTRONIX Development 2025-02-15 14:52:13 -05:00
  • c37d663584 Allow for searching downloads for specific years, months, days XANTRONIX Development 2025-02-15 14:28:29 -05:00
  • f4174ac440 Implement method for walking downloaded products XANTRONIX Development 2025-02-15 14:09:54 -05:00
  • 2c988fd0de Fix parsing of 2-character timestamps XANTRONIX Industrial 2025-02-15 11:19:42 -05:00
  • 37eb4fc2be Add WSR-88D Come And Take It flag to README.md XANTRONIX Industrial 2025-02-15 01:18:18 -05:00
  • db8ed2142d Initial commit of nexrad-archive-report-ingest XANTRONIX Industrial 2025-02-14 17:16:34 -05:00
  • 070f04b469 Obviate need for __from_row__() XANTRONIX Industrial 2025-02-14 16:20:27 -05:00
  • bb58abf01b Make Radar a child class of DatabaseTable XANTRONIX Industrial 2025-02-14 15:43:11 -05:00
  • bee6c8f5fd Whitespace alignment XANTRONIX Industrial 2025-02-14 15:41:02 -05:00
  • fbbeeef08b Refactor radar.py to use database layer features XANTRONIX Industrial 2025-02-14 15:32:15 -05:00
  • 8a0cbfcd6b Rename _insert__ attributes to _write__ XANTRONIX Industrial 2025-02-14 15:31:50 -05:00
  • 76989f10e9 Fix Dockerfile XANTRONIX Industrial 2025-02-14 14:59:52 -05:00
  • 4aaf7e6749 Remove print() debugging XANTRONIX Industrial 2025-02-14 14:58:24 -05:00
  • 1688218c95 Drastic improvement in database layer XANTRONIX Industrial 2025-02-14 14:52:50 -05:00
  • 28fd4050c7 Prune down Database.column_placeholders() a bit XANTRONIX Industrial 2025-02-14 13:48:16 -05:00
  • e577cb2759 Prepare for a big db.py refactor XANTRONIX Industrial 2025-02-14 13:34:31 -05:00
  • 124bab8b17 Fix storm report insertion XANTRONIX Industrial 2025-02-14 11:50:43 -05:00
  • 8ed64e831e Remove print() debugging XANTRONIX Industrial 2025-02-14 10:42:48 -05:00
  • d818922afa One final reworking of output format XANTRONIX Industrial 2025-02-13 19:31:45 -05:00
  • 2cb1066219 s/report/event/g XANTRONIX Industrial 2025-02-13 19:22:27 -05:00
  • 2159f4fea0 Report actual EVENT_ID field value while archiving XANTRONIX Industrial 2025-02-13 19:19:27 -05:00
  • 9916fc8d9e Sort out adding storm reports to database XANTRONIX Industrial 2025-02-13 17:45:07 -05:00
  • 55e179658b Allow None value for storm coordinates XANTRONIX Industrial 2025-02-13 17:44:32 -05:00
  • 5bab45b779 Fix issues with column placeholders XANTRONIX Industrial 2025-02-13 17:44:12 -05:00
  • f8b6093d4e Make start, end storm report coordinates optional XANTRONIX Industrial 2025-02-13 17:43:03 -05:00
  • e8eb158fac Update to use install from requirements.txt XANTRONIX Industrial 2025-02-13 15:26:35 -05:00
  • 05ebe724b3 Implement usage of nexrad_storm_report table XANTRONIX Industrial 2025-02-13 15:25:35 -05:00
  • e27b5f88a6 Bring significant object mapping enhancements to db.py XANTRONIX Industrial 2025-02-13 15:20:46 -05:00
  • df23ccc113 Use sqlite3.Row as row factory XANTRONIX Industrial 2025-02-13 14:42:04 -05:00
  • cfbb70261e Add nexrad_storm_report table; reorganize table/index creation XANTRONIX Industrial 2025-02-13 14:22:24 -05:00
  • e5b24d5d71 Allow multiple CSV files; rename nexrad.archive.Archive methods XANTRONIX Industrial 2025-02-13 12:19:06 -05:00
  • a6e785281b Change output to put S3 keys in same column in all cases XANTRONIX Industrial 2025-02-12 16:50:43 -05:00
  • 015ba27c33 Use os.path.join() where possible XANTRONIX Industrial 2025-02-12 15:37:14 -05:00
  • b9ca5c0c89 Grammar in README.md XANTRONIX Industrial 2025-02-12 14:04:45 -05:00
  • 32d7f25eaa Run CreateSpatialIndex() in db/nexrad.sql XANTRONIX Industrial 2025-02-12 13:47:44 -05:00