Commit graph

80 commits

Author SHA1 Message Date
XANTRONIX Industrial
231ae2dcca Add database indices for storm report query performance 2025-02-15 21:51:07 -05:00
XANTRONIX Industrial
ee81af22f0 Rename RE_PRODUCT to RE_FILE for accuracy 2025-02-15 20:34:06 -05:00
XANTRONIX Industrial
ae44b47a71 Inline links in README.md 2025-02-15 19:45:28 -05:00
XANTRONIX Industrial
513b6bf217 Shrink banner image a bit 2025-02-15 17:42:52 -05:00
XANTRONIX Industrial
8fbfb109c5 Update README.md header image 2025-02-15 17:41:30 -05:00
XANTRONIX Industrial
29372d9661 Don't call internal methods on ArchiveProduct 2025-02-15 17:25:44 -05:00
XANTRONIX Industrial
45a5ef6cbd Remove unnecessary import 2025-02-15 17:22:14 -05:00
XANTRONIX Industrial
312e3afeb2 Fix linter warnings 2025-02-15 17:21:20 -05:00
XANTRONIX Industrial
fc81fa9b83 Implement ArchiveProduct class 2025-02-15 17:10:42 -05:00
XANTRONIX Industrial
cef61dcc97 Use datetime.__str__(), not isoformat()
Use datetime.__str__(), not isoformat() to conform to the native
timestamp format of SQLite3
2025-02-15 17:10:00 -05:00
XANTRONIX Industrial
23bf0f3f8b Remove unwanted verbose output 2025-02-15 15:06:27 -05:00
XANTRONIX Development
14ef79f2c0 Change quoting style on SQLite3 load_extension() call 2025-02-15 14:52:13 -05:00
XANTRONIX Development
c37d663584 Allow for searching downloads for specific years, months, days 2025-02-15 14:31:01 -05:00
XANTRONIX Development
f4174ac440 Implement method for walking downloaded products 2025-02-15 14:09:54 -05:00
XANTRONIX Industrial
2c988fd0de Fix parsing of 2-character timestamps
Fix parsing of 2-character timestamps to be minute timestamps at
midnight local time
2025-02-15 11:21:18 -05:00
XANTRONIX Industrial
37eb4fc2be Add WSR-88D Come And Take It flag to README.md 2025-02-15 01:18:28 -05:00
XANTRONIX Industrial
db8ed2142d Initial commit of nexrad-archive-report-ingest 2025-02-14 17:16:34 -05:00
XANTRONIX Industrial
070f04b469 Obviate need for __from_row__() 2025-02-14 16:20:27 -05:00
XANTRONIX Industrial
bb58abf01b Make Radar a child class of DatabaseTable 2025-02-14 15:43:11 -05:00
XANTRONIX Industrial
bee6c8f5fd Whitespace alignment 2025-02-14 15:41:02 -05:00
XANTRONIX Industrial
fbbeeef08b Refactor radar.py to use database layer features 2025-02-14 15:32:15 -05:00
XANTRONIX Industrial
8a0cbfcd6b Rename _insert__ attributes to _write__ 2025-02-14 15:31:50 -05:00
XANTRONIX Industrial
76989f10e9 Fix Dockerfile 2025-02-14 14:59:52 -05:00
XANTRONIX Industrial
4aaf7e6749 Remove print() debugging 2025-02-14 14:58:24 -05:00
XANTRONIX Industrial
1688218c95 Drastic improvement in database layer 2025-02-14 14:52:50 -05:00
XANTRONIX Industrial
28fd4050c7 Prune down Database.column_placeholders() a bit 2025-02-14 13:48:16 -05:00
XANTRONIX Industrial
e577cb2759 Prepare for a big db.py refactor 2025-02-14 13:34:31 -05:00
XANTRONIX Industrial
124bab8b17 Fix storm report insertion 2025-02-14 11:50:43 -05:00
XANTRONIX Industrial
8ed64e831e Remove print() debugging 2025-02-14 10:42:48 -05:00
XANTRONIX Industrial
d818922afa One final reworking of output format 2025-02-13 19:31:45 -05:00
XANTRONIX Industrial
2cb1066219 s/report/event/g 2025-02-13 19:22:27 -05:00
XANTRONIX Industrial
2159f4fea0 Report actual EVENT_ID field value while archiving 2025-02-13 19:19:27 -05:00
XANTRONIX Industrial
9916fc8d9e Sort out adding storm reports to database 2025-02-13 17:45:07 -05:00
XANTRONIX Industrial
55e179658b Allow None value for storm coordinates 2025-02-13 17:44:32 -05:00
XANTRONIX Industrial
5bab45b779 Fix issues with column placeholders 2025-02-13 17:44:12 -05:00
XANTRONIX Industrial
f8b6093d4e Make start, end storm report coordinates optional 2025-02-13 17:43:03 -05:00
XANTRONIX Industrial
e8eb158fac Update to use install from requirements.txt 2025-02-13 15:26:35 -05:00
XANTRONIX Industrial
05ebe724b3 Implement usage of nexrad_storm_report table 2025-02-13 15:25:35 -05:00
XANTRONIX Industrial
e27b5f88a6 Bring significant object mapping enhancements to db.py 2025-02-13 15:20:46 -05:00
XANTRONIX Industrial
df23ccc113 Use sqlite3.Row as row factory 2025-02-13 14:42:04 -05:00
XANTRONIX Industrial
cfbb70261e Add nexrad_storm_report table; reorganize table/index creation 2025-02-13 14:22:24 -05:00
XANTRONIX Industrial
e5b24d5d71 Allow multiple CSV files; rename nexrad.archive.Archive methods 2025-02-13 12:19:06 -05:00
XANTRONIX Industrial
a6e785281b Change output to put S3 keys in same column in all cases 2025-02-12 16:50:43 -05:00
XANTRONIX Industrial
015ba27c33 Use os.path.join() where possible 2025-02-12 15:37:14 -05:00
XANTRONIX Industrial
b9ca5c0c89 Grammar in README.md 2025-02-12 14:04:45 -05:00
XANTRONIX Industrial
32d7f25eaa Run CreateSpatialIndex() in db/nexrad.sql 2025-02-12 13:47:44 -05:00
XANTRONIX Industrial
b4f81848cc Format for 80 columns 2025-02-12 13:45:48 -05:00
XANTRONIX Industrial
ccade2a91d Catch ValueError on invalid integers in storm report details 2025-02-12 11:42:48 -05:00
XANTRONIX Industrial
01fe9f53c9 Provide direct link to storm reports CSV files 2025-02-12 11:12:03 -05:00
XANTRONIX Industrial
b986239026 Print record number when files already archived 2025-02-12 11:11:48 -05:00