Page tree
Skip to end of metadata
Go to start of metadata

Jiras

RADAR-2 - Getting issue details... STATUS

DevOps

Repo: https://github.com/obrienlabs/radar

Architecture

There are several data sites that serve up doppler radar images every 6-10 minutes.  In addition we have correlating satellite, lightning and weather data.  We also have historical radar imaging for missed downloads.
see Text and Image Processing

High Level Architecture

Serverless Architecture

Traditional Architecture

radar arch diagram

Analysis

Data Model

There are several radar sites across canada that provide individual and combined images at 10 and 6 minute intervals.

Image Format

480 x 560 with legend - active area is 480 x 480 

XFT_2018_09_21_21_20_f
filtered

example XFT_2008_11_08_14_00.GIF



Intermittent Effects

xam is a good example

Out of order image ordering (historical)


Transient blocking from wind farms

Transient blocking from RF interference

Permanent false positive elements

single frame noise

Image glitter at 1 pixel

Noise past circular range rings

Historical radar missing data due to grid/names overlay


API


Use Cases

UC 1: Continuous Radar Download

20210401 : switched out from image to html5

https://weather.gc.ca/map_e.html?layers=radar
base map is https://open.canada.ca/data/en/dataset/296de17c-001c-4435-8f9a-f5acab632e85 ESRI version https://geoappext.nrcan.gc.ca/arcgis/rest/services/BaseMaps/CBMT3978/MapServer

UC 2: Radar Processing

UC 3: Radar Monitoring

UC 4: Radar Serving

UC 5: Historical Radar Download

https://climate.weather.gc.ca/radar/index_e.html?site=CASFT&year=2021&month=4&day=5&hour=09&minute=20&duration=2&image_type=PRECIPET_RAIN_WEATHEROFFICE

3 hours delayed

UC 10: Vaisala RF Lightning Detection

see https://github.com/obrienlabs/radar/issues/16

https://weather.gc.ca/lightning/index_e.html?id=ONT#mapTop

refactor
https://github.com/obrienlabs/radar/blob/master/radar.se/src/main/java/org/obrienscience/radar/integration/LightningService.java
to use lambda/streams

17 photos up at 1935
earliest (8 before)
https://weather.gc.ca/data/lightning_images/ONT_202107202210.png
landing
https://weather.gc.ca/data/lightning_images/ONT_202107202230.png
to (6 after)
https://weather.gc.ca/data/lightning_images/ONT_202107202330.png

# updates: 1:20 after
https://weather.gc.ca/data/lightning_images/ONT_202107202340.png
available at 19:41:20

Design

Design Issues

Periodic Capture Framework

Static Image Analysis

Pixel Track Prediction

Continuously run a simulation of future storm pixel position and adjust the cone based on actual future tracks.

Devops

Implementation and deployment

Virtual Machine based - EC2 VMware

Container based - Helm on Kubernetes on Docker

Serverless Based - Lambda

Testing

Security

Monitoring

Releases

Documentation

Development Log

Links




  • No labels