Skip to content

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

usv-data-2020

The full-resolution observations for the 2020 uncrewed surface vehicle season — every sample the instruments reported, in weekly chunks.

This repository holds no code and no committed data. It is a publishing target: a workflow here checks out oceansensing/usv, runs its data build for the 2020 season, and publishes the result as this repository's GitHub Pages site.

Served at https://oceansensing.org/usv-data-2020/ — the same origin as the site that reads it, because a project site under an organisation with a Pages custom domain serves under that domain. That is the whole reason the data lives here rather than beside the site: it costs no cross-origin request and no relaxation of the site's content security policy.

Why a repository per season

The archive at full rate is around 0.5 GB gzipped, against GitHub Pages' 1 GB published-site limit — which applies whatever a repository's visibility. It does not fit beside a site that is itself 250 MB.

Splitting by season also makes most of the work disappear: a closed season is immutable. 2020 has ended, so this repository's contents cannot change. It is built once, by hand, and never again — which is why the workflow here has no schedule, only workflow_dispatch.

What 2020 holds

10 records, saildrone only, and roughly 9 MB. Its longest deployment is fisheries_2020_all at 22 weeks.

For scale: the largest season in the archive is 2021, measured at 118 MB — five times under the limit.

What is here

season.json                    every record, its chunks and its variables
<datasetId>/<chunk>.json.gz    one week, gzipped, inflated in the browser

A chunk is seven days from the Unix epoch, so its boundaries are the same instant for every record and do not move when a mission gains earlier data. A full week of a 1-minute record with 40 columns is about 380 KB.

The files are stored already compressed, because a static host will not compress a type it does not recognise and the archive only fits gzipped. They arrive under content-type: application/gzip and are inflated with DecompressionStream.

The observations are NOAA's

Fetched from the NOAA PMEL ERDDAP, which is their source of truth and which each record links back to. Each dataset carries its own licence and acknowledgement; this repository redistributes them unchanged and claims nothing over them.

The build code is oceansensing/usv; all rights reserved, see its LICENSE.

About

Full-resolution USV observations for the 2020 season — the detail tier of https://oceansensing.org/usv/

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors