Skip to content

feat: v202608 release - #1

Merged
jeffseif merged 1 commit into
mainfrom
jeffseif/v202608-release
Aug 25, 2026
Merged

feat: v202608 release#1
jeffseif merged 1 commit into
mainfrom
jeffseif/v202608-release

Conversation

@jeffseif

@jeffseif jeffseif commented Aug 25, 2026

Copy link
Copy Markdown
Member

Background

This rolls up a number of changes for the v202608 release

Changes

  1. The concept of continents has been removed. Although they helped to manually track backfills, they bundled a lot of risk into individual runs and could result in hours of compute being thrown away. Now, the harmonize, emit, and attribute batches all operate (and cache) on individual tiles. This also means that when a country falls entirely within one tile, its results can be generated end-to-end in minutes -- rather than spending hours pre-generating results for the continent it resides in.
  2. The list of 220 countries is now generated programmatically and materialized in a json.
  3. The JD approach was attributing emissions to 11 crops, but only 3 of them were backed by production -- so eight were lacking emissions factors. NASS quickstats was expanded to include those eight additional crop productions and now JD emissions factors are generated for all 11 crops in the USA
  4. FAOSTAT production is ingested in order to support validation scripts. The GFW TCL dataset is also ingested.
  5. Tooling to measure drift across commits was added in tools/measure-drift.py
  6. Validation tooling (for comparing with independent datasets) was added in validation. This is quite complex but now enables a transparent and repeatable process that can help to identify (and sometimes explain) critical differences with other datasets.
  7. Several fixes and improvements were applied to the SLUC model. These mainly are caused by varying granularity of the crop taxonomy over the MAPSPAM snapshots.

@jeffseif
jeffseif requested a review from tdedecko August 25, 2026 21:01
…vidual tiles

220 country list is now generated programmatically and materialized
Expand JD from three to eleven crops (mainly in NASS quickstats)
Ingest FAOSTAT production
Add tooling to measure drift across commits
Formalize validation tooling for comparison with independent datasets
Several fixes and improvements to the SLUC model
@jeffseif
jeffseif force-pushed the jeffseif/v202608-release branch from 8be42d0 to 040acf7 Compare August 25, 2026 22:43
@jeffseif
jeffseif merged commit 3389d4f into main Aug 25, 2026
2 checks passed
@jeffseif
jeffseif deleted the jeffseif/v202608-release branch August 25, 2026 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants