Skip to content

fix(etl): rebuild highlights after fallback - #109

Merged
Sam-24-dev merged 1 commit into
mainfrom
fix/etl-rebuild-highlights-after-fallback
Sep 7, 2026
Merged

Sam-24-dev merged 1 commit into
mainfrom
fix/etl-rebuild-highlights-after-fallback

Conversation

@Sam-24-dev

Copy link
Copy Markdown
Owner

Summary

  • rebuild home_highlights.json from the final bridge JSONs after Reddit fallback restoration
  • keep both frontend/assets/data and datos/metadata/remote_assets consistent
  • extend the bridge integrity gate to validate the deploy-time remote asset root

Root cause

Scheduled run 34131946862 generated Home highlights during sync_assets, then restored the canonical Reddit topic/intersection bridges afterward. Home was not rebuilt, so the integrity gate correctly rejected stale embedded Reddit summaries and blocked publication.

Why this ordering is safe

The new step runs only on the existing Reddit fallback condition, immediately after the final bridge restore and before the integrity/freshness gates. It reuses build_home_highlights_payload and writes only home_highlights.json; it does not rerun the full exporter or read stale CSV inputs.

Asset roots

  • compact frontend assets: frontend/assets/data
  • full deploy artifact assets: datos/metadata/remote_assets

The fallback restore and integrity gate now cover both roots.

Validation

  • TDD RED: 4 focused regression tests failed for the missing rebuild, remote restore, remote gate, and workflow ordering
  • python -m pytest -q — 230 passed
  • focused regression suite — 45 passed
  • ruff check ... — passed
  • python -m compileall -q backend scripts tests — passed
  • YAML parse — passed
  • bandit -q -ll ... — passed
  • git diff --check — passed
  • detect-secrets scan <staged files> — no findings
  • flutter test — 145 passed
  • flutter analyze — no issues
  • flutter build web --wasm --no-wasm-dry-run --no-web-resources-cdn ... — passed

Non-goals

Copilot AI lite review requested due to automatic review settings September 7, 2026 22:01

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@Sam-24-dev
Sam-24-dev merged commit 2952e37 into main Sep 7, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants