Skip to content

Stop exporting level_sources and user_levels via Database Migration Service#73527

Open
sureshc wants to merge 1 commit into
stagingfrom
infrastructure/stop-exporting-large-tables-via-dms
Open

Stop exporting level_sources and user_levels via Database Migration Service#73527
sureshc wants to merge 1 commit into
stagingfrom
infrastructure/stop-exporting-large-tables-via-dms

Conversation

@sureshc

@sureshc sureshc commented Jun 26, 2026

Copy link
Copy Markdown
Contributor

RED team has switched to using Materialized Views that source data from tables imported into Redshift via Zero ETL.

Testing story

code-dot-org $ export AWS_PROFILE=codeorg-admin
code-dot-org $ bundle exec rake stack:data:validate RAILS_ENV=production ADMIN=true

Finished stack:data:environment (less than a minute)
Pending update for stack `DATA-production`:
Remove DMSCronLevelSourcesPii [AWS::DMS::ReplicationTask]
Remove DMSCronUserLevels [AWS::DMS::ReplicationTask]
Finished stack:data:validate (less than a minute)

Deployment notes

code-dot-org $ bundle exec rake stack:data:start RAILS_ENV=production ADMIN=true

Privacy and security

@sureshc sureshc requested a review from a team June 26, 2026 22:08
@github-actions

Copy link
Copy Markdown

[WARN: DMS Config Modified] This PR modifies the aws/dms/tasks.yml file. These changes must be deployed manually by @code-dot-org/infrastructure before merging.

@sureshc

sureshc commented Jun 26, 2026

Copy link
Copy Markdown
Contributor Author

deployed:

code-dot-org $ bundle exec rake stack:data:start RAILS_ENV=production ADMIN=true


Finished stack:data:environment (less than a minute)
Pending update for stack `DATA-production`:
Remove DMSCronLevelSourcesPii [AWS::DMS::ReplicationTask]
Remove DMSCronUserLevels [AWS::DMS::ReplicationTask]
Proceed? [y/n]
y
Stack update requested, waiting for provisioning to complete...
..2026-06-26 22:11:22 UTC- DATA-production [UPDATE_COMPLETE_CLEANUP_IN_PROGRESS]
2026-06-26 22:11:22 UTC- DATA-production [UPDATE_COMPLETE_CLEANUP_IN_PROGRESS]

Stack update complete.

@sureshc sureshc marked this pull request as ready for review June 26, 2026 22:12
@sureshc sureshc requested a review from a team as a code owner June 26, 2026 22:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant