Skip to content

RDSC-6038: Add RDI 2.0.0 release notes and migration guidance - #3996

Merged
andy-stark-redis merged 9 commits into
mainfrom
RDSC-6038-rdi-2.0.0-release-notes
Sep 17, 2026
Merged

andy-stark-redis merged 9 commits into
mainfrom
RDSC-6038-rdi-2.0.0-release-notes

Conversation

@ZdravkoDonev-redis

@ZdravkoDonev-redis ZdravkoDonev-redis commented Sep 13, 2026

Copy link
Copy Markdown
Collaborator

Adds the September 2026 RDI 2.0.0 release notes, changes rdi_current_version from 1.19.1 to 2.0.0, and documents migration from the classic processor to Flink before the version upgrade. The release page uses weight 967 without claiming an exact release day.

Includes the changes from #4017 so release notes and migration guidance can be reviewed together in this PR.

Tickets: RDSC-6038, RDSC-6045.

Companion Cloud documentation: #3997.

Changelog source and wording changes

Source: redis-data-integration main CHANGELOG.md at c57c3a2. The release notes include fixes also shipped in 1.19.1 and preserve the security identifiers from this source.

Deliberate differences from the changelog:

  • Add a multi-source introduction covering separate source configuration and collectors, the API v2/CLI versus API v1 boundary, and a link to the new Multiple sources guide. Describe per-source reset here instead of as a separate feature, retaining the API query parameter, CLI flag, preservation of other sources' internal data, and pipeline restart behavior.
  • Clarify that source removal cleans up internal RDI data and retains records already written to the target. Shorten the cleanup explanation by removing implementation details.
  • Put the Flink default-processor change first under Breaking Changes. Use the clearer heading stating that topic.prefix is no longer accepted in advanced.source.
  • Apply the reviewers' wording improvements to optional null fields, qualified metric stream names, transformation source selectors, database-scoped secrets, component-to-source association, and follower leadership behavior.
  • Simplify the scaffolded-source, external-endpoint, and source-mTLS entries by removing internal secret naming, endpoint discovery, and keystore wiring details. Keep the user-facing behavior and configuration options.
  • Make bug-fix headings describe the corrected behavior. Shorten the bulk-insert fix to its trigger, job restart, and error message, removing recovery and split-handling details. Keep the accepted wording for the stream-recovery fix and template validation fixes.
  • Keep the transformation-template wording about the source the job reads from and the template written by rdi-admin install.

API and CLI changes are included as release-note entries. Generated definitions and the remaining Core documentation are in #3916, which currently targets this branch. The new Multiple sources link depends on that PR.

Processor migration and upgrade guidance

The migration guide stops the source collector while the classic processor drains the input streams, then switches to Flink and resumes collection. It includes CLI, Redis commands, and Redis Insight checks, snapshot guidance, post-migration verification, and rollback instructions. A dedicated upgrade section explains the processor-default change in RDI 2.0.0.

The migration and upgrade pages are taken unchanged from #4017 at c9e8a95de925f012532cbe233e44555f83cc291f. The release notes and version setting are preserved from this PR's previous head.

Validation

  • Hugo 0.143.1 focused RDI build of the combined branch: passed. The build used the pending Multiple sources page from RDSC-5610: Multi-source documentation #3916 at 3d6834f05161d6517f963a3797844469bb9aedba as a validation-only content mount; it is not added by this merge. SCAN client-example warnings remain.
  • Checked the rendered release notes, migration and upgrade pages, command blocks, YAML examples, internal links and anchors; git diff --check: passed.
  • Verified that both sets of changed files match their respective source branches exactly and that the combined PR diff contains only the release notes, version setting, and migration/upgrade guides.
  • Remote qualification recorded in RDSC-6045: Document draining streams before Flink processor migration #4017 passed for explicit-classic, omitted-processor-type, and already-empty pipeline cases, including source-position continuity, target writes, checkpoints, DLQ preservation, and Redis Insight checks. These remote runs were not repeated for this merge.
  • The remote qualification used candidate 0.0.202609101145, not the final RDI 2.0.0 release artifact.

Publication hold

Do not merge to main until:

  • The RDI 2.0.0 installer, Helm chart, and CLI artifacts are available at the documented download locations.
  • The coordinated Core documentation from RDSC-5610: Multi-source documentation #3916 is integrated, so the new Multiple sources link resolves in the published site.

The version-variable change also updates download instructions elsewhere on the site, so it must wait for the artifacts.


Note

Low Risk
Documentation-only changes; the version bump affects published download URLs and must stay coordinated with actual 2.0.0 artifact availability.

Overview
Publishes RDI 2.0.0 documentation by bumping rdi_current_version to 2.0.0 (so install/upgrade download links and {{< rdi-version >}} across the site point at 2.0.0) and adding a new September 2026 release notes page covering breaking changes (Flink as default processor, API v1/v2 behavior), multi-source pipelines, and related fixes/improvements/security.

Upgrade and classic→Flink migration guides are expanded for the default-processor shift: a pre-upgrade note and Upgrading to RDI 2.0.0 section (migrate on 1.19.0 and drain streams, or pin processors.type: classic before upgrade). The migration runbook is restructured into explicit disable collection → drain input streams (with redis-di describe, SCAN/XLEN, Redis Insight) → switch to Flink and resume steps, plus rollback wording when 2.0.0 defaults to Flink.

Reviewed by Cursor Bugbot for commit c43b74d. Bugbot is set up for automated code reviews on this repo. Configure here.

@github-actions

github-actions Bot commented Sep 13, 2026

Copy link
Copy Markdown
Contributor

🧠 Redis Memory

Found 9 related items from repository history (1 new this commit):

Memory updated at c43b74d

@stoyanr stoyanr left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Many minor comments, mostly polishing of AI wording, and a few not so minor ones regarding ordering most important changes first and dropping internal details.

Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated

@andy-stark-redis andy-stark-redis left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed a small typo in one of Stoyan's suggestions. Otherwise, LGTM.

Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md
Comment thread content/integrate/redis-data-integration/release-notes/rdi-2-0-0.md Outdated
@ZdravkoDonev-redis ZdravkoDonev-redis changed the title RDSC-6038: Add RDI 2.0.0 release notes RDSC-6038: Add RDI 2.0.0 release notes and migration guidance Sep 16, 2026
@andy-stark-redis
andy-stark-redis merged commit ef934db into main Sep 17, 2026
99 checks passed
@andy-stark-redis
andy-stark-redis deleted the RDSC-6038-rdi-2.0.0-release-notes branch September 17, 2026 08:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants