Skip to content

STAC-24630: Add stackgraph backup v2 documentation [DRAFT] - #360

Open
craffit wants to merge 3 commits into
stagingfrom
stac-24630
Open

STAC-24630: Add stackgraph backup v2 documentation [DRAFT]#360
craffit wants to merge 3 commits into
stagingfrom
stac-24630

Conversation

@craffit

@craffit craffit commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator

Adds documentation for stackgraph backup/restore v2

@craffit
craffit requested a review from a team as a code owner July 16, 2026 14:31
@craffit craffit added the draft label Jul 16, 2026
@netlify

netlify Bot commented Jul 16, 2026

Copy link
Copy Markdown

Deploy Preview for suse-obs ready!

Name Link
🔨 Latest commit c497380
🔍 Latest deploy log https://app.netlify.com/projects/suse-obs/deploys/6a5f798f35e8ba00089eab50
😎 Deploy Preview https://deploy-preview-360--suse-obs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@viliakov viliakov left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few documentation-style points on the new v2 sections. The surrounding docs use third-person, imperative voice and avoid first-person/marketing phrasing, so the new prose reads a bit out of style. Also flagged two typos/grammar fixes and a content mismatch with the Helm chart default. Details inline.


=== Enabling/disabling v1 and v2 backups

As of {next-release-version} we make backups in two versions, v1 and v2. The old v1 system is battle-tested but slow, the v2 system is fast and feature-rich but has to prove itself, hence both systems are active by default. If for some reason one of the systems should be disabled, this can be done through `backup.stackGraph.scheduled.implementation` which can be `v1`, `v2` or `all`. The default is `all`.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Style + content on this paragraph:

  • First-person voice: "we make backups" — the rest of the docs are third-person. Suggest: "As of {next-release-version}, backups are made in two versions, v1 and v2."
  • Marketing/anthropomorphizing: "battle-tested", "fast and feature-rich but has to prove itself". Suggest something neutral like: "v1 is the established but slower system; v2 is faster and adds incremental backups but is newer. By default both run so v2 can be validated alongside v1."
  • Content mismatch: this says the default is all, but helm-charts-internal#100 sets backup.stackGraph.scheduled.implementation default to v1 (only v1 runs by default; v2 is suspended). The docs and chart need to agree — either change the chart default to all or update this to say v1-only by default.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ignore Content mismatch: this says the default is all, but helm-charts-internal#100 sets backup.stackGraph.scheduled.implementation default to v1 (only v1 runs by default; v2 is suspended). The docs and chart need to agree — either change the chart default to all or update this to say v1-only by default.. The AI missed you comment in the helm-charts pr....

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will now merge helm with v1 but move to 'all' when i release this feature. I will be testing first on noghtly while v2 is disabled for end-users

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

applied suggestions


== Configuration and topology data v2 (StackGraph)

Since SUSE Observability {next-release-version} we are rolling out v2 of StackGraph backup/restore. For now both v1 and v2 backups will be made, until v2 is deemed completely stable, at which point we'll sunset v1 backups.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

First-person voice + jargon: "we are rolling out" and "we'll sunset v1 backups". Suggest: "SUSE Observability {next-release-version} introduces v2 of StackGraph backup/restore. Both v1 and v2 backups are created until v2 is considered stable, after which v1 backups will be discontinued."

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

applied


Since SUSE Observability {next-release-version} we are rolling out v2 of StackGraph backup/restore. For now both v1 and v2 backups will be made, until v2 is deemed completely stable, at which point we'll sunset v1 backups.

V2 backups offer significant improvements in backup and restore speed, as well as incremental backups. Also, the StackGraph v2 restore procedure allows for restoring historical (backfill) data while the system is running, which means much quicker time to get the system back up.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tone down the marketing phrasing "offer significant improvements". Suggest: "v2 backups improve backup and restore speed and add incremental backups." Also note "V2" here vs "v2" elsewhere — standardize on lowercase v2.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


=== List StackGraph v2 backups

To list the StackGraph V2 backups, execute the following command:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Capitalization: "StackGraph V2" should be "StackGraph v2" to match the rest of the document.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


=== Restore a StackGraph v2 backup

The restore has a 'live' and 'backfill' portion of the backup. The 'live' part takes down the system and will restore the latest data. After the 'live' part is done, the system will scale up and is accessible by end-users. The `backfill` portion will be restored while the system is running. The following message appears to signify when the system is accessible again:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two nits:

  • "takes down the system" is informal — prefer "takes the system offline".
  • Quoting is inconsistent: 'live' / 'backfill' are single-quoted here but `backfill` is in backticks in the same paragraph. Use backticks for literals throughout to match the rest of the doc.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


==== Additional commands

* `sts-backup stackgraph-v2 backfill`. The restore command will automatically restore both the `live` and `backfill` portion of a backup. If, however, the restore command gets interrupted (through CTRL-C) or fails due to instability the cluster, this command can be used to restart the backfill job, restoring the `backfill` portion of the data.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Grammar + consistency:

  • "fails due to instability the cluster" → "fails due to instability of the cluster".
  • "CTRL-C" — the existing doc uses "Ctrl+C"; standardize on that.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

==== Additional commands

* `sts-backup stackgraph-v2 backfill`. The restore command will automatically restore both the `live` and `backfill` portion of a backup. If, however, the restore command gets interrupted (through CTRL-C) or fails due to instability the cluster, this command can be used to restart the backfill job, restoring the `backfill` portion of the data.
* `sts-backup stackgraph-v2 abort`. If restoring the `backfill` portion of a backup cannot be recovered or is lost somehow, `abort` can be used to wrap up the restore command with the data that got already ingested successfully. This command is really a last resort and should not be needed in normal operation.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Informal phrasing: "This command is really a last resort" → "This command is a last resort".

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


* `sts-backup stackgraph-v2 backfill`. The restore command will automatically restore both the `live` and `backfill` portion of a backup. If, however, the restore command gets interrupted (through CTRL-C) or fails due to instability the cluster, this command can be used to restart the backfill job, restoring the `backfill` portion of the data.
* `sts-backup stackgraph-v2 abort`. If restoring the `backfill` portion of a backup cannot be recovered or is lost somehow, `abort` can be used to wrap up the restore command with the data that got already ingested successfully. This command is really a last resort and should not be needed in normal operation.
* `sts-backup stackgraph-v2 check-and-finalize`. When any command (`restore`/`backfill`/`abort`) gets interrupted with Ctrl-C, the `check-and-finalize` command can be used to keep track of its progress, incling a `--wait` option which allows waiting for the job to finish.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo + consistency:

  • "incling a --wait option" → "including".
  • "Ctrl-C" → "Ctrl+C" to match the existing doc.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


[,bash]
----
Setting up port-forward to suse-observability-minio:9000 in namespace <NAMESPACE>...

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is the minio still there? I thought we switched to s3proxy?


[,bash]
----
sts-backup stackgraph-v2 list --namespace <NAMESPACE>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is the namespace argument optional? We can default to suse-observability


It can be configured to store the backups in three locations:

* xref:/setup/data-management/backup_restore/backup_enable.adoc[AWS S3]

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a confusing set of links


=== Enable/disable v1 and v2 backups

As of {next-release-version}, backups are made in two versions, v1 and v2. The old v1 is the established but slower system; v2 is faster and adds incremental backups but is newer. By default both run so v2 can be used while having v1 to fall back on. If for some reason one of the systems should be disabled, this can be done through `backup.stackGraph.scheduled.implementation` which can be `v1`, `v2` or `all`. The default is `all`.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
As of {next-release-version}, backups are made in two versions, v1 and v2. The old v1 is the established but slower system; v2 is faster and adds incremental backups but is newer. By default both run so v2 can be used while having v1 to fall back on. If for some reason one of the systems should be disabled, this can be done through `backup.stackGraph.scheduled.implementation` which can be `v1`, `v2` or `all`. The default is `all`.
As of {next-release-version}, backups are made in two versions, v1 and v2. v1 is the older, established but slower system whereas v2 is the newer, faster system that adds incremental backups. Since both systems run, by default, v2 can be primarily used while having v1 to fall back on. If, for some reason, one of the systems should be disabled, this can be done through `backup.stackGraph.scheduled.implementation` which can be `v1`, `v2` or `all`. The default is `all`.

"this can be done through" - What is 'this' here? Is it "backup can be performed"?


== Configuration and topology data v2 (StackGraph)

SUSE Observability {next-release-version} introduces v2 of StackGraph backup/restore. Both v1 and v2 backups are created until v2 is considered stable, after which v1 backups will be discontinued.

@akashraj4261 akashraj4261 Aug 4, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
SUSE Observability {next-release-version} introduces v2 of StackGraph backup/restore. Both v1 and v2 backups are created until v2 is considered stable, after which v1 backups will be discontinued.
{stackstate-product-name} {next-release-version} introduces v2 of StackGraph backup/restore. Both v1 and v2 backups are created until v2 is considered stable, after which v1 backups will be discontinued.

Are there any parameters that we might want to suggest keeping an eye on to ensure the stability of v2? Or is this something the customers will always know?


SUSE Observability {next-release-version} introduces v2 of StackGraph backup/restore. Both v1 and v2 backups are created until v2 is considered stable, after which v1 backups will be discontinued.

V2 backups improve backup and restore speed and add incremental backups. Also, the StackGraph v2 restore procedure allows for restoring historical (backfill) data while the system is running, which means much quicker time to get the system back up.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
V2 backups improve backup and restore speed and add incremental backups. Also, the StackGraph v2 restore procedure allows for restoring historical (backfill) data while the system is running, which means much quicker time to get the system back up.
V2 backups improve backup and restore speed and add incremental backups. Also, the StackGraph v2 restore procedure allows restoring historical (backfill) data while the system is running resulting in quicker system backups.

@akashraj4261 akashraj4261 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added suggestions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants