Skip to content

Automation hub, team and org scoped automations - #2959

Open
mdlinville wants to merge 6 commits into
mainfrom
automation_updates-DOCS-2928_DOCS-2829
Open

Automation hub, team and org scoped automations#2959
mdlinville wants to merge 6 commits into
mainfrom
automation_updates-DOCS-2928_DOCS-2829

Conversation

@mdlinville

@mdlinville mdlinville commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Description

Docs for Automations Hub, team-scoped automations, and org-scoped automations. These features shipped with 0.83.0.

Available for technical review

Fixes DOCS-2928
Fixes DOCS-2929

Testing

  • Local build succeeds without errors (mint dev)
  • Local link check succeeds without errors (mint broken-links)
  • PR tests succeed

@mdlinville
mdlinville requested a review from Copilot July 23, 2026 21:44
@mdlinville
mdlinville requested a review from a team as a code owner July 23, 2026 21:44
@w-b-hivemind

w-b-hivemind Bot commented Jul 23, 2026

Copy link
Copy Markdown

HiveMind Sessions

1 session · 31m · $5.27

Session Agent Duration Tokens Cost Lines
Add W&B Automation Docs for DOCS-2928 and DOCS-2929
0f9aef16-389d-4be4-ba3b-da9bd42a1106
claude 31m 48.3K $5.27 +70 -9
Total 31m 48.3K $5.27 +70 -9

View all sessions in HiveMind →

Run claude --resume 0f9aef16-389d-4be4-ba3b-da9bd42a1106 to pickup where you left off.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds documentation for the global Automations hub and expands Automations docs to cover Organization- and Team-scoped automations, including where to create them, what events are available at broader scopes, and how to view execution history.

Changes:

  • Introduces the Automations hub concept and updates “where to find/create” guidance to include hub-based workflows.
  • Adds Organization/Team scope definitions and event availability details (including rate limiting/cooldown note).
  • Updates Slack/Webhook automation creation docs and automation history docs to reflect hub + broader scopes.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
snippets/_includes/automations/where-to-find-automations.mdx Adds the Automations hub as a primary discovery/entry point across scopes.
models/automations.mdx Expands scope model, adds an Automations hub section, and updates limitations text.
models/automations/automation-events.mdx Adds Organization and Team scope sections and contextual notes about triggering behavior.
models/automations/create-automations.mdx Updates creation entry points to include the global Automations hub + scope selection.
models/automations/create-automations/webhook.mdx Adds a note directing readers to hub-based Team/Org scope creation and scope limitations.
models/automations/create-automations/slack.mdx Adds a note directing readers to hub-based Team/Org scope creation and scope limitations.
models/automations/view-automation-history.mdx Adds hub-based guidance for viewing history across scopes, plus registry/project alternatives.
Comments suppressed due to low confidence (1)

models/automations.mdx:81

  • Typo: "webhoook" should be "webhook".
- At the **Team** and **Organization** scopes, the W&B App supports only artifact and collection events. Run-based events aren't available in the App at these scopes. See [Automation events and scopes](/models/automations/automation-events).

## Next steps
- [Automations tutorial](/models/automations/tutorial): Guides you to create a project automation to alert on run failures and a Registry automation to run a webhoook when an alias is added. The tutorial uses the W&B App.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread models/automations.mdx Outdated
Comment thread models/automations/view-automation-history.mdx Outdated
Comment thread models/automations/automation-events.mdx Outdated
@mintlify

mintlify Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
wandb 🟢 Ready View Preview Jul 23, 2026, 9:48 PM

@github-actions

github-actions Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

📚 Mintlify Preview Links

🔗 View Full Preview

📝 Changed (7 total)

📄 Pages (7)

File Preview
models/automations.mdx Automations
models/automations/automation-events.mdx Automation Events
models/automations/create-automations.mdx Create Automations
models/automations/create-automations/slack.mdx Slack
models/automations/create-automations/webhook.mdx Webhook
models/automations/view-automation-history.mdx View Automation History
snippets/_includes/automations/where-to-find-automations.mdx Where To Find Automations

🤖 Generated automatically when Mintlify deployment succeeds
📍 Deployment: 56bf3ff at 2026-07-28 23:20:22 UTC

@github-actions

github-actions Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

🔗 Link Checker Results

All links are valid!

No broken links were detected.

Preview: https://wb-21fd5541-automation-updates-docs-2928-docs-2829.mintlify.site

- Fix broken anchors in automations.mdx Limitations (run-metrics-change,
  run-metrics-z-score-change) and fix "webhoook" typo in Next steps.
- Add a Team/Org scope availability note to automation-events.mdx.
- Qualify hub-based history guidance in view-automation-history.mdx:
  lead with the always-available registry/project tabs and gate the
  Automations hub to Multi-tenant/Dedicated (Server v0.83.0+).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@mintlify

mintlify Bot commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
wandb 🟡 Building Jul 23, 2026, 9:44 PM

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 7 out of 7 changed files in this pull request and generated 1 comment.

Comment thread models/automations/create-automations.mdx
@github-actions

github-actions Bot commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

Readability impact

Word-weighted Flesch-Kincaid grade change across 6 changed pages: +0.1 (harder).

Lower Flesch-Kincaid grade and higher reading ease both mean easier to read. This check is informational and never blocks a PR.

Human readability

Page FK grade before FK grade after FK Δ Reading ease Δ Direction
models/automations.mdx 10.4 10.6 +0.2 -1.0 harder
models/automations/automation-events.mdx 10.6 10.8 +0.2 -1.9 harder
models/automations/create-automations.mdx 10.6 10.7 +0.1 -0.5 harder
models/automations/create-automations/slack.mdx 7.6 7.6 +0.0 +0.2 unchanged
models/automations/create-automations/webhook.mdx 8.5 8.5 +0.0 +0.2 unchanged
models/automations/view-automation-history.mdx 11.8 11.8 +0.0 +1.0 unchanged
snippets/_includes/automations/where-to-find-automations.mdx 9.7 n/a

AI agent comprehension

Rated 0-3 (higher is easier for an agent to parse and act on).

Page Before After Δ
models/automations/create-automations/webhook.mdx
models/automations/automation-events.mdx
models/automations/create-automations/slack.mdx
models/automations.mdx
models/automations/create-automations.mdx
models/automations/view-automation-history.mdx
snippets/_includes/automations/where-to-find-automations.mdx

Curated-docs baseline median FK grade by type: conceptual 10.5, procedural 8.8, reference 9.4.

From workflow run 30407522517

Comment thread models/automations/create-automations.mdx
Comment thread models/automations.mdx Outdated
Comment thread models/automations/automation-events.mdx Outdated
Comment thread models/automations/create-automations.mdx Outdated
Comment thread models/automations.mdx
Comment thread models/automations.mdx Outdated
Comment thread models/automations.mdx Outdated
Comment thread snippets/_includes/automations/where-to-find-automations.mdx Outdated
Co-authored-by: Matt Linville <matt@linville.me>
Comment thread models/automations.mdx Outdated
Comment thread models/automations.mdx
## Limitations
[Run metric automations](/models/automations/automation-events/#run-metrics-events) and [run metrics z-score change automations](/models/automations/automation-events/#run-metrics-z-score-change-automations) are currently supported only in [W&B Multi-tenant Cloud](/platform/hosting/#wb-multi-tenant-cloud).
- [Run metric automations](/models/automations/automation-events/#run-metrics-change) and [run metrics z-score change automations](/models/automations/automation-events/#run-metrics-z-score-change) are supported only in [W&B Multi-tenant Cloud](/platform/hosting/#wb-multi-tenant-cloud) and [Dedicated Cloud](/platform/hosting/hosting-options/dedicated-cloud).
- At the **Team** and **Organization** scopes, the W&B App supports only artifact and collection events. Run-based events aren't available in the App at these scopes. See [Automation events and scopes](/models/automations/automation-events).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if you mention this elsewhere, but it is possible to create team-/org-scoped run automations programmatically (via the Automations API in the SDK). At least it will be -- pending the following PR (still in review): wandb/wandb#12194

suggestion: May be worth mentioning the programmatic (SDK) API does allow these, to avoid undue confusion

Extra context:

  • Run automations aren't outright disabled for team/org scopes, they're just hidden in the (more curated) UI
  • The fact that we hid them in the UI was a late-game decision. Not essential for this PR, but for reference, some context for the decision: thread

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants