Skip to content

Commit d9f928a

Browse files
committed
Bump the conformance pin to 0.2.0-alpha.8 and baseline the listen checks it surfaces
conformance 4944b268 (0.2.0-alpha.8, unpublished on npm — same sha256-verified pkg.pr.new mechanics as the previous pin) includes upstream #372: checks whose prerequisite is missing now fail with a 'Not testable' message instead of skipping outside the pass/fail denominator. For this repo that surfaces one new known failure: server-stateless fails its three subscriptions/listen MUST checks, because the everything-server's legacy resources/subscribe handlers make it advertise resources.subscribe in server/discover while subscriptions/listen answers -32601 — advertised-but-rejected is now a failure, not a skip. Baseline the scenario in both expected-failures files until the listen runtime lands. The two listChanged SHOULD checks remain legitimately skipped (declared false). The tasks-* scenarios fail with higher check counts (their cascade skips now fail too) but were already baselined; client legs are unaffected.
1 parent 76b7016 commit d9f928a

3 files changed

Lines changed: 22 additions & 9 deletions

File tree

.github/actions/conformance/expected-failures.2026-07-28.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,9 @@
2323
client: []
2424

2525
server:
26+
# SEP-2575 subscriptions/listen is not implemented yet; see the matching
27+
# entry in expected-failures.yml for the full rationale.
28+
- server-stateless
2629
# SEP-2243 Mcp-Param-* server-side validation is not implemented yet; see
2730
# the matching entry in expected-failures.yml for the full rationale.
2831
- http-custom-header-server-validation

.github/actions/conformance/expected-failures.yml

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,16 @@
1313
client: []
1414

1515
server:
16+
# SEP-2575 subscriptions/listen is not implemented yet. The everything-
17+
# server's legacy resources/subscribe handlers make it advertise
18+
# `resources.subscribe` in server/discover, and as of conformance #372 a
19+
# server that advertises a subscription capability but answers
20+
# subscriptions/listen with -32601 fails the three listen MUST checks
21+
# ("Not testable") instead of skipping them. Remove this entry when the
22+
# listen runtime lands. NOTE: while listed, this entry also masks new
23+
# failures in the scenario's other 25 (currently passing) checks — the
24+
# baseline is per-scenario, not per-check.
25+
- server-stateless
1626
# SEP-2243 Mcp-Param-* server-side validation is not implemented yet. The
1727
# everything-server's `test_x_mcp_header` tool arms these checks (without an
1828
# x-mcp-header-annotated tool the harness skips all of them silently); the

.github/workflows/conformance.yml

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -19,17 +19,17 @@ env:
1919
# Bump deliberately and reconcile both
2020
# .github/actions/conformance/expected-failures*.yml files in the same change.
2121
#
22-
# Temporarily pinned to the pkg.pr.new build of conformance main@b18aa918
23-
# (the merge of #371, which fixes the http-custom-headers fixture's
24-
# spec-forbidden `number`-typed x-mcp-header annotations) — no published
25-
# release includes it yet. Pinned by commit SHA so the tarball cannot move
26-
# under us; CONFORMANCE_PKG_SHA256 pins the bytes and the fetch-and-verify
27-
# step below downloads, checks the digest, and repoints CONFORMANCE_PKG at the
22+
# Temporarily pinned to the pkg.pr.new build of conformance main@4944b268
23+
# (0.2.0-alpha.8, which includes #372: fail checks whose prerequisite is
24+
# missing instead of skipping them) — alpha.8 is not published to npm yet.
25+
# Pinned by commit SHA so the tarball cannot move under us;
26+
# CONFORMANCE_PKG_SHA256 pins the bytes and the fetch-and-verify step below
27+
# downloads, checks the digest, and repoints CONFORMANCE_PKG at the
2828
# verified local copy. Repin to the next published @modelcontextprotocol/
29-
# conformance release (>0.2.0-alpha.7) once it ships, then drop
29+
# conformance release (>=0.2.0-alpha.8) once it ships, then drop
3030
# CONFORMANCE_PKG_SHA256 and the fetch-and-verify steps.
31-
CONFORMANCE_PKG: "https://pkg.pr.new/@modelcontextprotocol/conformance@b18aa918"
32-
CONFORMANCE_PKG_SHA256: "e9f6bc25085b4692e988cbdbd024a4203d54a52a6aaa065376cf8ecaa09bb680"
31+
CONFORMANCE_PKG: "https://pkg.pr.new/@modelcontextprotocol/conformance@4944b268"
32+
CONFORMANCE_PKG_SHA256: "0f70c035782d319d72ab427653c5275db5c50429d59fae0241a645b33aeda1a7"
3333

3434
jobs:
3535
server-conformance:

0 commit comments

Comments
 (0)