Skip to content

0.3.3: affected tests handle non-C# changes; docs match the code - #44

Merged
csa7mdm merged 1 commit into
mainfrom
fix/eval-report-gaps
Sep 24, 2026
Merged

csa7mdm merged 1 commit into
mainfrom
fix/eval-report-gaps

Conversation

@csa7mdm

@csa7mdm csa7mdm commented Sep 24, 2026

Copy link
Copy Markdown
Owner

Follows up an external evaluation report. Each claim was checked against the code before changing anything.

Fixed

  • dotnet_test_affected ignored changes to files that aren't compiled C#. A change only to a .csproj, .razor, appsettings.json or resource file, or a deleted .cs file, returned "No changed .cs files" and ran nothing, even though those changes can break tests. Now:

    • the file is mapped to the project folder that holds it (the deepest one, for nested projects);
    • the test projects that reference that project run;
    • the file is listed in the new untracedFiles field.

    A change to a .props, .targets, global.json, nuget.config or .editorconfig file runs the whole solution. Documentation files, and files outside every project such as CI workflows, are still ignored.

    Checked end to end through the MCP server on this repo:

    Changed files Result
    DotNetDevMCP.Build.csproj projects scope, runs DotNetDevMCP.Build.Tests
    Directory.Build.props solution scope
    ci.yml + README.md "No changed code or project files."

Checked and not a bug

  • The report said calls through an interface or base class are missed. They aren't: Roslyn's reference search follows them. A new test pins this down.

Docs

  • Removed docs/architecture/system-overview.md. It described components that were never built (MergeAnalyzer, CodeReviewEngine, AgentCoordinator, DependencyAnalyzer...). The wiki's Architecture page describes the code as it is.
  • The BenchmarkDotNet README now says those benchmarks measure orchestration overhead with Task.Delay, and points to benchmarks/polly for real numbers.
  • README:
    • The known gaps now include the NuGet PackageReference gap and the lack of a sandbox.
    • New "Using it at work?" line, linking to Discussions → Show and tell.
  • CONTRIBUTING no longer points at the missing docs/ai-context/project-context.json.

Release

Bumps the version to 0.3.3 (props, server.json, CHANGELOG). After merge: tag v0.3.3, then run mcp-publisher publish.

Tests

120 pass (2 new).

🤖 Generated with Claude Code

Checked an external evaluation against the code:
- dotnet_test_affected dropped every changed file that wasn't a compiled .cs
  file (.csproj, .razor, appsettings.json, deleted files) and ran nothing.
  They now use the project fallback and are listed in untracedFiles; a
  changed .props/.targets/global.json/nuget.config/.editorconfig runs the
  whole solution.
- A new test confirms calls through an interface or base class are
  followed (the report said they weren't).
- Removed system-overview.md, which described components that don't
  exist; labeled the BenchmarkDotNet suite as orchestration overhead only;
  dropped CONTRIBUTING's reference to a missing ai-context file.
- README: fuller known gaps and a "Using it at work?" line.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@csa7mdm
csa7mdm merged commit 56fbd54 into main Sep 24, 2026
6 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant