feat: add MCP latency benchmark script and Windows investigation (#11)#70
Open
Kunall7890 wants to merge 5 commits into
Open
feat: add MCP latency benchmark script and Windows investigation (#11)#70Kunall7890 wants to merge 5 commits into
Kunall7890 wants to merge 5 commits into
Conversation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Windows validation for MCP latency benchmark — addresses #11.
What I found
After installing
@nhonh/react-debugger@2.1.2globally and runningthe benchmark, I discovered that the
mcpsubcommand is an interactiveinstaller (creates a local
/mcpdirectory), not a stdio JSON-RPCserver. The CLI only exposes
-v,-h, and-yflags — there is no--stdiotransport available in the current published version.This means Phase A (the MCP stdio server) has not been published to
npm yet, so latency data cannot be collected at this time.
Windows-specific bugs found and fixed in the script
spawn EINVAL.cmdfiles needshell: trueon Windowsshell: trueto spawn optionsspawn ENOENT.cmdwrappers — plain path failsresolveBin()now prefers.cmdpath fromwhereoutputThese bugs are Windows-only and would not appear on macOS/Linux.
Files added
scripts/bench-mcp-latency.mjs— reusable benchmark runner, works onWindows + Linux, auto-detects OS and writes the correct output file
evidence/phase0-latency-windows.json— run metadata + environment infoevidence/phase0-latency-windows-notes.md— full investigation writeupReady to re-run
Once
react-debugger mcp --stdio(or equivalent) is available in apublished version, re-running:
on Windows will produce valid
evidence/phase0-latency-windows.jsontiming data automatically. No script changes needed.
Environment