feat(eval): read-only batch-evaluation TUI (list + get) - #1938
Open
jariy17 wants to merge 2 commits into
Open
Conversation
jariy17
marked this pull request as ready for review
August 6, 2026 21:29
added 2 commits
August 7, 2026 19:07
Wire batch-evaluation into the eval TUI, mirroring evaluator/online-eval:
- BatchEvaluationPicker (PaginatedTablePicker over listBatchEvaluations) +
BatchEvaluationListScreen; enter on a row opens the job.
- BatchEvaluationGetJsonScreen — raw JSON only (no metadata hub); unwraps
getBatchEvaluation's { detail } (metadata + merged CloudWatch results).
- BatchEvaluationScreen menu (RouterScreen); the menu route is mandatory or the
eval menu entry falls through to the HelpScreen catch-all and exits the app.
- index.tsx now opens the TUI on a bare invocation (renderTui +
withTuiOnEmptyFlagsAndArgs) instead of printing help.
- Root.tsx: menu + list + bare-get-redirect + get/:id routes.
Screen tests cover menu, picker (rows/options/redirect/select/empty), and
detail (full JSON, CloudWatch-failure-degrades, retry). 752 pass.
Align the list column with every other picker (harness, runtime, online-eval, evaluator, memory, …): show updatedAt as 'updated UTC' rather than createdAt as 'created UTC'.
jariy17
force-pushed
the
feat/eval-batch-evaluation-tui
branch
from
August 7, 2026 19:08
3ec32c9 to
30585a8
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## feat/eval-batch-evaluation-readonly #1938 +/- ##
=======================================================================
+ Coverage 95.78% 95.81% +0.02%
=======================================================================
Files 296 300 +4
Lines 16431 16546 +115
=======================================================================
+ Hits 15738 15853 +115
Misses 693 693 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds the read-only TUI for
agentcore eval batch-evaluation, wiring it into the eval TUI alongsideevaluatorandonline-eval:list— a paginated, searchable table of batch evaluations (BatchEvaluationPickeroverPaginatedTablePicker). Enter on a row opens that job.get— a raw-JSON detail screen (JsonDetail). No metadata hub: the value is the full response (job metadata + per-sessionresults), which the JSON shows cleanly. UnwrapsgetBatchEvaluation's{ detail }(metadata + merged CloudWatch results).BatchEvaluationScreen(RouterScreen). This route is mandatory: the eval menu already listsbatch-evaluation, and without a route the entry falls through to theHelpScreencatch-all and exits the app.A bare
agentcore eval batch-evaluationnow opens the TUI (renderTui+withTuiOnEmptyFlagsAndArgs) instead of printing help.Demo
Files
src/components/BatchEvaluationPicker.tsx— list body (columns/toRow/loadPage), mirrorsOnlineEvalPicker.src/handlers/eval/batch-evaluation/list/screen.tsx—BatchEvaluationListScreen; enter → get.src/handlers/eval/batch-evaluation/get/screen.tsx—BatchEvaluationGetJsonScreen+useBatchEvaluationDetail.src/handlers/eval/batch-evaluation/screen.tsx—BatchEvaluationScreenmenu.index.tsxre-wired torenderTui;Root.tsxgets the menu + list + bare-get-redirect +get/:idroutes.Testing
batch-evaluation.screen.test.tsx— menu (get/list), picker (rows, Core-options, bare-get redirect, selection → JSON, empty), detail (full JSON incl. merged results, CloudWatch-failure-degrades, retry).