-
Notifications
You must be signed in to change notification settings - Fork 0
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Product coverage: Console has no scenarios, Outpost has one
scenarioScenario coverage, design or correctnessScenario coverage, design or correctnessStatus: Open.#19 In hookdeck/evals;Feedback: evolve the page layout to be independent of supabase/evals
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#18 In hookdeck/evals;Feedback: show skills and no-skills together, and link where to get the skills
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#17 In hookdeck/evals;Add Claude Opus: decide the cadence and the budget it needs
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#16 In hookdeck/evals;Feedback: drop the weaker-model caveat from the page
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#15 In hookdeck/evals;Scenarios flake, and single-attempt runs publish the flake as a result
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#14 In hookdeck/evals;Release process: package a run, its closed issues and its measured delta
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#13 In hookdeck/evals;Track the CLI agent-safety work that came out of this benchmark
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#12 In hookdeck/evals;Confirm the docs-suppression mechanism rather than inferring it
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#10 In hookdeck/evals;Investigate and resolve stages are too thin to publish as scores
scenarioScenario coverage, design or correctnessScenario coverage, design or correctnessStatus: Open.#8 In hookdeck/evals;Review and merge or drop the Codex cost-reporting branch
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#6 In hookdeck/evals;Decide which models and scenarios earn a place in the weekly run
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#5 In hookdeck/evals;