Skip to content

Feedback: evolve the page layout to be independent of supabase/evals #18

Description

@leggetter

From Gareth, on the first draft:

Rather than saying 'we copied it', I'd probably reference them saying 'Inspired by
Supabase Evals we…'. Especially if we evolve the layout to be more independent -
which I think we should do.

Three design directions were attached to the thread: a public-record ledger, an
evidence-first transcript view, and a skills A/B delta report. I have not seen the
images
, so this issue records the direction rather than assessing them.

Attribution wording is already changed, to "based on" rather than "copied". That
was chosen over "inspired by" deliberately: the tree was imported at a commit and
modified, which NOTICE and CHANGES.md state in full for Apache-2.0 purposes.
"Inspired by" would understate it, and on a page whose argument is that its numbers
are checkable, the first checkable claim should be accurate. "Based on" reads better
than "copied" and stays true.

On layout independence: the current page is a close port of upstream's information
architecture, which was the right way to ship a first draft and is not a reason to
keep it. Two of the three directions Gareth described map onto work already open:

Worth noting the first loop closed as a negative result: the CLI fix bought no
measurable improvement because the failures were variance. A page that lists
improvements needs to handle that honestly, or it becomes a marketing surface that
only reports wins, which is the opposite of the project's stated goal.

Done when there is an agreed design direction, informed by what the data can
actually support.

Metadata

Metadata

Assignees

No one assigned

    Labels

    publishingThe results page, contract and docs

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions