auraone

Connect agent systems, inspect tool traces, replay failures, compare candidates, and export regression evidence.

Author, validate, preview, calibrate, diff, and export criterion-level AI evaluation rubrics.

Synchronize robot episodes, inspect failures and recoveries, record review decisions, and export checksummed evidence.

Measure inter-annotator agreement with modern metrics, uncertainty, ordinal support, and missing-data handling.

Probe judge behavior for position, verbosity, self-preference, paraphrase, anchoring, and calibration failures.

Validate and render a disclosure record for judge prompts, calibration, bias, limitations, and intended use.

Validate required Datasheet, Model Card, and Data Card sections and surface actionable review findings.

Scan MCP manifests, package metadata, source, and docs for tool, auth, filesystem, shell, network, and readiness risks.

Import rubric JSON and response JSONL, validate them, run deterministic scoring, and inspect exact evidence in the browser.

Validate, lint, diff, and convert portable AuraOne Rubric Schema v1 files.

Shared Proofline UI, runtime contracts, keychain, updater, and release infrastructure for AuraOne Open desktop Studios.

Score repository responses against an AuraOne rubric and publish one consistent GitHub evidence surface.

Normalize agent tool-call traces into deterministic replay artifacts and pytest cases.

Compare before and after prompt and rubric directories and generate deterministic drift review notes.

Validate agent cards, capabilities, structured payloads, errors, cancellation, and task lifecycle behavior.

Run executable rubric-spec v1 compatibility checks and emit reproducible conformance evidence.

Convert OpenTelemetry or Phoenix GenAI trace exports into local evaluation regression cases and manifests.

Validate and summarize human intervention and recovery segments in robot episodes.

Integrate hosted AuraOne evaluation workflows through typed REST and GraphQL clients.

Provide repo-ready MCP, A2A, OTEL, replay, compare, and CI examples.