[samkeen]

Summary

This PR adds a complete documentation site for the System One experiments, including a landing page and an interactive results page for the model-router experiment. The site is built with plain HTML, CSS, and JavaScript with no build dependencies, ready to be served by GitHub Pages.

Key Changes

• Landing page (docs/index.html): Introduces the System One experiments project with:

  • Hero section explaining the concept of models answering typed questions with calibrated probabilities
  • Live interactive instrument showing real model answers with animated probability bars
  • Question type examples and specimen experiment cards
  • Protocol overview and navigation to individual experiments

• Model-router results page (docs/model-router/index.html): Comprehensive walkthrough of the first live run comparing three Jev models:

  • Hero statistics showing task counts, routing decisions, and latency metrics
  • Interactive sections covering the routing problem, hypothesis, model details, and decision policy
  • Exploratory interface allowing users to adjust confidence thresholds and see how routing decisions change
  • Detailed scoreboard comparing model performance across multiple metrics
  • Findings and caveats sections

• Styling system (docs/assets/site.css, docs/model-router/results.css):

  • Comprehensive design system with CSS variables for light/dark themes
  • Linear-inspired neutral aesthetic with cool grays and indigo accent
  • Responsive layouts supporting mobile, tablet, and desktop viewports
  • Semantic color palette for decision models and routing levels

• Interactive functionality (docs/assets/site.js, docs/model-router/app.js):

  • Theme toggle with localStorage persistence
  • Reveal-on-scroll animations for progressive disclosure
  • Tooltip system for contextual information
  • Interactive bar slider for exploring routing decisions at different confidence thresholds
  • Real-time calculation of routing outcomes based on model probabilities

• Data pipeline (docs/tools/build-model-router-data.mjs):

  • Build script that transforms raw model-router evaluation results into the data structure consumed by the results page
  • Validates generated summaries against recorded run data to prevent drift
  • Generates docs/model-router/data.js containing all metrics and task data

• Supporting files:

  • docs/README.md: Documentation for the docs folder structure
  • docs/.nojekyll: Disables Jekyll processing for GitHub Pages

Notable Implementation Details

• The results page is fully self-contained with no external dependencies beyond Google Fonts
• Interactive elements use native HTML inputs and vanilla JavaScript for maximum compatibility
• The data generation script validates consistency between the page's displayed summaries and the original run data
• Responsive design uses CSS Grid and Flexbox with mobile-first media queries
• Color scheme automatically adapts to system preferences with manual override capability
• Tooltips and interactive elements are keyboard accessible with proper ARIA labels

https://claude.ai/code/session_01K1eyyappwT4oMyRMLPHhYZ

Summary by CodeRabbit

• New Features
  • Added a responsive documentation site with light and dark themes, accessible navigation, and reduced-motion support.
  • Added a model-router results page with interactive charts, task and bar explorers, filters, routing summaries, and latency metrics.
  • Added a landing page featuring experiment summaries, protocol details, and an interactive model-answer replay.
• Documentation
  • Added guidance on the site’s contents, publishing, local preview, and model-router evaluation data.

[coderabbitai]

Note

Currently processing new changes in this PR. This may take a few minutes, please wait...

⚙️ Run configuration

• Configuration used: Organization UI
• Review profile: CHILL
• Plan: Advanced
• Run ID: 03277676-3f0c-46f3-939a-e07797f3ff31

📥 Commits

Reviewing files that changed from the base of the PR and between c787598 and 0377673.

📒 Files selected for processing (10)

• docs/.nojekyll
• docs/README.md
• docs/assets/site.css
• docs/assets/site.js
• docs/index.html
• docs/model-router/app.js
• docs/model-router/data.js
• docs/model-router/index.html
• docs/model-router/results.css
• docs/tools/build-model-router-data.mjs

 ________________________________________
< Even Chuck Norris needs a code review. >
 ----------------------------------------
  \
   \   (\__/)
       (•ㅅ•)
       / 　 づ

✨ Finishing Touches

📝 Generate docstrings

• Commit to this branch
• Create a new PR

🧪 Generate unit tests (beta)

• Commit to this branch
• Create a new PR

• Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}