feat: agent observability evaluation - #50
Merged
hifizz merged 126 commits intoSep 2, 2026
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Caution Review failedThe pull request is closed. ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Team Run ID: ⛔ Files ignored due to path filters (5)
📒 Files selected for processing (197)
📝 WalkthroughWalkthroughThe pull request adds Project Workspace management, attachment-composer demos, agent observability, feedback-score mirroring, evaluation tooling, private-relay models, database migrations, CI workflows, and supporting documentation. ChangesProject Workspace
Agent observability and evaluation
Attachment composer, model routing, and presentation
Documentation and runtime alignment
Estimated code review effort: 5 (Critical) | ~120 minutes Sequence Diagram(s)sequenceDiagram
participant ThreadChat
participant Generation
participant ProjectWorkspace
participant Observability
participant Langfuse
ThreadChat->>Generation: Start assistant generation
Generation->>ProjectWorkspace: Load contract and project files
ProjectWorkspace-->>Generation: Return context snapshot and statistics
Generation->>Observability: Record trace and model operations
Generation->>Langfuse: Export sanitized telemetry
Langfuse-->>Observability: Return export status
Generation-->>ThreadChat: Stream result and terminal state
sequenceDiagram
participant FeedbackAPI
participant Database
participant OutboxWorker
participant Langfuse
FeedbackAPI->>Database: Save feedback and enqueue versioned outbox row
FeedbackAPI-->>ThreadChat: Return updated feedback
OutboxWorker->>Database: Claim due row with lease
OutboxWorker->>Langfuse: Mirror deterministic score
Langfuse-->>OutboxWorker: Return success or failure
OutboxWorker->>Database: Acknowledge or schedule retry
✨ Finishing Touches 💡 1🛠️ Fix failing CI checks 💡
📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
- keep bubble open on outside click / scroll / resize while draft exists - ignore new text selections with a draft (copy-paste into the composer) - Esc with a draft opens a confirm dialog and shakes the bubble - entering/shake animations moved off steady-state to avoid tc-pop replay flash - draft-guard styles co-located with the component
- focus the question textarea only after the measured bubble becomes visible - replay the entrance transition for every new selection - compensate textarea borders to avoid phantom overflow - reuse a global slim scrollbar utility with Firefox support
…esign spec(project): 增加 Project 功能
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary by CodeRabbit
New Features
Bug Fixes