Skip to content

docs: outline Mapache v4 architecture - #231

Open
BK1031 wants to merge 2 commits into
mainfrom
bk1031/v4-architecture-brainstorming
Open

BK1031 wants to merge 2 commits into
mainfrom
bk1031/v4-architecture-brainstorming

Conversation

@BK1031

@BK1031 BK1031 commented Sep 16, 2026

Copy link
Copy Markdown
Contributor
  • Document the current Mapache architecture and production-readiness gaps
  • Propose v4 vehicle, signal, ingestion, query, subscription, and widget contracts
  • Define reliability, authorization, operations, migration phases, and open design decisions

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 16, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-16T08:43:48.561405Z 0a87d2e PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0a87d2eba7

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread docs/v4-brainstorming.md
Comment on lines +607 to +609
2. Capture a subscription watermark/cursor.
3. Execute history through that watermark.
4. Buffer log events after the watermark while history runs.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Wait for the history store to reach the watermark

When the storage writer is behind the broker, capturing a broker cursor and immediately querying ClickHouse cannot return history "through" that cursor: the proposed observation row stores no broker partition or offset, while the buffer contains only events after the watermark. Pre-watermark records still awaiting persistence therefore appear in neither the snapshot nor the buffer and are silently lost from the subscription. Persist consumer coordinates and wait for the query store to materialize the watermark, or buffer from an earlier boundary, before emitting snapshot completion.

Useful? React with 👍 / 👎.

Comment thread docs/v4-brainstorming.md
Comment on lines +354 to +356
platform_id nullable
vehicle_id nullable
source_id

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Decouple platform bindings from vehicle-owned sources

When multiple vehicles share a platform, every source_id is nevertheless vehicle-scoped by the data-source model, so a binding that requires source_id can belong to only one vehicle and cannot act as the advertised reusable platform-level binding. Creating one copy per vehicle also removes the platform-default/vehicle-override behavior described below. Model a platform source role or binding template separately, then resolve it to each vehicle's concrete source.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant