Skip to content

Document the file-backed parser architecture - #31

Merged
donatj merged 6 commits into
masterfrom
fix/architecture-guide
Oct 11, 2026
Merged

donatj merged 6 commits into
masterfrom
fix/architecture-guide

Conversation

@donatj

@donatj donatj commented Oct 11, 2026 •

Copy link
Copy Markdown
Owner

sqlread has already handled dumps far larger than available memory on machines with limited memory. Future changes must preserve that capability. The architecture needs to state this goal explicitly.

Add ARCHITECTURE.md with Rob Pike's Lexical Scanning in Go as the scanner's foundation. Treat the file as memory. Define bounded buffers, source spans, index storage, query execution, cancellation, and cache behavior. Identify areas for measurement or refinement.

State the supported-syntax scope, read-only source contract, and failure behavior. Prefer minimal explicit state and integration and functional tests.

Validation: checked the talk references, local file links, and diff whitespace. Documentation only. No runtime code changed.

@donatj
donatj marked this pull request as ready for review October 11, 2026 16:35
Copilot AI balanced review requested due to automatic review settings October 11, 2026 16:35

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The document does not clearly enumerate currently supported syntax or distinguish it from planned behavior.

1 open finding
What changed in this PR

Documents sqlread’s file-backed, bounded-memory architecture and future design constraints.

Changes:

  • Defines scanner, indexing, execution, cancellation, and cache contracts.
  • Identifies current memory-related refinement areas.
File Description
ARCHITECTURE.md Adds architectural principles and implementation guidance.

🧠 Review effort: Balanced


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread ARCHITECTURE.md
Comment on lines +21 to +22
sqlread supports a deliberate subset of dump formats and query syntax. Full SQL
compatibility is not a requirement. Document the supported syntax as it evolves.
@donatj
donatj merged commit f3ce26d into master Oct 11, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants