Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
496c1b4
Unify access process and stabilize container checks
buzzcrow Sep 29, 2026
8f8677d
Add protocol-specific chunk types
buzzcrow Sep 29, 2026
9dd9104
Plan explicit deployment protection
buzzcrow Sep 29, 2026
ab6e530
Configure protocol storage and single-node strip writes
buzzcrow Sep 30, 2026
9db6649
Configure ChunkDB background DiskIO transport
buzzcrow Sep 30, 2026
c55af26
Move access write policies into protocol libraries
buzzcrow Sep 30, 2026
4177c4d
Allow protected mirror writes on surviving nodes
buzzcrow Sep 30, 2026
6c9bac1
Enforce single-node strip policy during replacement
buzzcrow Sep 30, 2026
7b1ef37
Verify single-copy mirror errors propagate
buzzcrow Sep 30, 2026
8fa7f32
Align local S3 cluster with explicit test placement
buzzcrow Sep 30, 2026
73c922c
Add protected three-rack local cluster fixture
buzzcrow Sep 30, 2026
06fbb08
Trace degraded stream publication and preserve outage acceptance
buzzcrow Sep 30, 2026
72010b0
Advance access storage isolation and deployment protection
buzzcrow Sep 30, 2026
0d8d828
Tighten DiskIO lint and async test buffer lifetime
buzzcrow Sep 30, 2026
a974b6e
Restore protected cluster writes after ChunkDB failover
buzzcrow Sep 30, 2026
d70d173
Verify placement repair after protected cluster restart
buzzcrow Sep 30, 2026
4cfd391
Verify real DiskIO write errors reach small writers
buzzcrow Sep 30, 2026
2d91259
Verify single-copy reads fail after DiskIO loss
buzzcrow Sep 30, 2026
e92f298
Verify combined access protocols on protected storage
buzzcrow Sep 30, 2026
7f56867
Exercise nonaligned protected protocol writes
buzzcrow Sep 30, 2026
f1dd3ca
Verify S3 writes progress during Iceberg GC
buzzcrow Sep 30, 2026
c901bd7
Verify access monitor probes both listeners
buzzcrow Sep 30, 2026
bb34d44
Rotate small-write chunks after mirror repair exhaustion
buzzcrow Sep 30, 2026
ad6ca55
Verify journal write failure after DiskIO loss
buzzcrow Sep 30, 2026
324250b
Verify two-copy writes across mirror block boundary
buzzcrow Sep 30, 2026
be259da
Verify journal failure with live DiskIO errors
buzzcrow Sep 30, 2026
fcf1ce7
Move Iceberg file writer preparation into library
buzzcrow Sep 30, 2026
62d9842
Clarify remaining protocol ownership work
buzzcrow Sep 30, 2026
510f380
Centralize Iceberg uploaded file records
buzzcrow Sep 30, 2026
910695c
Document access ownership and deployment voting modes
buzzcrow Sep 30, 2026
d164574
Fail small writes when all pipelines disappear
buzzcrow Sep 30, 2026
21154b5
Keep Iceberg file writes on Iceberg chunks
buzzcrow Sep 30, 2026
9766ca8
Cover single-node reservation guard
buzzcrow Sep 30, 2026
92ba6fc
Keep default Iceberg write policy in library
buzzcrow Sep 30, 2026
2e44004
Fail access process when Iceberg workers stop
buzzcrow Sep 30, 2026
b817699
Use Iceberg write policy for GC pool
buzzcrow Sep 30, 2026
3a852e3
Reject zero-copy production mirror strips
buzzcrow Sep 30, 2026
8f3c577
Align access and strip design with protection policy
buzzcrow Sep 30, 2026
c7f1a91
Propagate terminal small-write manager failure
buzzcrow Sep 30, 2026
5bbf648
Verify single-node reservation protection
buzzcrow Sep 30, 2026
06e8c56
Move Iceberg GC storage adapters into library
buzzcrow Sep 30, 2026
55df4c4
Keep Iceberg streaming reads behind file storage
buzzcrow Sep 30, 2026
6c467f0
Keep Iceberg upload writers behind file storage
buzzcrow Sep 30, 2026
7825e5e
Verify combined access exit after storage failure
buzzcrow Sep 30, 2026
98c8a1e
Seal written mirror strips and verify single-node layouts
buzzcrow Sep 30, 2026
4eeeb8c
Bump version and publish latest container tag
buzzcrow Sep 30, 2026
3fa9632
Retire completed access and protection requirements
buzzcrow Sep 30, 2026
cd339df
Fix Iceberg CI test fixtures
buzzcrow Sep 30, 2026
1bb2099
Align CI assertions with single-node fixtures
buzzcrow Sep 30, 2026
5bb7bf5
Document native Iceberg object listing design questions
buzzcrow Sep 30, 2026
a8cbaa8
Improve Iceberg upload admission and large Parquet registration
buzzcrow Sep 30, 2026
685869d
Document Iceberg upload flow and improve CI diagnostics
buzzcrow Oct 1, 2026
28ef451
Treat DiskIO write payloads as opaque bytes
buzzcrow Oct 1, 2026
47bfbe4
Implement bounded Iceberg large upload flow
buzzcrow Oct 1, 2026
a65610b
Share upload flow and repair failed mirror writes
buzzcrow Oct 1, 2026
c597608
Measure upload waits and preserve mirror completion order
buzzcrow Oct 1, 2026
179a12c
Batch large mirror writes and recover failed chunks
buzzcrow Oct 1, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .github/workflows/release-container.yml
Original file line number Diff line number Diff line change
Expand Up @@ -143,7 +143,9 @@ jobs:
SOURCE_REVISION=${{ needs.verify.outputs.revision }}
PREVIEW_VERSION=${{ needs.verify.outputs.version }}
RUNTIME_SHA256=${{ needs.verify.outputs.runtime_sha256 }}
tags: docker.io/crowdb/crowdb-iceberg:${{ needs.verify.outputs.image_tag }}
tags: |
docker.io/crowdb/crowdb-iceberg:${{ needs.verify.outputs.image_tag }}
docker.io/crowdb/crowdb-iceberg:latest
- uses: sigstore/cosign-installer@v4.1.2
- name: Sign published digest
env:
Expand Down
17 changes: 12 additions & 5 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

# Changelog

CROWDB is preparing its first development release, `0.1.0-dev`. Publication
is pending; this is not a production release or a compatibility promise.
CROWDB is preparing `0.2.0`. This is a development version, not a
production release or a compatibility promise.

CROWDB does not yet maintain compatibility for persisted data, WAL, metadata,
or other on-disk formats. A newer checkout may be unable to read data created by
Expand All @@ -21,7 +21,14 @@ policy.

## [Unreleased]

### 0.1.0-dev preparation
### 0.2.0 preparation

- S3 and Iceberg own separate chunk types, storage policies, and write pools
behind one access-server process.
- Explicit single-node test and three-node production protection profiles,
with strip-level mirror and EC I/O and repairable degraded EC placement.

## [0.1.0]

- Single-node Linux amd64 container with native Iceberg REST catalog and FileIO,
backed by CROWDB metadata, chunk storage and disk services.
Expand All @@ -31,8 +38,8 @@ policy.
- Host builds and runtime-only container packaging, with a manual Docker Hub
publication workflow for version and commit tags, signatures, SBOM and provenance.

The intended image is `crowdb/crowdb-iceberg:v0.1.0-dev`; no published digest is
recorded yet. The GUI is not ready for this container. Multi-node deployment,
The preview image is `crowdb/crowdb-iceberg:0.1.0`; no published digest is
recorded here. Multi-node deployment,
production hardening and data-format upgrades are outside this release.

See the container deployment files for supported startup, persistence,
Expand Down
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ Thank you for contributing to CROWDB.

## Development status

CROWDB is under active development at version `0.1.0-dev`. It has not reached
CROWDB is under active development at version `0.2.0`. It has not reached
alpha, is not recommended for production, and must be tested with disposable
data. Compatibility is not yet maintained for persisted data, WAL, metadata, or
other on-disk formats. A change may deliberately replace an unreleased format
Expand Down
85 changes: 49 additions & 36 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading