Skip to content

[OpenCOOD] Implement model-specific V2X payloads for all fusion strategies - #198

Merged
Haralishev77 merged 2 commits into
mainfrom
feature/model-specific-v2x-payloads
Sep 4, 2026
Merged

Haralishev77 merged 2 commits into
mainfrom
feature/model-specific-v2x-payloads

Conversation

@Haralishev77

Copy link
Copy Markdown
Member

Summary

Introduce model-specific V2X communication boundaries so each CAV performs the appropriate local inference stages before transmitting data. Payloads now represent the actual information exchanged by Early, Late, Intermediate, Where2Comm, and FPV-RCNN fusion pipelines.

Related issue

Related to #192

Changes

  • Added typed, model-specific V2X payloads and communication adapters.
  • Changed Early fusion to transmit sender-local LiDAR and project it at the receiver.
  • Changed Late fusion to transmit decoded bounding boxes and confidence scores, followed by receiver-side projection and global NMS.
  • Changed Intermediate models to transmit learned spatial or multi-scale features instead of preprocessed voxel inputs.
  • Applied model compression before transmission and decompression before receiver-side fusion.
  • Applied the Where2Comm communication mask at the sender-side transmission boundary.
  • Kept GT, labels, anchors, object IDs, and visualization context local to the dataset.
  • Preserved FPV-RCNN cooperation using stage-one proposals and VSA point features without GT-dependent inference.
  • Added regression and equivalence tests for communication contracts, metadata, post-processing, compression, packet delivery, and model splits.

Validation

  • Simulation run
  • Manual verification

Validated Early, Late, Where2Comm, and FPV-RCNN communication paths in simulation. Added unit tests for the new and modified functionality; the complete CI test suite remains to be run.

Checklist

  • Linked the related issue
  • Kept the PR focused and reviewable

@Haralishev77 Haralishev77 self-assigned this Sep 4, 2026
@Haralishev77 Haralishev77 added enhancement New feature or request OpenCOOD Some changes in OpenCOOD module CoP Something new in cooperative perception category labels Sep 4, 2026
Comment thread OpenCOOD/test/test_communication_adapters.py Fixed
Comment thread OpenCOOD/opencood/models/communication_adapters/early.py Fixed
Comment thread OpenCOOD/opencood/models/communication_adapters/intermediate.py Fixed
Comment thread OpenCOOD/opencood/models/communication_adapters/late.py Fixed
Comment thread OpenCOOD/opencood/models/communication_adapters/where2comm.py Fixed
@Haralishev77
Haralishev77 merged commit 4c61faa into main Sep 4, 2026
8 checks passed
@Haralishev77
Haralishev77 deleted the feature/model-specific-v2x-payloads branch September 4, 2026 13:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CoP Something new in cooperative perception category enhancement New feature or request OpenCOOD Some changes in OpenCOOD module

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Compute cooperative perception features on each CAV and transmit compressed intermediate features

2 participants