Skip to content

[FEAT]: Add golden incident fixtures for extraction regression testing #482

@Harshvardhan-91

Description

@Harshvardhan-91

📝 Description

FireForm’s extraction pipeline is evolving quickly, with work around structured extraction, validation, confidence scoring, and template-aware filling.

To make future extraction changes safer, it would be useful to add a small set of golden incident fixtures: sample incident narratives paired with expected structured outputs.

Example fixture:

{
  "name": "basic_structure_fire",
  "input_text": "Engine 12 responded to a structure fire at 142 Oak Street at 18:40. No injuries were reported.",
  "expected": {
    "incident_type": "structure fire",
    "incident_address": "142 Oak Street",
    "unit": "Engine 12",
    "time": "18:40",
    "injuries": "No injuries reported"
  }
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions