Skip to content

Selection 'generic' filter drops attributed personal realizations (LoCoMo qa/0083 gold lost) #177

Description

@fazpu

Evidence (2026-07-29, GLM-5.2 smoke store, conv-26)

LoCoMo qa/0083 asks: What did Melanie realize after the charity race? — gold: self-care is important (D2:3).

The v5-strong answer agent retrieved the charity-race claim at rank 1 but no realization claim exists in the store. The loss ledger (#161) shows why — claimify extracted it, selection dropped it:

decision_type: selection_drop  reason: generic
source_span: "The event was really thought-provoking. I'm starting to realize that self-care is really important. It's a journey for me..."

Analysis

The generic filter is doing what it was designed to do — drop low-information platitudes. But an attributed personal realization is not generic even when its content is a platitude: "Melanie realized self-care is important" is testimony about Melanie's state of mind, anchored to an event. The attribution + event anchor make it informative.

Proposed direction

Selection rubric amendment: first-person insight/realization statements ("I realized/learned/started to realize...") attributed to a speaker are exempt from the generic drop; the claim should be kept in attributed form ("X said she realized...").

Sizing

Wait for the full LoCoMo run — the ledger lets us join selection_drop/generic decisions against missed questions to quantify how often this pattern costs gold answers before touching the rubric.

Found by the loss ledger exactly as intended: extraction omission diagnosed to a named gate decision in minutes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions