Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,3 +40,8 @@ python -m scoring_engine.cli examples/anonymized_conversation.json

The baseline outputs dimension scores, confidence values, evidence keywords, and a
rubric version. It must only receive anonymized records.

## Developer Notes

- [scoring_engine/README.md](scoring_engine/README.md) explains the scorer package.
- [examples/README.md](examples/README.md) explains the synthetic scoring fixture.
13 changes: 13 additions & 0 deletions examples/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# Scoring Examples

This folder holds synthetic anonymized scoring inputs.

`anonymized_conversation.json` is shaped like the anonymization service output and can be
used with the CLI:

```bash
python -m scoring_engine.cli examples/anonymized_conversation.json
```

Examples in this repo should never contain raw contributor conversations or identifying
details.
22 changes: 22 additions & 0 deletions scoring_engine/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# Scoring Engine Package

This package scores anonymized conversation records. It must not receive raw submissions.

## File Map

- `baseline.py`: transparent keyword baseline and scoring output shape.
- `cli.py`: command-line wrapper around the baseline scorer.
- `__init__.py`: exports `score_record` for tests and future callers.

## Current Baseline

The scorer is deterministic and intentionally simple. It checks anonymized message text
for rubric keywords and returns dimension scores, confidence values, evidence keywords,
and `validated_for_claims: false`.

This is useful for wiring the pipeline together. It is not a validated research model.

## First Place To Edit

Add or adjust dimensions in `baseline.py`, then add synthetic tests in
`tests/test_baseline.py`. Keep examples anonymized.
Loading