feat(scorers): support multiple python_scorer_* entries in run YAML - #528

Open

saurabh-net wants to merge 10 commits into

mainfrom

feature/multiple-python-scorers

Commits on Jul 27, 2026

feat(scorers): support multiple python_scorer_* entries in run YAML
saurabh-net
committed
ff33313
docs: add multiple python_scorer examples and parameter documentation
saurabh-net
committed
722f658
feat(scorers): retain custom_name fallbacks and resolve comparator_name in analyzer
saurabh-net
committed
e9cbaaa
style(analyzer): move import os to top-level and support binary_rubric_scorer prefix in analyzer
saurabh-net
committed
534cca4
fix(scorers): pass prompt_id to score_dict for prompt-level multi-trial aggregation
saurabh-net
committed
67acec0
revert: remove binary_rubric_scorer change to isolate in separate PR
saurabh-net
committed
314dabf
refactor(scorers): encapsulate custom_name resolution into get_python_scorer_name helper
saurabh-net
committed
b406941
style(scorers): move import os to top-level in scorers/util.py
saurabh-net
committed
44e39ea
style(scorers): simplify scorer_config dict fallback in score.py
saurabh-net
committed
2f4d325

Commits on Jul 28, 2026

style(analyzer): remove unused import os
saurabh-net
committed
5f49613