Skip to content

WKG-80: Allow the users to disable certain built-in metrics#89

Open
nelly-hateva wants to merge 1 commit into
mainfrom
WKG-80
Open

WKG-80: Allow the users to disable certain built-in metrics#89
nelly-hateva wants to merge 1 commit into
mainfrom
WKG-80

Conversation

@nelly-hateva

@nelly-hateva nelly-hateva commented Jun 25, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

WKG-80:

Functional changes:

  • Allow the users to disable certain built-in metrics

Technical improvements:

  • Rename Evaluator to AnswerRelevanceEvaluator for consistency and readability
  • Common interface for all evaluators
  • Rename answer_eval_error to answer_correctness_error for consistency
  • Rename llm_factory.Config to llm_factory.LLMConfig and custom_evaluation.Config to custom_evaluation.EvaluatorConfig for better readability
  • Update github steps versions

@nelly-hateva nelly-hateva force-pushed the WKG-80 branch 7 times, most recently from a790d3d to 1785516 Compare June 26, 2026 13:49
@nelly-hateva nelly-hateva requested a review from pgan002 June 26, 2026 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pgan002 pgan002 Awaiting requested review from pgan002

Assignees

@pgan002 pgan002

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@nelly-hateva @pgan002