Issues

• HumanLabeledDataset.from_csv silently coerces numeric response and objective text

  microsoft/PyRIT#2978 · Filter by author Garyouki opened on Oct 4, 2026

• SubStringScorer identifiers omit text matcher configuration

  microsoft/PyRIT#2977 · Filter by author Garyouki opened on Oct 4, 2026

• BUG HumanLabeledDataset.from_csv drops hash-prefixed rows and truncates text

  microsoft/PyRIT#2974 · Filter by author bIackr0se opened on Oct 3, 2026

• BUG: StringJoinConverter identifiers collide across distinct word selections

  microsoft/PyRIT#2973 · Filter by author LE0-Lin opened on Oct 3, 2026

• BUG: PlagiarismScorer accepts invalid n-gram size and blank reference text

  microsoft/PyRIT#2971 · Filter by author RohithPariki opened on Oct 3, 2026

• FEAT: Add a general scorer registry API for dataset-driven scenarios

  feature-requestGUInot ready yet
  microsoft/PyRIT#2970 · Filter by author romanlutz opened on Oct 3, 2026
  2

• PackageHallucinationScorer (Python) misses from pkg.sub import x and indented imports

  microsoft/PyRIT#2948 · Filter by author Zhuoxi2000 opened on Oct 1, 2026
  1

• SeedDatasetFilter(criteria=[]) silently matches no datasets

  Bug: triage
  microsoft/PyRIT#2947 · Filter by author hannahwestra25 opened on Oct 1, 2026

• AsciiArtConverter silently drops every non-ASCII character

  microsoft/PyRIT#2942 · Filter by author feiiiiii5 opened on Oct 1, 2026
  2

• AzureContentFilterScorer normalizes image severity by 7, but images only return 0/2/4/6

  microsoft/PyRIT#2939 · Filter by author feiiiiii5 opened on Oct 1, 2026

• Title: Feature Request: Attack strategy for Excessive Agency / unauthorized tool invocation

  feature-request
  microsoft/PyRIT#2903 · Filter by author antoniotoudji1 opened on Sep 28, 2026

• BUG General self-ask scorers crash when the judge returns a category

  microsoft/PyRIT#2896 · Filter by author u7k4rs6 opened on Sep 28, 2026

• BUG SelectiveTextConverter token stages convert text that was never selected

  microsoft/PyRIT#2892 · Filter by author u7k4rs6 opened on Sep 28, 2026

• FEAT Let attack techniques turn off judge feedback, and use it for GOAT to match the paper

  microsoft/PyRIT#2889 · Filter by author shashank03-dev opened on Sep 27, 2026
  1

• Question: external Gateway decisions alongside trace-backed invocation evidence

  microsoft/PyRIT#2887 · Filter by author krivonosoff161 opened on Sep 27, 2026

• Should the true/false aggregators get a strict-empty variant, like the float ones?

  microsoft/PyRIT#2883 · Filter by author feiiiiii5 opened on Sep 26, 2026

• LiteLLMChatTarget does not flag or survive output-token truncation

  microsoft/PyRIT#2878 · Filter by author feiiiiii5 opened on Sep 26, 2026

• Undefined t-statistic is written as bare NaN, making the metrics registry invalid JSON

  microsoft/PyRIT#2875 · Filter by author feiiiiii5 opened on Sep 26, 2026

• BUG Configuration keeps runtime-status errors after polling recovers

  Bug: triageGUIhelp wanted
  microsoft/PyRIT#2868 · Filter by author romanlutz opened on Sep 26, 2026
  1

• BUG Live reinitialization discards unsaved converter working-copy edits

  Bug: triageGUIhelp wanted
  microsoft/PyRIT#2867 · Filter by author romanlutz opened on Sep 26, 2026
  2

• BUG Connected clients save new attacks with stale operation defaults after reinitialization

  Bug: triageGUIhelp wanted
  microsoft/PyRIT#2866 · Filter by author romanlutz opened on Sep 26, 2026
  1

• Scorer metrics omit coverage when undetermined responses are excluded

  microsoft/PyRIT#2859 · Filter by author bIackr0se opened on Sep 26, 2026

• ObjectiveScorerEvaluator scores every conversation message as an assistant response

  microsoft/PyRIT#2835 · Filter by author feiiiiii5 opened on Sep 25, 2026

• BUG Scenario success rate counts ERROR attempts that were later retried or resumed

  microsoft/PyRIT#2819 · Filter by author u7k4rs6 opened on Sep 24, 2026
  2

• MAINT Extract scenario-history aggregate queries and record construction

  not ready yet
  microsoft/PyRIT#2769 · Filter by author romanlutz opened on Sep 22, 2026