Skip to content

Increase max_tokens for security 1.1 - #1697

Merged
bkorycki merged 4 commits into
mainfrom
increase-max-tokens-sec-1.1
Oct 14, 2026
Merged

bkorycki merged 4 commits into
mainfrom
increase-max-tokens-sec-1.1

Conversation

@bkorycki

Copy link
Copy Markdown
Contributor

No description provided.

@bkorycki
bkorycki requested a review from a team as a code owner October 13, 2026 20:10
@bkorycki
bkorycki deployed to Scheduled Testing October 13, 2026 20:10 — with GitHub Actions Active
@github-actions

Copy link
Copy Markdown

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@wpietri wpietri left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems plausible, but I'd love to see some tests that show that this accomplishes what you're intending.

@bkorycki
bkorycki deployed to Scheduled Testing October 13, 2026 21:00 — with GitHub Actions Active
@bkorycki

Copy link
Copy Markdown
Contributor Author

@wpietri I added some unit tests.

@bkorycki
bkorycki requested a review from wpietri October 13, 2026 21:01
@rogthefrog

Copy link
Copy Markdown
Contributor

@bkorycki what does this address?

@bkorycki

Copy link
Copy Markdown
Contributor Author

@rogthefrog it addresses #1696 . I believe the idea is that jailbreaks elicit longer responses, so we need to increase the max tokens accordingly.

@wpietri wpietri left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry for the confusion, but those tests don't strike me as helpful; they're just asserting that the config is the config, something that we can tell by looking at the code. For now just go ahead and remove them.

@bkorycki
bkorycki deployed to Scheduled Testing October 14, 2026 19:30 — with GitHub Actions Active
@bkorycki
bkorycki deployed to Scheduled Testing October 14, 2026 19:32 — with GitHub Actions Active
@bkorycki
bkorycki merged commit 0a4289b into main Oct 14, 2026
3 checks passed

This branch was successfully deployed

1 active deployment
Scheduled Testing — 99792c19 Deployed Oct 14, 2026 by bkorycki via build #2602
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants