Skip to content

Commit 051dda2

Browse files
authored
feat(example): support server video inputs and Gemma text tool calls (abetlen#2291)
* feat(example): support server video inputs and Gemma text tool calls * fix(example): pass media count to MTMD tokenizer * fix(example): avoid MTMD video stdin double close * fix(example): parse Gemma text tool bracket calls
1 parent e107999 commit 051dda2

3 files changed

Lines changed: 354 additions & 63 deletions

File tree

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
77

88
## [Unreleased]
99

10+
- feat(example): support server video inputs and Gemma text tool calls by @abetlen in #2291
1011
- feat: update llama.cpp to ggml-org/llama.cpp@8f83d6c27
1112
- fix(example): support multi-step Responses tool streaming by @abetlen in #2288
1213
- fix(ci): Repair Linux accelerator wheels for manylinux publishing

examples/server/configs/gemma-4-12b-it-qat.json

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@
4444
},
4545
"tool_calls": {
4646
"type": "array",
47-
"x-regex-iterator": "<\\|tool_call>(call:[^\\{]+\\{.*?\\})<tool_call\\|>",
47+
"x-regex-iterator": "<\\|tool_call>(call:[^\\{\\[]+[\\{\\[].*?[\\}\\]])<tool_call\\|>",
4848
"items": {
4949
"type": "object",
5050
"properties": {
@@ -56,11 +56,11 @@
5656
"properties": {
5757
"name": {
5858
"type": "string",
59-
"x-regex": "^call:(\\w+)\\{"
59+
"x-regex": "^call:(\\w+)[\\{\\[]"
6060
},
6161
"arguments": {
6262
"type": "object",
63-
"x-regex": "^call:\\w+(\\{.*\\})$",
63+
"x-regex": "^call:\\w+(\\{.*\\}|\\[.*\\])$",
6464
"x-parser": "gemma4-tool-call",
6565
"additionalProperties": true
6666
}

0 commit comments

Comments
 (0)