Skip to content

Preserve BFCL argument values in model schemas - #53

Closed
SonAIengine wants to merge 1 commit into
codex/bfcl-schema-only-argument-guidancefrom
codex/bfcl-argument-value-preservation
Closed

Preserve BFCL argument values in model schemas#53
SonAIengine wants to merge 1 commit into
codex/bfcl-schema-only-argument-guidancefrom
codex/bfcl-argument-value-preservation

Conversation

@SonAIengine

Copy link
Copy Markdown
Owner

Summary

  • Add deterministic model-facing schema hints for argument value preservation.
  • Preserve boolean defaults, percentage-as-decimal rate values, open dict nesting, and query-local symbolic data references.
  • Bump the BFCL model-case cache version because prompts/tool schemas changed.
  • Document the Qwen 27B argument subset lift in the research notes.

Validation

  • poetry run ruff check .
  • poetry run ruff format --check .
  • poetry run pytest tests/test_bfcl_tool_selection_llm_loop.py tests/test_bfcl_tool_selection_sweep.py -q -> 26 passed
  • poetry run pytest tests/ -q -> 962 passed, 3 skipped, 1 warning
  • Fresh Qwen 27B run on the 6-case argument mismatch subset: evaluator exact 1.0, retrieval@5 1.0, failure tags {}

Qwen smoke artifact

  • /tmp/gtc-bfcl-argument-value-hints-v4-subset.json

Notes

@SonAIengine

Copy link
Copy Markdown
Owner Author

Closing this internal stacked PR as superseded by the current main branch. The branch is preserved for history.

@SonAIengine SonAIengine closed this Aug 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant