chore: TDR: unstructured review#239
Conversation
QualOps Code Quality AnalysisStatus: ✅ PASSED - No issues found Summary
No issues found in the analyzed code. 📊 Full ReportPowered by QualOps |
|
The document says reasoning models and many OpenAI-compatible/local models often cannot use json_schema. That was more true in 2024/early 2025, but it is too broad for June 2026.
https://www.requesty.ai/blog/structured-outputs-across-llm-providers-the-compatibility-mess Given the current movement into agentic & tool calls and so on, and the fact, that inference providers & hosts will drop old models to get capacity for more recent ones, my personal opinion is, that they become irrelevant very quickly. Even if there is the need to support such a model, it is imo the wrong approach, to build it into the core solution. It should be on inference serve/proxy level to "fix" this - like LMStudio and Ollama do it. https://lmstudio.ai/docs/developer/openai-compat/structured-output Imo, it is not worth to invest time here. |
TDR describing how we handle code review issue collection and reporting when the model does not support structured responses (JSON schemas)