From 00100cde7b93d810972f0f750b4dd48ea2a743cc Mon Sep 17 00:00:00 2001 From: DB Lee Date: Thu, 14 May 2026 11:27:43 -0700 Subject: [PATCH] docs(agent-workflow): deduplicate judge env var block Re-validated docs/tutorial-agent-workflow.md against current develop (291 lines). Single doc-only drift fixed: - Section 3 'Initialize AgentOps' set both AZURE_OPENAI_DEPLOYMENT and AZURE_AI_MODEL_DEPLOYMENT_NAME to the same value ('gpt-4o-mini'). _model_config() reads them as fallbacks of each other - setting both is redundant. Reduced to one, added a one-line note explaining the alias (same change as PR #158 for the Copilot-skills tutorial). Other claims verified against the code without re-deploying the container app: - The documented agentops.yaml shape (request_field, response_field, tool_calls_field at top level, plus thresholds for tool_call_accuracy / intent_resolution / task_adherence) parses cleanly via AgentOpsConfig.model_validate. - All six documented thresholds match real evaluators in src/agentops/core/evaluators.py (default thresholds at lines 82, 90, 181, 194, 212, 228). - The dataset shape (input + expected + tool_definitions + tool_calls) triggers the agent-evaluator set per the docstring in src/agentops/core/evaluators.py. - 'agentops workflow generate --kinds pr --force' still exists (--force here is generate's, not the deprecated skills install --force). - 'agentops doctor --severity-fail critical' is valid. Refs #130. --- docs/tutorial-agent-workflow.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/tutorial-agent-workflow.md b/docs/tutorial-agent-workflow.md index 9d13efe..e13441f 100644 --- a/docs/tutorial-agent-workflow.md +++ b/docs/tutorial-agent-workflow.md @@ -180,9 +180,12 @@ agentops init $env:AZURE_AI_FOUNDRY_PROJECT_ENDPOINT = "https://.services.ai.azure.com/api/projects/" $env:AZURE_OPENAI_ENDPOINT = "https://.openai.azure.com" $env:AZURE_OPENAI_DEPLOYMENT = "gpt-4o-mini" -$env:AZURE_AI_MODEL_DEPLOYMENT_NAME = "gpt-4o-mini" ``` +`AZURE_AI_MODEL_DEPLOYMENT_NAME` is accepted as a fallback name for the +judge deployment. Set only one of the two — `AZURE_OPENAI_DEPLOYMENT` +wins when both are set. + ## 4. Write `agentops.yaml` ```powershell