revert mcp gym issue #628
benjibcci.yml
on: pull_request
Lint & Type Check
1m 2s
Matrix: test-core
Batch Evaluation Tests
2m 34s
MCP End-to-End Tests
1m 54s
Upload Coverage
5s
Annotations
10 errors and 3 warnings
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L108
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_abcd_letter"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L85
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
"split" is not a known attribute of "None" (reportOptionalMemberAccess)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
Cannot access attribute "split" for class "List[ChatCompletionContentPartTextParam]"
Attribute "split" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L79
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L63
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L101
No parameter named "data" (reportCallIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L85
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_boxed_text"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled
"Exception" is a subclass of "Exception" (reportUnusedExcept)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|