Skip to content

Issue with Eval Sets/Cases #895

Description

@TooGoodDT

I created a few different eval sets/cases through the adk web dev ui. However, when I try to run these said eval sets that have been created through the server I get the following error:

Traceback (most recent call last):
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/applications.py", line 112, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 187, in call
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 165, in call
await self.app(scope, receive, _send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 714, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 734, in app
await route.handle(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 288, in handle
await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 76, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 73, in app
response = await f(request)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
return await dependant.call(**values)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/google/adk/cli/fast_api.py", line 470, in run_eval
await run_evals(
TypeError: object async_generator can't be used in 'await' expression

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions