From 822e774f0ef18c88c9ffcee758bbd67e69314033 Mon Sep 17 00:00:00 2001 From: Sofiya Nuryyeva Date: Fri, 21 Aug 2026 10:49:19 -0400 Subject: [PATCH 1/5] adding new OKP tests --- tests/e2e/features/okp_rag.feature | 229 +++++++++++++++++++++++++++++ tests/e2e/features/query.feature | 24 +++ tests/e2e/test_list.txt | 1 + 3 files changed, 254 insertions(+) create mode 100644 tests/e2e/features/okp_rag.feature diff --git a/tests/e2e/features/okp_rag.feature b/tests/e2e/features/okp_rag.feature new file mode 100644 index 000000000..989cf1061 --- /dev/null +++ b/tests/e2e/features/okp_rag.feature @@ -0,0 +1,229 @@ +@cfg_okp +Feature: OKP(Solr) RAG retrieval tests + + # Offline Knowledge Portal (OKP) provides a Solr-backed RAG source to LSC. + # Tests verify that Lightspeed Stack can use OKP for both Inline RAG + # (context injected before the LLM request) and Tool RAG (context + # retrieved on demand via file_search), in both offline and online modes. + + Background: + Given The service is started locally + And The system is in default state + And OKP(Solr) server is running + And I set the Authorization header to Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzdWIiOiIxMjM0NTY3ODkwIiwibmFtZSI6Ikpva + And REST API service prefix is /v1 + And the Lightspeed stack configuration directory is "tests/e2e/configuration" + + # ── Inline RAG — Query ── + + Scenario Outline: mode query with inline RAG returns rag_chunks and referenced_documents + Given The service uses the configuration + And The service is restarted + When I use "query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And The response contains non-empty rag_chunks + And The response contains non-empty referenced_documents + And The number of rag_chunk returned is + And Each rag_chunk has a non-empty score + And Each rag_chunk source is "okp" + And Each referenced_document has fields doc_url, doc_title, source, and document_id + And Each referenced_document doc_url contains "" + And Each referenced_document doc_title is not empty + And Each referenced_document source is "okp" + And Each referenced_document has a non-empty document_id + + Examples: Offline + | mode | config | max_chunks | doc_url_domain | + | Offline | lightspeed-stack-okp-offline.yaml | 5 | localhost:8081 | + + Examples: Online + | mode | config | max_chunks | doc_url_domain | + | Online | lightspeed-stack-okp-online.yaml | 1 | docs.redhat.com | + + # ── Inline RAG — Streaming Query ── + + Scenario Outline: mode streaming query with inline RAG returns referenced_documents + Given The service uses the configuration + And The service is restarted + When I use "streaming_query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And I wait for the response to be completed + And The response contains non-empty referenced_documents + And Each referenced_document has fields doc_url, doc_title, source, and document_id + And Each referenced_document doc_url contains "" + And Each referenced_document doc_title is not empty + And Each referenced_document source is "okp" + And Each referenced_document has a non-empty document_id + + Examples: Offline + | mode | config | doc_url_domain | + | Offline | lightspeed-stack-okp-offline.yaml | localhost:8081 | + + Examples: Online + | mode | config | doc_url_domain | + | Online | lightspeed-stack-okp-online.yaml | docs.redhat.com | + + # ── Inline RAG — Query with Dynamic Filter ── + + Scenario Outline: Query with inline RAG with dynamic filter returns rag_chunks and referenced_documents + Given The service uses the lightspeed-stack-okp-offline.yaml configuration + And The service is restarted + When I use "query" to ask question with authorization header + """ + {"query": "Security best practices", + "solr": { + "mode": "", + "filters": { + "filters": { + "type": "in", + "key": "product", + "value": ["openshift_container_platform", "ansible_automation_platform", "red_hat_enterprise_linux"] + } + } + } + } + """ + Then The status code of the response is 200 + And The response contains non-empty rag_chunks + And The response contains non-empty referenced_documents + And The number of rag_chunk returned is 5 + And Each rag_chunk has a non-empty score + And Each rag_chunk source is "okp" + And Each referenced_document has fields doc_url, doc_title, source, and document_id + And Each referenced_document doc_url contains "" + And Each referenced_document doc_title is not empty + And Each referenced_document source is "okp" + And Each referenced_document has a non-empty document_id + + Examples: + | filter_mode | doc_url_domain | + | semantic | localhost:8081 | + | hybrid | docs.redhat.com | + + # ── Tool RAG — Query API ── + + Scenario Outline: queries API with OKP tool RAG has rag_chunk and referenced_documents returned + Given The service uses the configuration + And The service is restarted + When I use "query" to ask question with authorization header + """ + { + "query": "configure remote desktop using gnome", + "model": "{MODEL}", + "provider": "{PROVIDER}", + "system_prompt": "You MUST use the file_search tool to answer." + } + """ + Then The status code of the response is 200 + And The response contains non-empty tool_calls + And A tool_call has name "file_search" + And The response contains non-empty rag_chunks + And The number of rag_chunk returned is + And Each rag_chunk has a non-empty score + And Each rag_chunk source is "okp" + And The response contains non-empty referenced_documents + And Each referenced_document has fields doc_url, doc_title, source, and document_id + And Each referenced_document doc_url contains "" + And Each referenced_document doc_title is not empty + And Each referenced_document source is "okp" + And Each referenced_document has a non-empty document_id + + Examples: Offline + | mode | config | max_chunks | doc_url_domain | + | Offline | lightspeed-stack-okp-tool-offline.yaml | 5 | localhost:8081 | + + Examples: Online + | mode | config | max_chunks | doc_url_domain | + | Online | lightspeed-stack-okp-tool-online.yaml | 1 | access.redhat.com | + + # ── Tool RAG — Streaming Query API ── + + Scenario Outline: streaming query API with OKP tool RAG has rag_chunk and referenced_documents returned + Given The service uses the configuration + And The service is restarted + When I use "query" to ask question with authorization header + """ + { + "query": "configure remote desktop using gnome", + "model": "{MODEL}", + "provider": "{PROVIDER}", + "system_prompt": "You MUST use the file_search tool to answer." + } + """ + Then The status code of the response is 200 + And A tool_call has name "file_search" + And The response contains non-empty content + And The response contains non-empty referenced_documents + And Each referenced_document has fields doc_url, doc_title, source, and document_id + And Each referenced_document doc_url contains "" + And Each referenced_document doc_title is not empty + And Each referenced_document source is "okp" + And Each referenced_document has a non-empty document_id + + Examples: Offline + | mode | config | doc_url_domain | + | Offline | lightspeed-stack-okp-tool-offline.yaml | localhost:8081 | + + Examples: Online + | mode | config | doc_url_domain | + | Online | lightspeed-stack-okp-tool-online.yaml | access.redhat.com | + + # ── Tool RAG — Responses API ── + + Scenario Outline: responses API with OKP tool RAG has rag results returned + Given The service uses the configuration + And The service is restarted + When I use "responses" to ask question with authorization header + """ + { + "input": "configure remote desktop using gnome", + "model": "{PROVIDER}/{MODEL}", + "stream": false, + "instructions": "You MUST use the file_search tool to answer." + } + """ + Then The status code of the response is 200 + And The responses output includes an item with type "file_search_call" + And The response contains non-empty tool_calls + And A tool_call has type "file_search" + And The response contains non-empty results + And The number of results returned is + And Each rag_chunk has a non-empty score + And Each rag_chunk source is "okp" + And Each rag_chunk reference_url contains "" + + Examples: Offline + | mode | config | max_chunks | doc_url_domain | + | Offline | lightspeed-stack-okp-tool-offline.yaml | 5 | localhost:8081 | + + Examples: Online + | mode | config | max_chunks | doc_url_domain | + | Online | lightspeed-stack-okp-tool-online.yaml | 1 | access.redhat.com | + + # # ── OKP Server Unavailable — Graceful Error Handling ─────────────── + + Scenario: Query succeeds with empty rag_chunks when OKP server is unavailable + Given The OKP(Solr) server is stopped + When I use "query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And The response contains no rag_chunks + And The response contains no referenced_documents + + Scenario: Streaming query succeeds with empty referenced_documents when OKP server is unavailable + Given The OKP(Solr) server is stopped + When I use "streaming_query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And I wait for the response to be completed + And The response contains no referenced_documents diff --git a/tests/e2e/features/query.feature b/tests/e2e/features/query.feature index c0207315c..702fc1490 100644 --- a/tests/e2e/features/query.feature +++ b/tests/e2e/features/query.feature @@ -279,3 +279,27 @@ Scenario: Check if LLM responds for query request with error for missing query When I use "query" to ask question with too-long query and authorization header Then The status code of the response is 413 And The body of the response contains Prompt is too long + + # # ── OKP RAG Disabled (okp not in rag.retrieval.inline.sources) ───── + @cfg_okp + Scenario: Query returns no rag_chunks and no reference_documents when OKP OKP is disabled + Given The service uses the lightspeed-stack-okp-disabled.yaml configuration + And The service is restarted + When I use "query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And The response contains no rag_chunks + And The response contains no reference_documents + @cfg_okp + Scenario: Streaming query returns no referenced_documents when OKP is disabled + Given The service uses the lightspeed-stack-okp-disabled.yaml configuration + And The service is restarted + When I use "streaming_query" to ask question with authorization header + """ + {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} + """ + Then The status code of the response is 200 + And I wait for the response to be completed + And The response contains no referenced_documents diff --git a/tests/e2e/test_list.txt b/tests/e2e/test_list.txt index 2a5d97f05..c9ff90ed5 100644 --- a/tests/e2e/test_list.txt +++ b/tests/e2e/test_list.txt @@ -39,3 +39,4 @@ features/unified-mode-legacy.feature features/unified-mode-validation.feature features/unified-mode-migration.feature features/unified-mode-synthesis.feature +features/okp_rag.feature From b870f99e14a0f934c8ebd049aa2989628fe38d60 Mon Sep 17 00:00:00 2001 From: Sofiya Nuryyeva Date: Fri, 21 Aug 2026 10:53:48 -0400 Subject: [PATCH 2/5] added skip tags --- tests/e2e/features/okp_rag.feature | 2 +- tests/e2e/features/query.feature | 2 ++ 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/tests/e2e/features/okp_rag.feature b/tests/e2e/features/okp_rag.feature index 989cf1061..ba5193cb4 100644 --- a/tests/e2e/features/okp_rag.feature +++ b/tests/e2e/features/okp_rag.feature @@ -1,4 +1,4 @@ -@cfg_okp +@cfg_okp @skip Feature: OKP(Solr) RAG retrieval tests # Offline Knowledge Portal (OKP) provides a Solr-backed RAG source to LSC. diff --git a/tests/e2e/features/query.feature b/tests/e2e/features/query.feature index 702fc1490..555aee0b6 100644 --- a/tests/e2e/features/query.feature +++ b/tests/e2e/features/query.feature @@ -282,6 +282,7 @@ Scenario: Check if LLM responds for query request with error for missing query # # ── OKP RAG Disabled (okp not in rag.retrieval.inline.sources) ───── @cfg_okp + @skip Scenario: Query returns no rag_chunks and no reference_documents when OKP OKP is disabled Given The service uses the lightspeed-stack-okp-disabled.yaml configuration And The service is restarted @@ -293,6 +294,7 @@ Scenario: Check if LLM responds for query request with error for missing query And The response contains no rag_chunks And The response contains no reference_documents @cfg_okp + @skip Scenario: Streaming query returns no referenced_documents when OKP is disabled Given The service uses the lightspeed-stack-okp-disabled.yaml configuration And The service is restarted From a59edeaba8ccf5298f0c6c893fe0c17fbc626491 Mon Sep 17 00:00:00 2001 From: Sofiya Nuryyeva Date: Fri, 21 Aug 2026 11:11:14 -0400 Subject: [PATCH 3/5] fixed typo --- tests/e2e/features/okp_rag.feature | 2 +- tests/e2e/features/query.feature | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/tests/e2e/features/okp_rag.feature b/tests/e2e/features/okp_rag.feature index ba5193cb4..642393776 100644 --- a/tests/e2e/features/okp_rag.feature +++ b/tests/e2e/features/okp_rag.feature @@ -147,7 +147,7 @@ Feature: OKP(Solr) RAG retrieval tests Scenario Outline: streaming query API with OKP tool RAG has rag_chunk and referenced_documents returned Given The service uses the configuration And The service is restarted - When I use "query" to ask question with authorization header + When I use "streaming_query" to ask question with authorization header """ { "query": "configure remote desktop using gnome", diff --git a/tests/e2e/features/query.feature b/tests/e2e/features/query.feature index 555aee0b6..3660ad290 100644 --- a/tests/e2e/features/query.feature +++ b/tests/e2e/features/query.feature @@ -292,7 +292,7 @@ Scenario: Check if LLM responds for query request with error for missing query """ Then The status code of the response is 200 And The response contains no rag_chunks - And The response contains no reference_documents + And The response contains no referenced_documents @cfg_okp @skip Scenario: Streaming query returns no referenced_documents when OKP is disabled From 3a070beb1ee9e4ff4d78a253841b07a2b10b1fba Mon Sep 17 00:00:00 2001 From: Sofiya Nuryyeva Date: Fri, 21 Aug 2026 11:22:32 -0400 Subject: [PATCH 4/5] removed extra config calls --- tests/e2e/features/query.feature | 4 ---- 1 file changed, 4 deletions(-) diff --git a/tests/e2e/features/query.feature b/tests/e2e/features/query.feature index 3660ad290..18e3d155c 100644 --- a/tests/e2e/features/query.feature +++ b/tests/e2e/features/query.feature @@ -284,8 +284,6 @@ Scenario: Check if LLM responds for query request with error for missing query @cfg_okp @skip Scenario: Query returns no rag_chunks and no reference_documents when OKP OKP is disabled - Given The service uses the lightspeed-stack-okp-disabled.yaml configuration - And The service is restarted When I use "query" to ask question with authorization header """ {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} @@ -296,8 +294,6 @@ Scenario: Check if LLM responds for query request with error for missing query @cfg_okp @skip Scenario: Streaming query returns no referenced_documents when OKP is disabled - Given The service uses the lightspeed-stack-okp-disabled.yaml configuration - And The service is restarted When I use "streaming_query" to ask question with authorization header """ {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} From cadd731e05b48b2c8635b5fa1d977d49ec683e18 Mon Sep 17 00:00:00 2001 From: Sofiya Nuryyeva Date: Mon, 24 Aug 2026 15:23:44 -0400 Subject: [PATCH 5/5] refactored okp rag tests --- tests/e2e/features/okp_rag.feature | 142 +++++++---------------------- 1 file changed, 35 insertions(+), 107 deletions(-) diff --git a/tests/e2e/features/okp_rag.feature b/tests/e2e/features/okp_rag.feature index 642393776..6d419224d 100644 --- a/tests/e2e/features/okp_rag.feature +++ b/tests/e2e/features/okp_rag.feature @@ -14,10 +14,10 @@ Feature: OKP(Solr) RAG retrieval tests And REST API service prefix is /v1 And the Lightspeed stack configuration directory is "tests/e2e/configuration" - # ── Inline RAG — Query ── + # ── Inline RAG — Query (offline) ── - Scenario Outline: mode query with inline RAG returns rag_chunks and referenced_documents - Given The service uses the configuration + Scenario: Offline mode query with inline RAG returns rag_chunks and referenced_documents + Given The service uses the lightspeed-stack-okp-offline.yaml configuration And The service is restarted When I use "query" to ask question with authorization header """ @@ -26,27 +26,20 @@ Feature: OKP(Solr) RAG retrieval tests Then The status code of the response is 200 And The response contains non-empty rag_chunks And The response contains non-empty referenced_documents - And The number of rag_chunk returned is + And The number of rag_chunk returned is 1 And Each rag_chunk has a non-empty score And Each rag_chunk source is "okp" And Each referenced_document has fields doc_url, doc_title, source, and document_id - And Each referenced_document doc_url contains "" + And The number of eferenced_document returned is 1 + And Each referenced_document doc_url contains "localhost:8081" And Each referenced_document doc_title is not empty And Each referenced_document source is "okp" And Each referenced_document has a non-empty document_id - Examples: Offline - | mode | config | max_chunks | doc_url_domain | - | Offline | lightspeed-stack-okp-offline.yaml | 5 | localhost:8081 | - - Examples: Online - | mode | config | max_chunks | doc_url_domain | - | Online | lightspeed-stack-okp-online.yaml | 1 | docs.redhat.com | - - # ── Inline RAG — Streaming Query ── + # ── Inline RAG — Streaming Query (online) ── - Scenario Outline: mode streaming query with inline RAG returns referenced_documents - Given The service uses the configuration + Scenario: Online mode streaming query with inline RAG returns referenced_documents + Given The service uses the lightspeed-stack-okp-online.yaml configuration And The service is restarted When I use "streaming_query" to ask question with authorization header """ @@ -56,29 +49,23 @@ Feature: OKP(Solr) RAG retrieval tests And I wait for the response to be completed And The response contains non-empty referenced_documents And Each referenced_document has fields doc_url, doc_title, source, and document_id - And Each referenced_document doc_url contains "" + And The number of eferenced_document returned is 3 + And Each referenced_document doc_url contains "docs.redhat.com" And Each referenced_document doc_title is not empty + And Each referenced_document doc_title contains "openshift container platform 4.21" And Each referenced_document source is "okp" And Each referenced_document has a non-empty document_id - Examples: Offline - | mode | config | doc_url_domain | - | Offline | lightspeed-stack-okp-offline.yaml | localhost:8081 | - - Examples: Online - | mode | config | doc_url_domain | - | Online | lightspeed-stack-okp-online.yaml | docs.redhat.com | - # ── Inline RAG — Query with Dynamic Filter ── - Scenario Outline: Query with inline RAG with dynamic filter returns rag_chunks and referenced_documents + Scenario: Query with inline RAG with dynamic semantic filter returns rag_chunks and referenced_documents Given The service uses the lightspeed-stack-okp-offline.yaml configuration And The service is restarted When I use "query" to ask question with authorization header """ {"query": "Security best practices", "solr": { - "mode": "", + "mode": "semantic", "filters": { "filters": { "type": "in", @@ -90,31 +77,28 @@ Feature: OKP(Solr) RAG retrieval tests } """ Then The status code of the response is 200 + And The response contains "security best practices" And The response contains non-empty rag_chunks And The response contains non-empty referenced_documents - And The number of rag_chunk returned is 5 + And The number of rag_chunk returned is 1 And Each rag_chunk has a non-empty score And Each rag_chunk source is "okp" And Each referenced_document has fields doc_url, doc_title, source, and document_id - And Each referenced_document doc_url contains "" + And The number of eferenced_document returned is 1 + And Each referenced_document doc_url contains "localhost:8081" And Each referenced_document doc_title is not empty And Each referenced_document source is "okp" And Each referenced_document has a non-empty document_id - Examples: - | filter_mode | doc_url_domain | - | semantic | localhost:8081 | - | hybrid | docs.redhat.com | + # ── Tool RAG — Query API (offline) ── - # ── Tool RAG — Query API ── - - Scenario Outline: queries API with OKP tool RAG has rag_chunk and referenced_documents returned - Given The service uses the configuration + Scenario: Offline query API with OKP tool RAG has rag_chunk and referenced_documents returned + Given The service uses the lightspeed-stack-okp-tool-offline.yaml configuration And The service is restarted When I use "query" to ask question with authorization header """ { - "query": "configure remote desktop using gnome", + "query": "Troubleshooting guide", "model": "{MODEL}", "provider": "{PROVIDER}", "system_prompt": "You MUST use the file_search tool to answer." @@ -124,65 +108,25 @@ Feature: OKP(Solr) RAG retrieval tests And The response contains non-empty tool_calls And A tool_call has name "file_search" And The response contains non-empty rag_chunks - And The number of rag_chunk returned is + And The number of rag_chunk returned is 2 And Each rag_chunk has a non-empty score And Each rag_chunk source is "okp" And The response contains non-empty referenced_documents And Each referenced_document has fields doc_url, doc_title, source, and document_id - And Each referenced_document doc_url contains "" - And Each referenced_document doc_title is not empty - And Each referenced_document source is "okp" - And Each referenced_document has a non-empty document_id - - Examples: Offline - | mode | config | max_chunks | doc_url_domain | - | Offline | lightspeed-stack-okp-tool-offline.yaml | 5 | localhost:8081 | - - Examples: Online - | mode | config | max_chunks | doc_url_domain | - | Online | lightspeed-stack-okp-tool-online.yaml | 1 | access.redhat.com | - - # ── Tool RAG — Streaming Query API ── - - Scenario Outline: streaming query API with OKP tool RAG has rag_chunk and referenced_documents returned - Given The service uses the configuration - And The service is restarted - When I use "streaming_query" to ask question with authorization header - """ - { - "query": "configure remote desktop using gnome", - "model": "{MODEL}", - "provider": "{PROVIDER}", - "system_prompt": "You MUST use the file_search tool to answer." - } - """ - Then The status code of the response is 200 - And A tool_call has name "file_search" - And The response contains non-empty content - And The response contains non-empty referenced_documents - And Each referenced_document has fields doc_url, doc_title, source, and document_id - And Each referenced_document doc_url contains "" + And Each referenced_document doc_url contains "localhost:8081" And Each referenced_document doc_title is not empty And Each referenced_document source is "okp" And Each referenced_document has a non-empty document_id - Examples: Offline - | mode | config | doc_url_domain | - | Offline | lightspeed-stack-okp-tool-offline.yaml | localhost:8081 | - - Examples: Online - | mode | config | doc_url_domain | - | Online | lightspeed-stack-okp-tool-online.yaml | access.redhat.com | + # ── Tool RAG — Responses API (online) ── - # ── Tool RAG — Responses API ── - - Scenario Outline: responses API with OKP tool RAG has rag results returned - Given The service uses the configuration + Scenario: Online responses API with OKP tool RAG has rag results returned + Given The service uses the lightspeed-stack-okp-tool-online.yaml configuration And The service is restarted When I use "responses" to ask question with authorization header """ { - "input": "configure remote desktop using gnome", + "input": "Troubleshooting guide", "model": "{PROVIDER}/{MODEL}", "stream": false, "instructions": "You MUST use the file_search tool to answer." @@ -193,37 +137,21 @@ Feature: OKP(Solr) RAG retrieval tests And The response contains non-empty tool_calls And A tool_call has type "file_search" And The response contains non-empty results - And The number of results returned is + And The number of results returned is 3 And Each rag_chunk has a non-empty score And Each rag_chunk source is "okp" - And Each rag_chunk reference_url contains "" - - Examples: Offline - | mode | config | max_chunks | doc_url_domain | - | Offline | lightspeed-stack-okp-tool-offline.yaml | 5 | localhost:8081 | + And Each rag_chunk reference_url contains "access.redhat.com" - Examples: Online - | mode | config | max_chunks | doc_url_domain | - | Online | lightspeed-stack-okp-tool-online.yaml | 1 | access.redhat.com | - - # # ── OKP Server Unavailable — Graceful Error Handling ─────────────── + # ── OKP Server Unavailable — Graceful Error Handling ── Scenario: Query succeeds with empty rag_chunks when OKP server is unavailable - Given The OKP(Solr) server is stopped + Given The service uses the lightspeed-stack-okp-online.yaml configuration + And The service is restarted + And The OKP(Solr) server is stopped When I use "query" to ask question with authorization header """ {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} """ Then The status code of the response is 200 And The response contains no rag_chunks - And The response contains no referenced_documents - - Scenario: Streaming query succeeds with empty referenced_documents when OKP server is unavailable - Given The OKP(Solr) server is stopped - When I use "streaming_query" to ask question with authorization header - """ - {"query": "configure remote desktop using gnome", "model": "{MODEL}", "provider": "{PROVIDER}"} - """ - Then The status code of the response is 200 - And I wait for the response to be completed - And The response contains no referenced_documents + And The response contains no referenced_documents \ No newline at end of file