Skip to content

feat: add new tests - #559

Open
ramiy wants to merge 18 commits into
core-betafrom
tests/core
Open

ramiy wants to merge 18 commits into
core-betafrom
tests/core

Conversation

@ramiy

@ramiy ramiy commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@ramiy ramiy added the run-tests Trigger automated tests label Sep 18, 2026
@github-actions

Copy link
Copy Markdown

Playwright Test Failure

One or more Playwright targets failed in this workflow run.

See all Playwright errors (click to expand)

Affected Playwright test: chromium-file-based-snippets

FAILURE: code-snippets-evaluation.spec.ts:268:6 PHP snippets execute in priority order
[chromium-file-based-snippets] › code-snippets-evaluation.spec.ts:268:6 › Code Snippets Evaluation › PHP snippets execute in priority order 

    Error: expect(received).toEqual(expected) // deep equality

    - Expected  - 1
    + Received  + 1

      Array [
    -   "snippet-priority-1789745634655-low",
        "snippet-priority-1789745634655-high",
    +   "snippet-priority-1789745634655-low",
      ]

    Call Log:
    - Timeout 30000ms exceeded while waiting on the predicate

      288 |
      289 | 			await helper.navigateToFrontend()
    > 290 | 			await expect.poll(() => page.locator(`span[id^="${outputPrefix}"]`).evaluateAll(elements =>
          | 			^
      291 | 				elements.map(({ id }) => id)
      292 | 			)).toEqual([lowPriorityId, highPriorityId])
      293 | 		} finally {
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:290:4

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(received).toEqual(expected) // deep equality

    - Expected  - 4
    + Received  + 1

    - Array [
    -   "snippet-priority-1789745667486-low",
    -   "snippet-priority-1789745667486-high",
    - ]
    + Array []

    Call Log:
    - Timeout 30000ms exceeded while waiting on the predicate

      288 |
      289 | 			await helper.navigateToFrontend()
    > 290 | 			await expect.poll(() => page.locator(`span[id^="${outputPrefix}"]`).evaluateAll(elements =>
          | 			^
      291 | 				elements.map(({ id }) => id)
      292 | 			)).toEqual([lowPriorityId, highPriorityId])
      293 | 		} finally {
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:290:4

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry1/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry1/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(received).toEqual(expected) // deep equality

    - Expected  - 4
    + Received  + 1

    - Array [
    -   "snippet-priority-1789745700172-low",
    -   "snippet-priority-1789745700172-high",
    - ]
    + Array []

    Call Log:
    - Timeout 30000ms exceeded while waiting on the predicate

      288 |
      289 | 			await helper.navigateToFrontend()
    > 290 | 			await expect.poll(() => page.locator(`span[id^="${outputPrefix}"]`).evaluateAll(elements =>
          | 			^
      291 | 				elements.map(({ id }) => id)
      292 | 			)).toEqual([lowPriorityId, highPriorityId])
      293 | 		} finally {
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:290:4

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry2/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry2/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry2/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry2/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-2228b-s-execute-in-priority-order-chromium-file-based-snippets-retry2/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Affected Playwright test: chromium-file-based-snippets

FAILURE: code-snippets-evaluation.spec.ts:363:6 HTML snippet is evaluating correctly in footer
[chromium-file-based-snippets] › code-snippets-evaluation.spec.ts:363:6 › Code Snippets Evaluation › HTML snippet is evaluating correctly in footer 

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in footer!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in footer!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:372:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in footer!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in footer!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:372:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry1/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry1/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in footer!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in footer!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:372:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry2/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry2/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry2/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry2/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-92fcd-luating-correctly-in-footer-chromium-file-based-snippets-retry2/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Affected Playwright test: chromium-file-based-snippets

FAILURE: code-snippets-evaluation.spec.ts:376:6 HTML snippet is evaluating correctly in header
[chromium-file-based-snippets] › code-snippets-evaluation.spec.ts:376:6 › Code Snippets Evaluation › HTML snippet is evaluating correctly in header 

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in header!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in header!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:385:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in header!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in header!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:385:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry1/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry1/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in header!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in header!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:385:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry2/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry2/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry2/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry2/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-27ea4-luating-correctly-in-header-chromium-file-based-snippets-retry2/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Affected Playwright test: chromium-file-based-snippets

FAILURE: code-snippets-evaluation.spec.ts:389:6 HTML snippet is evaluating correctly at body start
[chromium-file-based-snippets] › code-snippets-evaluation.spec.ts:389:6 › Code Snippets Evaluation › HTML snippet is evaluating correctly at body start 

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body start!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body start!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:398:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body start!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body start!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:398:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry1/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry1/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body start!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body start!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:398:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry2/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry2/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry2/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry2/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-ce702-ing-correctly-at-body-start-chromium-file-based-snippets-retry2/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Affected Playwright test: chromium-file-based-snippets

FAILURE: code-snippets-evaluation.spec.ts:403:6 HTML snippet is evaluating correctly at body end
[chromium-file-based-snippets] › code-snippets-evaluation.spec.ts:403:6 › Code Snippets Evaluation › HTML snippet is evaluating correctly at body end 

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body end!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body end!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:412:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body end!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body end!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:412:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry1/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry1/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toBeVisible() failed

    Locator: locator('text=Hello World HTML snippet in body end!')
    Expected: visible
    Timeout: 30000ms
    Error: element(s) not found

    Call log:
      - Expect "toBeVisible" with timeout 30000ms
      - waiting for locator('text=Hello World HTML snippet in body end!')


       at helpers/SnippetsTestHelper.ts:521

      519 | 	 */
      520 | 	async expectTextVisible(text: string): Promise<void> {
    > 521 | 		await expect(this.page.locator(`text=${text}`)).toBeVisible()
          | 		                                                ^
      522 | 	}
      523 |
      524 | 	/**
        at SnippetsTestHelper.expectTextVisible (/home/runner/_work/code-snippets/code-snippets/tests/e2e/helpers/SnippetsTestHelper.ts:521:51)
        at /home/runner/_work/code-snippets/code-snippets/tests/e2e/code-snippets-evaluation.spec.ts:412:16

    attachment #1: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry2/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: video (video/webm) ──────────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry2/video.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry2/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry2/trace.zip
    Usage:

        npx playwright show-trace ../../test-results/code-snippets-evaluation-C-e0cd0-ating-correctly-at-body-end-chromium-file-based-snippets-retry2/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Affected Playwright test: chromium-db-snippets chromium-rtl

rtl.setup.ts > sign in as a right-to-left user
TimeoutError: page.waitForSelector: Timeout 60000ms exceeded.
Call log:
�[2m  - waiting for locator('#wpbody-content, #adminmenu') to be visible�[22m

TimeoutError: page.waitForSelector: Timeout 60000ms exceeded.
Call log:
�[2m  - waiting for locator('#wpbody-content, #adminmenu') to be visible�[22m

    at /home/runner/_work/code-snippets/code-snippets/tests/e2e/rtl.setup.ts:42:13

Please review the failing jobs and fix the issues before merging.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-tests Trigger automated tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant