Skip to content

Nightly Tests

Nightly Tests #7

Triggered via schedule January 23, 2025 02:22
Status Failure
Total duration 48m 59s
Artifacts 1

nightly-tests.yml

on: schedule
Matrix: check-test-build-deploy
Fit to window
Zoom out
Zoom in

Annotations

20 errors, 32 warnings, and 2 notices
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 53 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 54 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
2) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
2) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 54 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
2) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
2) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 55 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
3) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L13
3) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('button', { name: 'Werkzeug suchen' }) - locator resolved to <button type="submit" id="quiz-find-tool" data-testid="quiz-find-tool" class="ds-button ds-button-large">…</button> - attempting click action - waiting for element to be visible, enabled and stable 11 | 12 | async function submitForm(page: Page) { > 13 | await page.getByRole("button", { name: "Werkzeug suchen" }).click(); | ^ 14 | } 15 | 16 | test.describe("test quiz page", () => { at submitForm (/home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:13:63) at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:68:13
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.locator("main"); 25 | await mainContent.waitFor(); at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.locator("main"); 25 | await mainContent.waitFor(); at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L35
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 33 | }) => { 34 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 35 | await page.goto(url); | ^ 36 | 37 | const nextPrincipleIndex = principles.indexOf(principle) + 1; 38 | if (nextPrincipleIndex < principles.length) { at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:35:18
[Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
check-test-build-deploy (tool-finder) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
Slow Test: packages/tool-finder/[Desktop Safari] › e2e/general.spec.ts#L1
packages/tool-finder/[Desktop Safari] › e2e/general.spec.ts took 20.8s
Slow Test: packages/tool-finder/[Desktop Safari] › e2e/quizAndResult.spec.ts#L1
packages/tool-finder/[Desktop Safari] › e2e/quizAndResult.spec.ts took 20.1s
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
Slow Test: packages/dito/[Desktop Firefox] › e2e/resultForm.spec.ts#L1
packages/dito/[Desktop Firefox] › e2e/resultForm.spec.ts took 2.7m
Slow Test: packages/dito/[Mobile Safari] › e2e/resultForm.spec.ts#L1
packages/dito/[Mobile Safari] › e2e/resultForm.spec.ts took 2.3m
Slow Test: packages/dito/[Tablet Chrome] › e2e/resultForm.spec.ts#L1
packages/dito/[Tablet Chrome] › e2e/resultForm.spec.ts took 1.5m
Slow Test: packages/dito/[Mobile Chrome] › e2e/resultForm.spec.ts#L1
packages/dito/[Mobile Chrome] › e2e/resultForm.spec.ts took 1.5m
Slow Test: packages/dito/[Desktop Edge] › e2e/resultForm.spec.ts#L1
packages/dito/[Desktop Edge] › e2e/resultForm.spec.ts took 1.5m
check-test-build-deploy (dito) / check-and-test
No files were found with the provided path: packages/dito/tests/playwright/playwright-report. No artifacts will be uploaded.
🎭 Playwright Run Summary
2 failed [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── 1 flaky [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster 157 passed (4.7m)
🎭 Playwright Run Summary
17 failed [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:31:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:92:3 › Visualizations Overview Page › displays main heading and subtitle [Mobile Safari] › e2e/examplePages.spec.ts:104:3 › Visualizations Overview Page › displays visualization details correctly [Mobile Safari] › e2e/examplePages.spec.ts:118:3 › Visualizations Overview Page › opens images in new tab [Mobile Safari] › e2e/examplePages.spec.ts:134:3 › Visualizations Overview Page › navigation to regulation detail works [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/visualisierungen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/digitale-kommunikation-sicherstellen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/datenschutz-und-informationssicherheit-gewaehrleisten is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/resultPage.spec.ts:221:3 › test result page reasoning › checking mix of unsure and negative answers for digital aspects and positive for interoperability leads to unsure result with a hint [Tablet Safari] › e2e/methodPages.spec.ts:136:3 › five principles page › five principles page links to examples 11 flaky [Desktop Safari] › e2e/resultForm.spec.ts:207:3 › test positive result for digital and negative for interoperability › negative reasoning input is not visible [Desktop Safari] › e2e/resultForm.spec.ts:536:3 › test unsure result for digital and unsure for interoperability › form is not shown [Mobile Safari] › e2e/methodPages.spec.ts:109:3 › five principles page › five principles conditional next step is accurate [Mobile Safari] › e2e/preCheckQuestions.spec.ts:58:3 › test questions form › back button works ─ [Mobile Safari] › e2e/preCheckQuestions.spec.ts:124:3 › test questions form › redirect to first unanswered question [Mobile Safari] › e2e/resultPage.spec.ts:21:3 › test result page general content › happy path leads to positive result [Mobile Safari] › e2e/resultPage.spec.ts:71:3 › test result page reasoning › one positive answer for digital and all unsure for interoperability leads to positive result with hint [Mobile Safari] › e2e/resultPage.spec.ts:114:3 › test result page reasoning › all answers are shown as reasons [Tablet Safari] › e2e/methodPages.spec.ts:109:3 › five principles page › five principles conditional next step is accurate [Tablet Safari] › e2

Artifacts

Produced during runtime
Name Size
playwright-e2e-test-results
23.3 MB