Skip to content

Nightly Tests

Nightly Tests #5

Manually triggered January 22, 2025 11:38
Status Failure
Total duration 49m 43s
Artifacts

nightly-tests.yml

on: workflow_dispatch
Matrix: check-test-build-deploy
Fit to window
Zoom out
Zoom in

Annotations

20 errors, 26 warnings, and 2 notices
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 47 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 46 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L7
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Error: locator.selectOption: Test timeout of 30000ms exceeded. Call log: - waiting for getByTestId('ressort') 5 | 6 | async function fillOutForm(page: Page) { > 7 | await page.getByTestId("ressort").selectOption("bmi"); | ^ 8 | await page.getByLabel("Für meinen Austausch").check(); 9 | await page.getByLabel("Interaktionen von Akteuren").check(); 10 | } at fillOutForm (/home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:7:37) at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:63:13
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster: packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Test timeout of 30000ms exceeded.
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('link', { name: 'Impressum' }) - locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 100ms 54 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - element is outside of the viewport - retrying click action - waiting 500ms 72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click(); 73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y); > 74 | await page.getByRole("link", { name: "Impressum" }).click(); | ^ 75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT); 76 | }); 77 | at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work: packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ──────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.getByRole("main"); 25 | await expect(mainContent).toContainText( at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 20 | }) => { 21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 22 | await page.goto(url); | ^ 23 | 24 | const mainContent = page.getByRole("main"); 25 | await expect(mainContent).toContainText( at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Test timeout of 30000ms exceeded.
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L34
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Error: page.goto: Test ended. Call log: - navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load" 32 | }) => { 33 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`; > 34 | await page.goto(url); | ^ 35 | await page.locator("main").waitFor(); 36 | 37 | const nextPrincipleIndex = principles.indexOf(principle) + 1; at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:34:18
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen: packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
check-test-build-deploy (tool-finder) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
check-test-build-deploy (tool-finder) / check-and-test: packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
check-test-build-deploy (dito) / check-and-test: packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
Slow Test: packages/dito/[Mobile Chrome] › e2e/examplePages.spec.ts#L1
packages/dito/[Mobile Chrome] › e2e/examplePages.spec.ts took 32.5s
Slow Test: packages/dito/[Mobile Safari] › e2e/methodPages.spec.ts#L1
packages/dito/[Mobile Safari] › e2e/methodPages.spec.ts took 32.4s
🎭 Playwright Run Summary
3 failed [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ───────────────── 2 flaky [Mobile Safari] › e2e/general.spec.ts:10:3 › test general functionality › all routes are reachable and have a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:114:3 › test links › links leading to external pages open in new tab 135 passed (5.7m)
🎭 Playwright Run Summary
18 failed [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: digitale-kommunikation-sicherstellen [Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: datenschutz-und-informationssicherheit-gewaehrleisten [Mobile Safari] › e2e/examplePages.spec.ts:92:3 › Visualizations Overview Page › displays main heading and subtitle [Mobile Safari] › e2e/examplePages.spec.ts:104:3 › Visualizations Overview Page › displays visualization details correctly [Mobile Safari] › e2e/examplePages.spec.ts:118:3 › Visualizations Overview Page › opens images in new tab [Mobile Safari] › e2e/examplePages.spec.ts:134:3 › Visualizations Overview Page › navigation to regulation detail works [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/visualisierungen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/digitale-kommunikation-sicherstellen is reachable and has a breadcrumb menu + title [Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/datenschutz-und-informationssicherheit-gewaehrleisten is reachable and has a breadcrumb menu + title [Tablet Chrome] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions [Tablet Safari] › e2e/methodPages.spec.ts:136:3 › five principles page › five principles page links to examples [Tablet Safari] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions 14 flaky [Desktop Chrome] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen [Desktop Chrome] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen [Desktop Safari] › e2e/resultForm.spec.ts:79:3 › test positive result for digital and interoperability › title input is visible [Desktop Safari] › e2e/resultPage.spec.ts:221:3 › test result page reasoning › checking mix of unsure and negative answers for digital aspects and positive for interoperability leads to unsure result with a hint [Mobile Chrome] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions [Mobile Safari] › e2e/preCheckQuestions.spec.ts:56:3 › test questions form › back button works ─ [Mobile Safari] › e2e/preCheckQuestions.spec.ts:70:3 › test questions form › answers are saved and loaded from cookie and pe