Nightly Tests #5
nightly-tests.yml
on: workflow_dispatch
Matrix: check-test-build-deploy
Annotations
20 errors, 26 warnings, and 2 notices
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('link', { name: 'Impressum' })
- locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 100ms
47 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 500ms
72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click();
73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y);
> 74 | await page.getByRole("link", { name: "Impressum" }).click();
| ^
75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT);
76 | });
77 |
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
|
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
1) [Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('link', { name: 'Impressum' })
- locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 100ms
46 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 500ms
72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click();
73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y);
> 74 | await page.getByRole("link", { name: "Impressum" }).click();
| ^
75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT);
76 | });
77 |
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
|
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster:
packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster:
packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L7
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster
Error: locator.selectOption: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByTestId('ressort')
5 |
6 | async function fillOutForm(page: Page) {
> 7 | await page.getByTestId("ressort").selectOption("bmi");
| ^
8 | await page.getByLabel("Für meinen Austausch").check();
9 | await page.getByLabel("Interaktionen von Akteuren").check();
10 | }
at fillOutForm (/home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:7:37)
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts:63:13
|
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster:
packages/tool-finder/tests/playwright/e2e/quizAndResult.spec.ts#L1
2) [Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Test timeout of 30000ms exceeded.
|
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L74
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('link', { name: 'Impressum' })
- locator resolved to <a href="/impressum" class="text-link increase-tap-area whitespace-nowrap">Impressum </a>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 100ms
54 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- element is outside of the viewport
- retrying click action
- waiting 500ms
72 | await page.getByRole("link", { name: "Barrierefreiheit" }).click();
73 | await expect(page).toHaveURL(allRoutes.PATH_A11Y);
> 74 | await page.getByRole("link", { name: "Impressum" }).click();
| ^
75 | await expect(page).toHaveURL(allRoutes.PATH_IMPRINT);
76 | });
77 |
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/tool-finder/tests/playwright/e2e/general.spec.ts:74:57
|
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work:
packages/tool-finder/tests/playwright/e2e/general.spec.ts#L1
3) [Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Error: page.goto: Test ended.
Call log:
- navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load"
20 | }) => {
21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`;
> 22 | await page.goto(url);
| ^
23 |
24 | const mainContent = page.getByRole("main");
25 | await expect(mainContent).toContainText(
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L22
1) [Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.goto: Test ended.
Call log:
- navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load"
20 | }) => {
21 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`;
> 22 | await page.goto(url);
| ^
23 |
24 | const mainContent = page.getByRole("main");
25 | await expect(mainContent).toContainText(
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:22:18
|
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
Test timeout of 30000ms exceeded.
|
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L34
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
Error: page.goto: Test ended.
Call log:
- navigating to "http://localhost:5172/beispiele/prinzipien/digitale-kommunikation-sicherstellen", waiting until "load"
32 | }) => {
33 | const url = `${ROUTE_PRINCIPLES.url}/${principle}`;
> 34 | await page.goto(url);
| ^
35 | await page.locator("main").waitFor();
36 |
37 | const nextPrincipleIndex = principles.indexOf(principle) + 1;
at /home/runner/work/digitalcheck-apps/digitalcheck-apps/packages/dito/tests/e2e/examplePages.spec.ts:34:18
|
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen:
packages/dito/tests/e2e/examplePages.spec.ts#L1
2) [Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
check-test-build-deploy (tool-finder) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
check-test-build-deploy (tool-finder) / check-and-test:
packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (tool-finder) / check-and-test:
packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
|
check-test-build-deploy (tool-finder) / check-and-test:
packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (tool-finder) / check-and-test:
packages/tool-finder/src/MaintenanceModeApp.tsx#L20
Classname 'increase-tap-area' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/beispiele.prinzipien.$prinzip.tsx#L138
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/beispiele.regelungen.$regelung.tsx#L110
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/vorpruefung.$questionId/PreCheckNavigation.tsx#L25
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/components/ParagraphList.tsx#L38
Unsafe member access .children on an `any` value
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/_index.tsx#L111
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/_index.tsx#L123
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/beispiele.prinzipien.$prinzip.tsx#L138
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/beispiele.regelungen.$regelung.tsx#L110
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/methoden_.fuenf-prinzipien.tsx#L78
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/sitemap.tsx#L50
Classname 'list-unstyled' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/sitemap.tsx#L53
Classname 'text-link' is not a Tailwind CSS class!
|
check-test-build-deploy (dito) / check-and-test:
packages/dito/app/routes/vorpruefung.$questionId/PreCheckNavigation.tsx#L25
Classname 'list-unstyled' is not a Tailwind CSS class!
|
Slow Test:
packages/dito/[Mobile Chrome] › e2e/examplePages.spec.ts#L1
packages/dito/[Mobile Chrome] › e2e/examplePages.spec.ts took 32.5s
|
Slow Test:
packages/dito/[Mobile Safari] › e2e/methodPages.spec.ts#L1
packages/dito/[Mobile Safari] › e2e/methodPages.spec.ts took 32.4s
|
🎭 Playwright Run Summary
3 failed
[Mobile Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ─────────────────
[Mobile Safari] › e2e/quizAndResult.spec.ts:58:3 › test result page › visualisation object leads to correct cluster
[Tablet Safari] › e2e/general.spec.ts:68:3 › test links › links in footer work ─────────────────
2 flaky
[Mobile Safari] › e2e/general.spec.ts:10:3 › test general functionality › all routes are reachable and have a breadcrumb menu + title
[Mobile Safari] › e2e/general.spec.ts:114:3 › test links › links leading to external pages open in new tab
135 passed (5.7m)
|
🎭 Playwright Run Summary
18 failed
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
[Mobile Safari] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: datenschutz-und-informationssicherheit-gewaehrleisten
[Mobile Safari] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: datenschutz-und-informationssicherheit-gewaehrleisten
[Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: digitale-kommunikation-sicherstellen
[Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: digitale-kommunikation-sicherstellen
[Mobile Safari] › e2e/examplePages.spec.ts:54:5 › Digitaltauglichkeit Prinzipien Detail › displays paragraphs with relevant principles for: datenschutz-und-informationssicherheit-gewaehrleisten
[Mobile Safari] › e2e/examplePages.spec.ts:67:5 › Digitaltauglichkeit Prinzipien Detail › navigates to laws associated with principle: datenschutz-und-informationssicherheit-gewaehrleisten
[Mobile Safari] › e2e/examplePages.spec.ts:92:3 › Visualizations Overview Page › displays main heading and subtitle
[Mobile Safari] › e2e/examplePages.spec.ts:104:3 › Visualizations Overview Page › displays visualization details correctly
[Mobile Safari] › e2e/examplePages.spec.ts:118:3 › Visualizations Overview Page › opens images in new tab
[Mobile Safari] › e2e/examplePages.spec.ts:134:3 › Visualizations Overview Page › navigation to regulation detail works
[Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/visualisierungen is reachable and has a breadcrumb menu + title
[Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/digitale-kommunikation-sicherstellen is reachable and has a breadcrumb menu + title
[Mobile Safari] › e2e/general.spec.ts:17:5 › test general availability › /beispiele/prinzipien/datenschutz-und-informationssicherheit-gewaehrleisten is reachable and has a breadcrumb menu + title
[Tablet Chrome] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions
[Tablet Safari] › e2e/methodPages.spec.ts:136:3 › five principles page › five principles page links to examples
[Tablet Safari] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions
14 flaky
[Desktop Chrome] › e2e/examplePages.spec.ts:18:5 › Digitaltauglichkeit main functionality › displays detailed information for principle: digitale-kommunikation-sicherstellen
[Desktop Chrome] › e2e/examplePages.spec.ts:30:5 › Digitaltauglichkeit main functionality › renders navigation links for principle: digitale-kommunikation-sicherstellen
[Desktop Safari] › e2e/resultForm.spec.ts:79:3 › test positive result for digital and interoperability › title input is visible
[Desktop Safari] › e2e/resultPage.spec.ts:221:3 › test result page reasoning › checking mix of unsure and negative answers for digital aspects and positive for interoperability leads to unsure result with a hint
[Mobile Chrome] › e2e/preCheckQuestions.spec.ts:277:3 › test question navigation on mobile screens › Navigation with LinkBar works and restricts unanswered questions
[Mobile Safari] › e2e/preCheckQuestions.spec.ts:56:3 › test questions form › back button works ─
[Mobile Safari] › e2e/preCheckQuestions.spec.ts:70:3 › test questions form › answers are saved and loaded from cookie and pe
|