Skip to content

End to End Tests

End to End Tests #3557

Triggered via merge group December 24, 2024 06:17
Status Success
Total duration 15m 7s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
1m 42s
Build Element-Web
Matrix: playwright
end-to-end-tests
38s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 28 warnings, and 6 notices
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit: playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
1) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
[Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue: playwright/e2e/read-receipts/index.ts#L446
1) [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') 9 × locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:446 444 | async assertRead(room: string | { name: string }) { 445 | const tile = this.getRoomListTile(room); > 446 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 447 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 448 | } 449 | at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:446:69) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts:112:17 › Read receipts › editing messages › in threads › A room with an edited threaded message is still read after restart @mergequeue: eval at evaluate (:234:30)#L1
1) [Chrome] › read-receipts/editing-messages-in-threads.spec.ts:112:17 › Read receipts › editing messages › in threads › A room with an edited threaded message is still read after restart @mergequeue Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts:120:17
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:72:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue: eval at evaluate (:234:30)#L1
2) [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:72:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts:80:17
[Chrome] › read-receipts/new-messages-in-threads.spec.ts:162:17 › Read receipts › new messages › in threads › Marking a room with unread threads as read makes it read @mergequeue: eval at evaluate (:234:30)#L1
3) [Chrome] › read-receipts/new-messages-in-threads.spec.ts:162:17 › Read receipts › new messages › in threads › Marking a room with unread threads as read makes it read @mergequeue Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-in-threads.spec.ts:170:17
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L1
1) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Test timeout of 90000ms exceeded.
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L19
1) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: page.waitForRequest: Test timeout of 90000ms exceeded. 17 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 18 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 19 | const tokenApiPromise = page.waitForRequest( | ^ 20 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 21 | ); 22 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:19:38
[Chrome] › pinned-messages/pinned-messages.spec.ts:13:9 › Pinned messages › should show the empty state when there are no pinned messages @screenshot: playwright/e2e/pinned-messages/index.ts#L158
2) [Chrome] › pinned-messages/pinned-messages.spec.ts:13:9 › Pinned messages › should show the empty state when there are no pinned messages @screenshot Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('menuitem', { name: 'Pinned messages' }) Expected string: "Pinned messages0" Received: <element(s) not found> Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('menuitem', { name: 'Pinned messages' }) at pinned-messages/index.ts:158 156 | */ 157 | async assertPinnedCountInRoomInfo(count: number) { > 158 | await expect(this.page.getByRole("menuitem", { name: "Pinned messages" })).toHaveText( | ^ 159 | `Pinned messages${count}`, 160 | ); 161 | } at Helpers.assertPinnedCountInRoomInfo (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:158:84) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:19:24
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 58.0s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 51.5s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 41.9s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 36.1s
Slow Test: [Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 30.0s
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.6m
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.7m
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.7s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 33.5s
Slow Test: [Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
Slow Test: [Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 56.3s
Slow Test: [Chrome] › read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 52.8s
Slow Test: [Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 50.3s
Slow Test: [Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.2m
Slow Test: [Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts took 51.4s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 59.3s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 48.1s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.2m
Slow Test: [Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 37.0s
Slow Test: [Chrome] › integration-manager/read_events.spec.ts#L1
[Chrome] › integration-manager/read_events.spec.ts took 36.2s
Slow Test: [Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 33.2s
🎭 Playwright Run Summary
1 flaky [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit 9 skipped 70 passed (9.0m)
🎭 Playwright Run Summary
3 skipped 69 passed (9.6m)
🎭 Playwright Run Summary
1 flaky [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue 15 skipped 59 passed (9.6m)
🎭 Playwright Run Summary
3 flaky [Chrome] › read-receipts/editing-messages-in-threads.spec.ts:112:17 › Read receipts › editing messages › in threads › A room with an edited threaded message is still read after restart @mergequeue [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:72:17 › Read receipts › editing messages › in the main timeline › Editing a reply after reading it makes the room unread @mergequeue [Chrome] › read-receipts/new-messages-in-threads.spec.ts:162:17 › Read receipts › new messages › in threads › Marking a room with unread threads as read makes it read @mergequeue 32 skipped 47 passed (9.8m)
🎭 Playwright Run Summary
81 passed (11.7m)
🎭 Playwright Run Summary
2 flaky [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit [Chrome] › pinned-messages/pinned-messages.spec.ts:13:9 › Pinned messages › should show the empty state when there are no pinned messages @screenshot 1 skipped 75 passed (11.9m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
688 KB
all-blob-reports-Chrome-2 Expired
9.01 MB
all-blob-reports-Chrome-3 Expired
9.9 MB
all-blob-reports-Chrome-4 Expired
4.44 MB
all-blob-reports-Chrome-5 Expired
4.42 MB
all-blob-reports-Chrome-6 Expired
778 KB
html-report
28.6 MB
webapp Expired
29.2 MB