Replicate otk bug #4270
Annotations
10 errors, 3 warnings, and 1 notice
Run Playwright tests:
playwright/element-web-test.ts#L331
1) [Chrome] › settings/encryption-user-tab/advanced.spec.ts:24:9 › Advanced section in Encryption tab › should show the encryption details @screenshot
Error: A snapshot doesn't exist at /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/advanced.spec.ts/encryption-details-linux.png, writing actual.
at ../element-web-test.ts:331
329 |
330 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 331 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
332 |
333 | await style.evaluate((tag) => tag.remove());
334 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:331:9)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/advanced.spec.ts:32:9
|
Run Playwright tests:
playwright/element-web-test.ts#L331
2) [Chrome] › settings/encryption-user-tab/advanced.spec.ts:55:9 › Advanced section in Encryption tab › should reset the cryptographic identity @screenshot
Error: A snapshot doesn't exist at /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/advanced.spec.ts/reset-cryptographic-identity-linux.png, writing actual.
at ../element-web-test.ts:331
329 |
330 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 331 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
332 |
333 | await style.evaluate((tag) => tag.remove());
334 |
at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:331:9)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/advanced.spec.ts:63:9
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/advanced.spec.ts#L66
2) [Chrome] › settings/encryption-user-tab/advanced.spec.ts:55:9 › Advanced section in Encryption tab › should reset the cryptographic identity @screenshot
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByTestId('encryptionDetails').getByRole('button', { name: 'Reset cryptographic identity' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByTestId('encryptionDetails').getByRole('button', { name: 'Reset cryptographic identity' })
64 | await tab.getByRole("button", { name: "Continue" }).click();
65 |
> 66 | await expect(section.getByRole("button", { name: "Reset cryptographic identity" })).toBeVisible();
| ^
67 | // After resetting the identity, the user should set up a new recovery key
68 | await expect(
69 | util.getEncryptionRecoverySection().getByRole("button", { name: "Set up recovery" }),
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/advanced.spec.ts:66:93
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
3) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:58:9 › Recovery section in Encryption tab › should change the recovery key @screenshot @no-webkit
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 32914 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome/default-recovery-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome/default-recovery-1-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 665px. 61975 pixels (ratio 0.13 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 665px, received 748px by 791px. 35889 pixels (ratio 0.07 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 32914 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:80:13
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
3) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:58:9 › Recovery section in Encryption tab › should change the recovery key @screenshot @no-webkit
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 33032 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome-retry1/default-recovery-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome-retry1/default-recovery-1-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 665px. 62056 pixels (ratio 0.13 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 665px, received 748px by 791px. 36086 pixels (ratio 0.07 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 33032 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:80:13
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
3) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:58:9 › Recovery section in Encryption tab › should change the recovery key @screenshot @no-webkit
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 32989 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome-retry2/default-recovery-1-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-d7db3-uld-change-the-recovery-key-Chrome-retry2/default-recovery-1-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 665px. 62068 pixels (ratio 0.13 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 665px, received 748px by 791px. 35941 pixels (ratio 0.07 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 32989 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:80:13
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
4) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:88:9 › Recovery section in Encryption tab › should setup the recovery key @screenshot @no-webkit
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 32871 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome/default-recovery-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome/default-recovery-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 687px. 62693 pixels (ratio 0.13 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 687px, received 748px by 791px. 35237 pixels (ratio 0.06 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 32871 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:113:9
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
4) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:88:9 › Recovery section in Encryption tab › should setup the recovery key @screenshot @no-webkit
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 32873 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome-retry1/default-recovery-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome-retry1/default-recovery-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 687px. 32874 pixels (ratio 0.07 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 687px, received 748px by 791px.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 32873 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:113:9
|
Run Playwright tests:
playwright/e2e/settings/encryption-user-tab/index.ts#L111
4) [Chrome] › settings/encryption-user-tab/recovery.spec.ts:88:9 › Recovery section in Encryption tab › should setup the recovery key @screenshot @no-webkit
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toHaveScreenshot(expected)
Expected an image 648px by 142px, received 748px by 791px. 32886 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/encryption-user-tab/recovery.spec.ts/default-recovery-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome-retry2/default-recovery-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-encryption-user-t-9749f-ould-setup-the-recovery-key-Chrome-retry2/default-recovery-diff.png
Call log:
- expect.toHaveScreenshot(default-recovery.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 648px by 142px, received 748px by 687px. 62622 pixels (ratio 0.13 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 748px by 687px, received 748px by 791px. 35142 pixels (ratio 0.06 of all image pixels) are different.
- waiting 250ms before taking screenshot
- waiting for getByTestId('encryptionTab')
- locator resolved to <div data-testid="encryptionTab" class="mx_SettingsTab mx_EncryptionUserSettingsTab">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 648px by 142px, received 748px by 791px. 32886 pixels (ratio 0.06 of all image pixels) are different.
at settings/encryption-user-tab/index.ts:111
109 | await dialog.getByRole("textbox").fill(clipboardContent);
110 | await dialog.getByRole("button", { name: confirmButtonLabel }).click();
> 111 | await expect(dialog).toMatchScreenshot("default-recovery.png");
| ^
112 | }
113 | }
114 |
at Helpers.confirmRecoveryKey (/home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/index.ts:111:30)
at /home/runner/work/element-web/element-web/playwright/e2e/settings/encryption-user-tab/recovery.spec.ts:113:9
|
Run Playwright tests
Process completed with exit code 1.
|
Run Playwright tests:
[Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 56.1s
|
Run Playwright tests:
[Chrome] › room/room.spec.ts#L1
[Chrome] › room/room.spec.ts took 27.7s
|
Run Playwright tests:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 17.3s
|
Run Playwright tests
4 failed
[Chrome] › settings/encryption-user-tab/advanced.spec.ts:24:9 › Advanced section in Encryption tab › should show the encryption details @screenshot
[Chrome] › settings/encryption-user-tab/advanced.spec.ts:55:9 › Advanced section in Encryption tab › should reset the cryptographic identity @screenshot
[Chrome] › settings/encryption-user-tab/recovery.spec.ts:58:9 › Recovery section in Encryption tab › should change the recovery key @screenshot @no-webkit
[Chrome] › settings/encryption-user-tab/recovery.spec.ts:88:9 › Recovery section in Encryption tab › should setup the recovery key @screenshot @no-webkit
1 skipped
49 passed (5.6m)
|
Loading