Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broken builds and merge-ups #287

Closed
github-actions bot opened this issue Jul 23, 2024 · 4 comments
Closed

Broken builds and merge-ups #287

github-actions bot opened this issue Jul 23, 2024 · 4 comments
Assignees

Comments

@github-actions
Copy link

github-actions bot commented Jul 23, 2024

This is an automatically created issue used to remind the Silverstripe CMS Squad to look at broken builds and merge-ups every Tuesday.

It was created by the .github/workflows/rhino-issue.yml workflow in the silverstripe/.github repository.

Triage instructions

  1. Put on the following label:
  • type/other
  1. Move this issue to the "Ready" column on our internal zenhub board

Broken builds:

Merge-ups:

PRs

@GuySartorelli
Copy link
Member

GuySartorelli commented Jul 29, 2024

There's a weird problem affecting both asset admin CI and admin CI which I can't reproduce locally, where it can't find the dialog.

My initial thoughts are that it could be a timing problem, since other alerts do fire and are found where they're expected. Though it is weird for a timing problem to be so consistent.

Alternatively it could be a different version of chromium or chrome driver perhaps? Or some other version mismatch? Almost certainly infrastructure since it's consistent even in sink, installer, and graphql CI runs but I can't reproduce locally either with DDEV or with my old custom docker setup.

Edit: Looking at the user experience, and based on one of the failed scenarios (haven't checked the others yet), if "I dismiss the dialog" in CI is actually confirming the dialog, then that could explain why the second dialog doesn't appear.

@GuySartorelli GuySartorelli removed their assignment Jul 29, 2024
@emteknetnz
Copy link
Member

Assigning back to Guy to ensure things are working as they should

@GuySartorelli
Copy link
Member

GuySartorelli commented Jul 30, 2024

Gonna add relevant findings here as I go, both for my own tracking and for future reference.

  • That asset-admin failure fails when just running that scenario on its own: https://github.com/creative-commoners/silverstripe-installer/actions/runs/10155247714. This rules out any bleed-over from other scenarios or features.

  • It also fails when using admin 5.2, which means changes in that repo at least aren't to blame (since the ci failure doesn't happen in the 5.2 branch of asset-admin)

  • It fails when using installer 5.2 with asset-admin 2.x-dev, which implies a code change in asset-admin specifically is to blame. Though that seems unlikely given a similar failure is affecting admin...

  • Looks like the fact that 2.2.x-dev was passing is just 'cause that hadn't been run recently enough.

    • There are a few differences in dependencies so I'll check those first.
    • There's also differences in chromedriver and chromium versions which I really hope aren't the problem, but they probably are
    • admin 2.2 passing 2 weeks ago
      • Chrome version is: Google Chrome for Testing 126.0.6478.182
      • Chromedriver version is: ChromeDriver 126.0.6478.182 (5b5d8292ddf182f8b2096fa665b473b6317906d5-refs/branch-heads/6478@{#1776})
    • admin 2.2 failing more recently
      • Google Chrome for Testing 127.0.6533.72
      • ChromeDriver 127.0.6533.72 (9755e24ca85aa18ffa16c743f660a3d914902775-refs/branch-heads/6533@{#1760})

Turns out it was the chrome or chromedriver version causing problems. I can reproduce with local behat now.
Can't reproduce in-browser locally. Even downloaded the exact version of "chrome for testing" that's failing in CI and the failure isn't happening in-browser.

@GuySartorelli
Copy link
Member

Opened php-webdriver/php-webdriver#1104 about the remaining behat failures in admin and asset-admin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants