-
Notifications
You must be signed in to change notification settings - Fork 273
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
opensearch-dashboards-functional test repo should always checkout release branch head commit #4057
Comments
Would like to get some input from developers here: @kavilla @dblock @amsiglan @kavithacm |
Hi @tranngocsongtruc, assigning this issue to you. Please go through it and let us know if you have any questions. |
Please assign me this issue. Thank you |
Hi @tranngocsongtruc looks like there is no progress on this issue. Please let us know if you need any help or have questions. Un-assigning you from this issue for now so that it can be picked up by someone else. |
I'd like to try submit a PR for this. |
@gaiksaya I talked to @peterzhu1992 at office hours this week and he suggested that grabbing the ref from the input manifest wouldn't work since the test does not read from the input manifest. An alternative suggestion he gave was to add a new parameter that accepts either a ref or a sha256 hash pointing to a commit. This would let users checkout whichever commit they want, including their own branches. Furthermore, the default behavior would still be to grab the commit from the build manifest. |
Sounds like a plan. Makes sense to keep the default behavior same as it is right now but it a non-null value is provided, it should be able to check that ref out. One correction, you still cannot use the fork/own branches since the github repo_url comes from build manifest but whatever is in repo_url is in build manifest, many ref should be good to use. |
Is your feature request related to a problem? Please describe
opensearch-dashboards-functional test repo is also added to the input manifest list file creating a distribution. This repository only hosts the tests to all the dashboards' plugins and core engine.
The current test process downloads build manifest and checkouts the commit head commit during RC build. See code block
However for past few releases and with new release window model exit criteria we need to fix the failing tests and remove the flaky ones.
Hence, today, if there are changes to the test code in opensearch-dashboards-functional test repo we need to rebuild the release candidate to include those changes. This is because, the way test workflow code is written, we use build manifest to fetch the commit ids to checkout the repository. See code block
Since there is no change in the actual software code shipped to the customer but just the tests and the fact that opensearch-dashboards-functional test repo is not shipped to the custome, re-creating RC is irrelevant.
Describe the solution you'd like
We would like to always checkout the head-commit of the release branch (mentioned in the input manifest). For example, if the release version is
2.10.0
the release branch would be2.10
This branch can either be grabbed from input manifest (preferred) or regex to
major.minor
branch to be checkout each time we run tests.Describe alternatives you've considered
Additional context
No response
The text was updated successfully, but these errors were encountered: