Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Milestone1 jan 2025 #257

Open
wants to merge 16 commits into
base: ibm
Choose a base branch
from
Open

Milestone1 jan 2025 #257

wants to merge 16 commits into from

Conversation

mahdipub
Copy link

@mahdipub mahdipub commented Dec 6, 2024

No description provided.

sophia-guo and others added 16 commits November 6, 2024 09:33
* Limit docker label to linux special.system

* limit to temurin
…pport Windows/docker builds (adoptium#1117)

* First pass of batOrSh and fixes for windows containers

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Refactoring signing code to allow operation in Windows containers

Signed-off-by: Stewart X Addison <sxa@redhat.com>
* Reduce stashing and avoid pre-unstash chmod in non-docker case

Signed-off-by: Stewart X Addison <sxa@redhat.com>

* Move workspace scope and use it for cleaning cyclone-dx and security directories

Signed-off-by: Stewart X Addison <sxa@redhat.com>

---------

Signed-off-by: Stewart X Addison <sxa@redhat.com>
Signed-off-by: Andrew Leonard <anleonar@redhat.com>
Co-authored-by: Andrew Leonard <31470007+andrew-m-leonard@users.noreply.github.com>
Co-authored-by: sophia-guo <sophia.gwf@gmail.com>
Co-authored-by: George Adams <georgeadams1995@gmail.com>
Signed-off-by: Stewart X Addison <sxa@redhat.com>
* Add release Tap collection and upload url

* Limit to adoptium jenkins

* Replace HUDSON_URL to JENKINS_URL as HUDSON_URL deprecates

* typo
…issions (adoptium#1139)

Signed-off-by: Stewart X Addison <sxa@redhat.com>
…ss-compile situation) (adoptium#1140)

Signed-off-by: Stewart X Addison <sxa@redhat.com>
Signed-off-by: Stewart X Addison <sxa@redhat.com>
* Switch to ubi8 base cuda image

The ubuntu image does not support ppc64le arch. We are now building (Semeru)
on ppc64le in the cent7 container and require the cuda libs.

Related #228

Signed-off-by: Adam Brousseau <adam.brousseau@ca.ibm.com>

* Pull cuda image from nvcr Nvidia

Sometimes pulls fail because DockerHub is rate limited. We are
also facing pull restrictions from DockerHub for Semeru.

Related eclipse-openj9/openj9#20622

Signed-off-by: Adam Brousseau <adam.brousseau@ca.ibm.com>

---------

Signed-off-by: Adam Brousseau <adam.brousseau@ca.ibm.com>
* Adding platforms to reproducibility healthcheck

We now have automated reproducibility testing on 3 more platforms,
so we're checking their results as part of the daily healthcheck.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding tolerance for decimal point

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Typo fix

* Syntax fix

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing the regex

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing variable content loss

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing another regex

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Typo fix

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing Linter concerns

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Alternative rounding method to solve Jenkins' MathContext aversion

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Changing method of rounding down

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing banned method

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Making sure we use the latest build repro info during healthcheck

Currently, we use the earliest pipeline with a given tag as our
best guess at the root source of a published build.

However, if the build link is rerun by a user for specific
platforms, the original link becomes outdated, and we should
use the new link for healthchecks (but only on the affected
platform).

This change adds the per-platform logic required to do that. We may
expand the scope for this in the long run, but for now this logic
will only be used by the section of the code which identifies the
reproducibility percentages for published builds.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Swapping paranthesis with curley braces

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Continues should be changed to returns if used inside lambdas

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding useful debug messages

Signed-off-by: Adam Farley <adfarley@redhat.com>

* More debug output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Point repro healthcheck at the correct build.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Resolving conflict and fixing typo

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Renaming variable

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adapting contains call to map API

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding white space tolerance to 100 percent check

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding debug output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Debug messages

* Switching nodes to try and get faster performance

Will revert before merge.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing typos

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Changing node

* Debug output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Trimming string

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Expanding range of nodes to be used for execution

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Resetting label

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing method signature

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Debug output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adjusting debug messages

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing lambdas

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing another lambda

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Restructuring error checking

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Debug message

Signed-off-by: Adam Farley <adfarley@redhat.com>

* debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Changing structure to prevent syntax problem

Signed-off-by: Adam Farley <adfarley@redhat.com>

* debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* To ensure accuracy when some platforms are subsets of other platforms

Like how alpine-linux contains the string linux.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Bracket mislaid - fixing

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Switching for loop styles

Because the previous kind doesn't appear to work, unsure why.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing reference to restricted job

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing legacy code

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Moving platformKeys scope to allow wider usage

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding tests check

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Typo

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Regex fix

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adjusting regex and adding debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Swapping out regex

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing superfluous check

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Better debug messages and a test tag

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Changing tag for testing

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing lambdas and getting test output data from trss

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing another lambda

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Correcting variable name

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Making sure that a missing buildOutputId can be worked around

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing static method use

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing legacy code.

* Removing redundant command

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding check for blank test output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing typo

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Tidying output and adding debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Reducing quanity of output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Reducing output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* More useful output

Signed-off-by: Adam Farley <adfarley@redhat.com>

* More debug

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Syntax fix

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Changing expected repro test bucket for windows and mac

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing debug messages, making all wgets more robust, plus code tidy

wgets to trss can hang if you're passing an invalid value, as per
aqa-test-tools issue 935. This code change allows us to treat
hangs (no response) as if the wget had returned an empty string.

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Making wget spider call silent

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Fixing output typo

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing excess white spaces

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Adding variable use to make linter happy

Signed-off-by: Adam Farley <adfarley@redhat.com>

* Removing build-passed check in favor of an upload-success check

So that if one of the tests fails and the upload is still successful,
we can still try to provide information on the reproducibility
test (assuming it ran at all).

Signed-off-by: Adam Farley <adfarley@redhat.com>

---------

Signed-off-by: Adam Farley <adfarley@redhat.com>
…arning (adoptium#1150)

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

---------

Signed-off-by: Andrew Leonard <anleonar@redhat.com>
…e configured to run with (adoptium#1151)

Signed-off-by: Stewart X Addison <sxa@redhat.com>
…fic asset (adoptium#1153)

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <anleonar@redhat.com>

---------

Signed-off-by: Andrew Leonard <anleonar@redhat.com>
Signed-off-by: Stewart X Addison <sxa@redhat.com>
Copy link

github-actions bot commented Dec 6, 2024

Thank you for creating a pull request!

Please check out the information below if you have not made a pull request here before (or if you need a reminder how things work).

Code Quality and Contributing Guidelines

If you have not done so already, please familiarise yourself with our Contributing Guidelines and Code Of Conduct, even if you have contributed before.

Tests

Github actions will run a set of jobs against your PR that will lint and unit test your changes. Keep an eye out for the results from these on the latest commit you submitted. For more information, please see our testing documentation.

In order to run the advanced pipeline tests (executing a set of mock pipelines), it requires an admin to post run tests on this PR.
If you are not an admin, please ask for one's attention in #infrastructure on Slack or ping one here.
To run full set of tests, use "run tests"; a subset of tests on specific jdk version, use "run tests quick 11,21"

@github-actions github-actions bot added documentation Improvements or additions to documentation jenkins-pipeline code-tools docker labels Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code-tools docker documentation Improvements or additions to documentation jenkins-pipeline
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants