Minimal integration test for bundle installation. by AdamSaleh · Pull Request #748 · rh-gitops-midstream/release

AdamSaleh · 2026-03-09T07:28:42Z

Decided to develop against 1.20 as I want this to be useful for current release testing.

Also, on main I was waiting too long for rebuilds.

First - the more sweeping change. I needed to update all of the PR based pipelines to produce ARM images as well, as we are mostly getting arm clusters in konflux ci.

Second - overviewof the pipeline:

it is triggered on completion of a group, which means it has access to all pr built images. This leads to littlebit of awkwardness during testing, as the pipeline always fails in first few minutes because of chsins signing issue and then gets triggered again in ~hour or so after it finishes bulding all of the components.
on PR it will not actually test the bundle as committed, as it takes the snapshots of the images anx creates a temporary bundle. This part of the pipeline was supplied by claude code. On Push, it should use the bundle as specified.
then it will create cluster, install the bundle, and run small subset of ginkgo tests - these will be hosted in new rh-gitops-release-qa organization made to facilitate faster updates of tests during release process.
regardless of the success of the pipeline, it will collect information from the test cluster, the pipeline logs, store these in quay as an artefact and send a slack message to our test-notification channel. This was based on our existing script and some konflux CI utilities vendored in and modified by claude code.

There is one more utility task, that parses the pipeline param for the PRs repository and branch so that you can change the steps contents when developing.

Please review and comment :)

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

…ops-midstream#746) * Add script and gha automation to build agent helm-chart Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com> * Modify ci triggers Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com> --------- Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

AdamSaleh · 2026-03-09T09:25:03Z

/retest

AdamSaleh · 2026-03-09T13:48:21Z

/retest

AdamSaleh · 2026-03-09T15:53:20Z

/retest

AdamSaleh · 2026-03-10T09:49:56Z

/retest

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

svghadi

When is this integration test going to run? on component build or on bundle build?

svghadi · 2026-03-19T06:03:10Z

+  application: gitops-main
+  contexts:
+    - description: bundle testing
+      name: component_bundle


Can you verify these values? I think the application should be gitops-1-20 and component should be name of the bundle component.

You are right about the application. The component_bundle is the context so that it catches all the changes. Currently if you change any of the application references, it shoul make you a new testing bundle that contains it and run tests on that.

I will point it to 1.20

svghadi · 2026-03-19T06:04:14Z

+      - name: url
+        value: https://github.com/rh-gitops-midstream/release
+      - name: revision
+        value: main
+      - name: pathInRepo
+        value: /.tekton/integration-tests/pipelines/gitops-bundle-integration-test-pipeline.yaml


Should the values point to release-1.20 branch and the pipeline name added in this PR?

Yeah, I used to develop it against 1.20 branch

…ate tarball (rh-gitops-midstream#653) * build microshift-gitops using pre-build-script custom task to create tarball * changed script to force rebuild * updated to 1.19.2 images references

AdamSaleh · 2026-03-31T11:30:46Z

@svghadi on second note, I figured I will get this merged first and then I will do a followup where I will create the scenario and point the steps to the rh-gitops-midstream/release instead of my fork.

varshab1210 · 2026-04-01T04:46:33Z

+  name: gitops-bundle-lowest-parallel-integration-test-pipeline
+spec:
+  description: |
+    An integration test which provisions an ephemeral Hypershift cluster and deploys an Operator


Suggested change

An integration test which provisions an ephemeral Hypershift cluster and deploys an Operator

An integration test which provisions an ephemeral Hypershift cluster and deploys the Openshift GitOps operator

varshab1210 · 2026-04-01T07:01:35Z

+      oc get csv -n "${OPERATOR_NAMESPACE}" -o wide 2>/dev/null || echo "No CSVs found"
+
+      echo -e "\n[CatalogSources]"
+      oc get catalogsources -n "${OPERATOR_NAMESPACE}" 2>/dev/null || echo "No catalogsources found"


Suggested change

oc get catalogsources -n "${OPERATOR_NAMESPACE}" 2>/dev/null || echo "No catalogsources found"

oc get catalogsources -n openshift-marketplace 2>/dev/null || echo "No catalogsources found"

varshab1210 · 2026-04-01T07:38:20Z

+
+      echo -e "\n[Operator Pod Logs (last 100 lines)]"
+      oc logs -n "${OPERATOR_NAMESPACE}" --all-containers=true --prefix=true --tail=100 \
+        --selector='control-plane=controller-manager' --ignore-errors=true 2>/dev/null || \


Suggested change

--selector='control-plane=controller-manager' --ignore-errors=true 2>/dev/null || \

--selector='control-plane=gitops-operator' --ignore-errors=true 2>/dev/null || \

varshab1210 · 2026-04-01T07:40:30Z

+      oc logs -n "${OPERATOR_NAMESPACE}" --all-containers=true --prefix=true --tail=100 \
+        -l 'app' --ignore-errors=true 2>/dev/null || \
+      echo "No logs available"


Suggested change

oc logs -n "${OPERATOR_NAMESPACE}" --all-containers=true --prefix=true --tail=100 \

-l 'app' --ignore-errors=true 2>/dev/null || \

echo "No logs available"

varshab1210 · 2026-04-01T07:51:41Z

+
+    echo -e "\n[Recent Pod Logs (last 50 lines)]"
+    oc logs -n "${NAMESPACE}" --all-containers=true --prefix=true --tail=50 \
+      -l 'app.kubernetes.io/part-of=argocd' --ignore-errors=true 2>/dev/null || \


I don't think we use this label

varshab1210 · 2026-04-01T07:53:35Z

+    echo -e "\n[Recent Pod Logs (last 50 lines)]"
+    oc logs -n "${NAMESPACE}" --all-containers=true --prefix=true --tail=50 \
+      -l 'app.kubernetes.io/part-of=argocd' --ignore-errors=true 2>/dev/null || \
+    oc logs -n "${NAMESPACE}" --all-containers=true --prefix=true --tail=50 \


This wouldn't work as we are not specifying the pod name

varshab1210 · 2026-04-01T08:23:59Z

+
+    # Wait for the operator to create the application-controller StatefulSet before checking rollout
+    echo "Waiting for openshift-gitops-application-controller StatefulSet to be created..."
+    #oc wait --for=create statefulset/openshift-gitops-application-controller -n "${NAMESPACE}" --timeout=300s || exit 1


This can be removed

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

) * build: switch argocd-agent build to make target Signed-off-by: Jayendra Parsai <jparsai@redhat.com> * build: switch argocd-agent build to make target Signed-off-by: Jayendra Parsai <jparsai@redhat.com> --------- Signed-off-by: Jayendra Parsai <jparsai@redhat.com>

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

AdamSaleh · 2026-04-13T09:04:12Z

/retest

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Updated versions for external images in config.yaml.

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

…4cc51e9e1c398ac (v1.2.0) (rh-gitops-midstream#912) Signed-off-by: dkarpele <karpelevich@gmail.com>

svghadi and others added 4 commits March 5, 2026 20:56

Add release-1.20 to baseBranchPatterns

50dc977

Fix versioning in script

f49bd32

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

Add version tags to built images (rh-gitops-midstream#747)

1394983

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

AdamSaleh marked this pull request as draft March 9, 2026 14:14

AdamSaleh marked this pull request as ready for review March 10, 2026 10:09

AdamSaleh requested a review from svghadi March 10, 2026 15:14

red-hat-konflux Bot and others added 5 commits March 13, 2026 13:08

chore(deps): update konflux references (rh-gitops-midstream#744)

cd806d5

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Fix typo in image tag generation task

5bad0be

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

Push to quay instead of ghcr

a6cd16b

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

Bump rollouts to rhel9 and argocd to 3.3.4 (rh-gitops-midstream#764)

8b76aac

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

chore(deps): update konflux references (rh-gitops-midstream#757)

22f0ef0

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

svghadi approved these changes Mar 19, 2026

View reviewed changes

svghadi reviewed Mar 19, 2026

View reviewed changes

svghadi self-requested a review March 19, 2026 06:06

Add microshift-gitops rpm configuration using pre-build-task to gener…

04c7b05

…ate tarball (rh-gitops-midstream#653) * build microshift-gitops using pre-build-script custom task to create tarball * changed script to force rebuild * updated to 1.19.2 images references

AdamSaleh force-pushed the konflux branch from 268cf56 to b3c8f6d Compare March 31, 2026 11:29

varshab1210 reviewed Apr 1, 2026

View reviewed changes

chore(deps): update konflux references (rh-gitops-midstream#772)

48d1c81

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

AdamSaleh force-pushed the konflux branch from f9ff6ce to b3c8f6d Compare April 2, 2026 09:31

red-hat-konflux Bot and others added 5 commits April 6, 2026 08:50

chore(deps): update konflux references (rh-gitops-midstream#808)

d44f132

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

chore(deps): refresh rpm lockfiles [SECURITY] (rh-gitops-midstream#802)

a03e12a

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

chore(deps): refresh rpm lockfiles (rh-gitops-midstream#788)

f2ea860

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

chore(deps): update konflux references (rh-gitops-midstream#843)

1056ba3

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Add a script to bump versions

e6123c1

Signed-off-by: Siddhesh Ghadi <sghadi1203@gmail.com>

svghadi and others added 7 commits April 14, 2026 17:24

Bump haproxy from 2.6 to 2.8

0a782a1

chore(deps): refresh rpm lockfiles (rh-gitops-midstream#875)

664af8f

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

Change external image versions in config.yaml

f3fd97c

Updated versions for external images in config.yaml.

Remove 1.17 branch from renovate.json

6f8fd36

Add ignored dependency for Renovate configuration

e6e020a

Add login step for quay.io in bundle workflow

c27964b

Change GitHub token secret from GITHUB_TOKEN to GH_TOKEN

f402ff3

AdamSaleh force-pushed the konflux branch from e3cac5f to b3c8f6d Compare April 29, 2026 07:39

red-hat-konflux Bot and others added 3 commits May 1, 2026 00:08

chore(deps): refresh rpm lockfiles (rh-gitops-midstream#905)

c896ab4

Signed-off-by: red-hat-konflux <126015336+red-hat-konflux[bot]@users.noreply.github.com> Co-authored-by: red-hat-konflux[bot] <126015336+red-hat-konflux[bot]@users.noreply.github.com>

chore: bumps argocd-image-updater to commit d611926ae8558abe5aa2a93f3…

a02ea28

…4cc51e9e1c398ac (v1.2.0) (rh-gitops-midstream#912) Signed-off-by: dkarpele <karpelevich@gmail.com>

WIP

091df4a

AdamSaleh force-pushed the konflux branch from b3c8f6d to 091df4a Compare May 7, 2026 21:08

CHANGE TO TRIGGER TESTS

72dace2

	An integration test which provisions an ephemeral Hypershift cluster and deploys an Operator
	An integration test which provisions an ephemeral Hypershift cluster and deploys the Openshift GitOps operator

	oc get catalogsources -n "${OPERATOR_NAMESPACE}" 2>/dev/null \|\| echo "No catalogsources found"
	oc get catalogsources -n openshift-marketplace 2>/dev/null \|\| echo "No catalogsources found"

	--selector='control-plane=controller-manager' --ignore-errors=true 2>/dev/null \|\| \
	--selector='control-plane=gitops-operator' --ignore-errors=true 2>/dev/null \|\| \

	oc logs -n "${OPERATOR_NAMESPACE}" --all-containers=true --prefix=true --tail=100 \
	-l 'app' --ignore-errors=true 2>/dev/null \|\| \
	echo "No logs available"

Conversation

AdamSaleh commented Mar 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AdamSaleh commented Mar 9, 2026

Uh oh!

AdamSaleh commented Mar 9, 2026

Uh oh!

AdamSaleh commented Mar 9, 2026

Uh oh!

AdamSaleh commented Mar 10, 2026

Uh oh!

svghadi left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

AdamSaleh commented Mar 31, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

AdamSaleh commented Apr 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

AdamSaleh commented Mar 9, 2026 •

edited

Loading