sparkImage.pullPolicy does not propagate to driver

[sweb]

Affected Stackable version

26.7

Affected Apache Spark-on-Kubernetes version

4.x

Current and expected behavior

When setting sparkImage.pullPolicy to Always, this is configured for the submit pod, but at least the driver keeps the default setting. Expected would be that we use the pullPolicy (and other sparkImage settings) on driver and executor pods.

Workaround

spec:

  sparkConf:

    spark.kubernetes.container.image.pullPolicy: "Always"

Possible solution

No response

Additional context

No response

Environment

No response

Would you like to work on fixing this bug?

No response