Skip to content

BeamRunJavaPipelineOperator deferrable impersonation chain issue #72135

Description

@borev

Under which category would you file this issue?

Airflow Core

Apache Airflow version

Airflow 2.11.1

What happened and how to reproduce it?

"When running BeamRunJavaPipelineOperator with deferrable=True and impersonation_chain='target_service_account', I get an 'access denied' / 'permission denied' error."

What you think should happen instead?

You have to add "impersonation_chain": self.dataflow_config.impersonation_chain, to

if self.deferrable:
                    trigger_args = {
                        "job_id": self.dataflow_job_id,
                        "project_id": self.dataflow_config.project_id,
                        "location": self.dataflow_config.location,
                        "gcp_conn_id": self.gcp_conn_id,
                        "impersonation_chain": self.dataflow_config.impersonation_chain,
                    }

Operating System

No response

Deployment

Google Managed Service for Apache Airflow

Apache Airflow Provider(s)

apache-beam

Versions of Apache Airflow Providers

apache-airflow-providers-apache-beam==6.2.3

Official Helm Chart version

Not Applicable

Kubernetes Version

No response

Helm Chart configuration

No response

Docker Image customizations

No response

Anything else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions