Skip to content
This repository has been archived by the owner on Apr 3, 2024. It is now read-only.

pass along the backfill command pool to the task instance #62

Open
wants to merge 1 commit into
base: gh-2.0.2
Choose a base branch
from

Conversation

kimyen
Copy link

@kimyen kimyen commented Jul 14, 2022

To be used together with adding new pool for backfill in airflow-sources and prevent task instance from being assigned to a pool by its operator.

@whitleykeith
Copy link

@kimyen I looked into where the task instance get's assigned the pool in airlfow-sources, and I think we can check the dag_run_id of the task and assign it there so we don't need to touch our fork

https://github.com/github/airflow-sources/blob/master/airflow_local_settings.py#L53 <-- This is where we override the pool for the task instance.

We can change the logic in the called function to inspect the dag run id.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants