How can I run just one task in a DAG with different schedule?

Question

I have a DAG that runs daily at specific scheduled interval that fetched data from the API, process it and transfer it to Google Cloud.

Now as the Authorization token keeps on expiring for the API, I need to automate the task of fetching the auth token(using API) and update the connections in Airflow. For that I have added one more task in my DAG, that updates the Auth token in my Airflow connections.

But I want to schedule that particular task only once a month and not daily.

This is my default_args in DAG

default_args = {
"owner": "airflow_admin",
"start_date": datetime(2017, 8, 29),
"schedule_interval": "0 5 * * *"
}

This is my task

update_auth_token = PythonOperator(
task_id = "update_auth_token",
python_context = True,
python_callable = update_auth_token,
dag=dag,
)

How can I schedule only task update_auth_token once a month and not daily unlike other tasks running in the DAG? Can I just add start_date, schedule_interval in the task seperately? Are there any other approaches?

Possible duplicate of [How to handle different task intervals on a single Dag in airflow?](https://stackoverflow.com/q/48440262/3679900) — y2k-shubham, Aug 21 '19 at 14:39
I don't agree. In my case I cannot use ShortCircuit Operator. The new task that I have inserted (update_auth) in DAG should run monthly followed by other tasks that are running daily. If the authentication is expired then update_auth_token followed by rest of tasks. If authentication is not expired then just rest of the tasks — tank, Aug 21 '19 at 16:42

How can I run just one task in a DAG with different schedule?

0 Answers0