1

I have a deployment of Airflow using the Kubernetes Executor storing logs onto a persistent volume, the logs are readable from the UI.

The issue is that with this configuration I can't see the logs in the pod using

kubectl logs -f <pod_name>

Is there a way to have the logs in both places?

My end goal is to have them in the Airflow UI and in my observability platform (logz.io)

CodeWizard
  • 128,036
  • 21
  • 144
  • 167
Ismael
  • 733
  • 6
  • 15
  • 1
    not confident enough to post this as an answer, I think that you could specify multiple handlers to write logs to both the console and to a persistent location (there's a little info from astronomer [here](https://www.astronomer.io/guides/logging)) – qfwfq Sep 28 '21 at 21:57
  • This is a really good resource but if I'm understanding correctly by default some things go to stdout/console while others go to a file. But from the documentation and that document I don't feel confident about changing it to achieve my goal. – Ismael Sep 30 '21 at 11:46

0 Answers0