airflow webserver started but UI doesn't show in browser

Question

I'm trying to use airflow .

I want to take a local test of the dags I wrote. I'm on windows so I decided to install ubuntu WLS following this bief tutorial https://coding-stream-of-consciousness.com/2018/11/06/apache-airflow-windows-10-install-ubuntu/. Everything seems fine.

I started my db with airflow initdb.

Then I run airflow webserver -p 8080 and it seems running. When I go to http://0.0.0.0:8080/ I can't see any user interface. If I try to run again the airflow webserver I got

Error: Already running on PID 6244 (or pid file '/home/marcofumagalli/airflow/airflow-webserver.pid' is stale)

so i suppose that webserver is running.

Is it something related to proxy?

localhost:8080 already did. It keep loading the page without showing anything. Same thing for curl, it's pending without returning anything — Marco Fumagalli, Apr 17 '19 at 14:23

score 20 · Accepted Answer · answered Nov 28 '19 at 10:20

Error: Already running on PID 6244 (or pid file '/home/marcofumagalli/airflow/airflow-webserver.pid' is stale)

This means that the port 8080 is busy.

Try running the commands below:-

sudo lsof -i tcp:8080:- will show are the processes running as

COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME Python 945 amanraheja 6u IPv4 0xb7fcab59337d7455 0t0 TCP *:http-alt (LISTEN) Python 1009 amanraheja 6u IPv4 0xb7fcab59337d7455 0t0 TCP *:http-alt (LISTEN) Python 1052 amanraheja 6u IPv4 0xb7fcab59337d7455 0t0 TCP *:http-alt (LISTEN) Python 1076 amanraheja 6u IPv4 0xb7fcab59337d7455 0t0 TCP *:http-alt (LISTEN) Python 96034 amanraheja 6u IPv4 0xb7fcab59337d7455 0t0 TCP *:http-alt (LISTEN)

Kill the PID's by kill -9 945 and so on..
delete the airflow-webserver.pid file and start the server again and you will see that it is running fine.

Also you could kill them all at once with `sudo lsof -i tcp:8080 | grep 'username' | awk '{print $2}' | xargs kill -9` , then delete the .pid file. — NicoE, Jan 24 '21 at 18:21

score 9 · Answer 2 · answered May 18 '21 at 20:48

9

mac docker memory issue

I hit this error while developing in my mac, and looking at the logs I found an exited with code: 137, which is an OOM code (although perhaps not always).

In any case, I fixed it by increasing the memory limit to 3GB in docker, following these docs:

answered May 18 '21 at 20:48

Joey Baruch

4,180
6
34
48

2

I needed to free 4GB of memory and it worked for me. life saver, thanks – Gabriel Marcondes Jun 03 '21 at 13:54

score 1 · Answer 3 · edited Mar 31 '21 at 13:43

1

hey actually same thing happened with me. i am sharing following steps which i did. kill the running pid by using kill pid command. then confirm that you have initiated db with airflow db init command. and created user by using airflow users create command. after doing this step by step. use localhost:8080 in place 0.0.0.0:8080. it worked for me.

edited Mar 31 '21 at 13:43

Dharman

30,962
25
85
135

answered Mar 31 '21 at 13:37

Chandresh Chahar

153
1
6

score 0 · Answer 4 · answered Nov 17 '21 at 07:24

0

By running kill -9 PID resolved the issue

answered Nov 17 '21 at 07:24

sammy ongaya

1,313
1
15
14

iamtodor · Answer 5 · 2023-01-15T21:22:26.773

0

Note for macOS users who runs Airflow via k8s:

In order to be able to see UI up and running on your browser at http://localhost:8080/, you need also to run port forwarding: kubectl port-forward POD_ID 8080:8080

edited Jan 15 '23 at 21:22

answered Feb 18 '22 at 11:19

iamtodor

734
8
21

score 0 · Answer 6 · answered Jul 22 '22 at 10:12

If you're running Airflow in a Docker, then killing the PID won't help, neither restarting the service. What you need to do is to search for the Docker container of Airflow's webserver and remove it like this:

docker ps

CONTAINER ID IMAGE ... PORTS NAMES

25d9df23d557 apache/airflow:2.3.2 ... 8080/tcp airflow-webserver

docker container rm {airflow-webserver}

airflow webserver started but UI doesn't show in browser

6 Answers6

mac docker memory issue

Note for macOS users who runs Airflow via k8s: