Unable to make airflow run on Linux server

Question

I installed airflow on linux server using: sudo pip3 install apache-airflow. It got installed successfully.

Then I did: export AIRFLOW_HOME=~/airflow. Finally I ran sudo airflow initdb, it's giving me an error:

sudo: airflow: command not found

echo $PATH prints something like this:

/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/xyz/abc/.local/bin:/home/xyz/abc/bin

I went through these posts:

But, couldn't find any solution that would solve my problem. Don't know what I'm missing. Any help regarding this would be appreciated..

Where did pip install Airflow? Normally you do not need sudo to run `airflow initdb`. — SergiyKolesnikov, May 27 '20 at 18:46
I guess it got installed in `/usr/local/bin`. That's what I tried `sudo airflow initdb`. It gives `sudo: airflow: command not found` — sm925, May 27 '20 at 18:51
Is there the Airflow binary in `/usr/local/bin`? Try `airflow initdb` without `sudo`. — SergiyKolesnikov, May 27 '20 at 18:53
Yes, it's there. Without `sudo` it prints: `-bash: /usr/local/bin/airflow: Permission denied` — sm925, May 27 '20 at 18:58
It looks like the problem is with sudo and not with Airflow. Check out this answer https://stackoverflow.com/a/18560604/6942134 Another possibility is that the executable bit is not set on `/usr/local/bin/airflow`. What does `ls -l /usr/local/bin/airflow` output? — SergiyKolesnikov, May 27 '20 at 19:20

score 1 · Accepted Answer · answered May 27 '20 at 19:42

1

It looks like the execution bit was not set for the airflow binary. Run sudo chmod 775 /usr/local/bin/airflow to fix this.

answered May 27 '20 at 19:42

SergiyKolesnikov

airflow in bin folder didn't have executable permission. I tried this, still getting `sudo: airflow: command not found` – sm925 May 27 '20 at 19:45
`airflow initdb` working now without `sudo`. But giving `airflow initdbTraceback (most recent call last): File "/usr/local/bin/airflow", line 23, in import argcompleteModuleNotFoundError: No module named 'argcomplete'` – sm925 May 27 '20 at 20:16
I think the Airflow installation is broken. It is generally not recommended to do `sudo pip install ...`. You can try installing it in a Python virtual environment. – SergiyKolesnikov May 27 '20 at 20:29
Now, from virtual environment when I do `airflow initdb` I'm getting `File "/usr/local/lib/python3.8/sqlite3/__init__.py", line 23, in from sqlite3.dbapi2 import * File "/usr/local/lib/python3.8/sqlite3/dbapi2.py", line 27, in from _sqlite3 import *ModuleNotFoundError: No module named '_sqlite3'` – sm925 May 27 '20 at 21:33
Yes, had to install `sqlite-devel` and then recompile python. – sm925 May 28 '20 at 14:58

1 Answers1