ImportError and ModuleNotFoundError: how to get a script running from the command line?

Question

I have a project with the following structure:

HorticulturalSalesPrediction/
    Docker
    HorticulturalSalesPrediction_API/
        optimization/
            __init__.py
            optuna_optim.py
        preprocess/
            __init__.py
            base_dataset.py
        utils/
            __init__.py
            FeatureAdder.py
            helper_functions.py
    __init__.py
    optim_pipeline.py
    run.py

In the script run.py I import stuff like this:

import optim_pipeline
from utils import helper_functions

And in the script optim_pipeline.py I import stuff like this:

from utils import helper_functions
from preprocess import base_dataset
from optimization import optuna_optim

I developed this framework with the IDE PyCharm and when I run it with the 'Run'-Button, the framework works fine. But when I want to run it over a terminal with python3 run.py or python3 -m run.py, I get the following error:

Traceback (most recent call last):
  File "run.py", line 3, in <module>
    import optim_pipeline
  File "/home/josef/Schreibtisch/HorticulturalSalesPrediction/HorticulturalSalesPrediction/HorticulturalSalesPrediction_API/optim_pipeline.py", line 4, in <module>
    from preprocess import base_dataset
  File "/home/josef/Schreibtisch/HorticulturalSalesPrediction/HorticulturalSalesPrediction/HorticulturalSalesPrediction_API/preprocess/base_dataset.py", line 8, in <module>
    from HorticulturalSalesPrediction_API.utils import FeatureAdder
ModuleNotFoundError: No module named 'HorticulturalSalesPrediction_API'

I know that there are already tons of questions and solutions to this whole python import topic (Relative imports - ModuleNotFoundError: No module named x, Call a function from another file?, Relative imports for the billionth time, ...), but none of these worked for me.

When I print sys.path I among others receive '/home/josef/Schreibtisch/HorticulturalSalesPrediction/HorticulturalSalesPrediction/HorticulturalSalesPrediction_API', so all this stuff should be available at the syspath.

I also tried to do relative and absolute imports. But with these attempts I reveice ValueError: attempted relative import beyond top-level package or ImportError: attempted relative import with no known parent package errors (e.g. when I try from . import optim_pipeline).

did you try to launch script.py as `python -m script` statement? What are you typing in the shell? — aestet, May 09 '22 at 09:10
Yes, I also tried `python3 -m run.py`, but got the same error ModuleNotFoundError like running `python3 run.py` — jeiglsperger, May 09 '22 at 09:14

score 0 · Answer 1 · answered May 09 '22 at 09:25

0

Try reinstalling the modules and updating python.

Update HorticulturalSalesPrediction_API

answered May 09 '22 at 09:25

TechNerdTheCoder

21
5

1

`HorticulturalSalesPrediction_API` is a folder or module, respectively, I created by myself, so it's not an external package, that I installed and imported. – jeiglsperger May 09 '22 at 09:42
try reinstalling it or remaking it – TechNerdTheCoder May 10 '22 at 06:20

jeiglsperger · Accepted Answer · 2022-08-08T10:08:13.397

So I found my mistake. The solution is to run python3 -m HorticulturalSalesPrediction_API.run in the HorticulturalSalesPrediction folder. Then it works like expected. I just then had to adjust some imports:

from HorticulturalSalesPrediction_API.utils import helper_functions
from . import optim_pipeline

and

from HorticulturalSalesPrediction_API.utils import helper_functions
from HorticulturalSalesPrediction_API.preprocess import base_dataset
from HorticulturalSalesPrediction_API.optimization import optuna_optim

ImportError and ModuleNotFoundError: how to get a script running from the command line?

2 Answers2