Webjobs Running Error (3587fd: ERR ) from zipfile

Question

I have the following small script in a file named fgh.py which I have been attempting to schedule as a webjob

import pandas as pd

df=pd.DataFrame({'a':[1,2,2],'b':[5,6,9]})

df['x']=df.a.sub(df.b)

print(df)

Using @Peter Pan post. I have created a virtual environment, done a pip install pandas. From the virtual environment, the script runs and executes as required.It however does not execute when loaded in Azure Webjobs. I suspect issues arise from the interface between the run,bat file and the Azure python console but have limited understanding of Azure to resolve the issue

In kudus, I have used this post to install python.

Running where python in cmd command in https://myapp.scm.azurewebsites.net/DebugConsole I get;

Additionally from https://arcgistrial.scm.azurewebsites.net/DebugConsole I get the following when I run cmd command python -V

In my run.bat file, I have tried to use either of the directories above without success.

Whether I make my run.bat file D:\home\python364x64\python.exe fgh.py or D:python364x64\python.exe fgh.py I get the following error;

I have gone a head and installed pandas and checked if successful by trying to install numpy

All this has not helped. I have been on this for a couple of days and it has to work somehow. Any help?

@Peter Pan what could I do different? – wwnde Oct 27 '20 at 05:51 — wwnde, Oct 27 '20 at 05:51
@Hopefully, I can get it sorted. – wwnde Oct 27 '20 at 07:14 — wwnde, Oct 27 '20 at 07:14

krishg · Accepted Answer · 2020-11-09T09:40:38.170

(Things are not quite straightforward in old Webjobs to run python task with dependencies. It has been quite some time, the world has moved on to Azure Function :))

However, since you still need to stick to Webjobs, below are the steps I followed which worked. I am using a batch file (.cmd) to run the python script due to the pre-requisites.

By default webjob supports python 2.7 at this moment. So, add python3 from 'extension' in your web app, In this case it was 3.6.4 x64 for me. This will add in path D:\home\python364x64\. How did I know? Kudus console :)

Create a requirements.txt file which contains pandas and numpy (note I had to explicitly add numpy version 1.19.3 due to an issue with latest 1.19.4 in Windows host at the time of this writing). Basically I used your fgh.py which depends on pandas which in turn depends on numpy.

pandas==1.1.4
numpy==1.19.3

Create a run.cmd file having the following content. Note 1st line is not needed. I was just checking python version.

D:\home\python364x64\python --version
D:\home\python364x64\python -m pip install --user --upgrade pip
D:\home\python364x64\python -m pip install --user certifi
D:\home\python364x64\python -m pip install --user virtualenv
D:\home\python364x64\python -m virtualenv .venv
.venv\Scripts\pip install -r requirements.txt
.venv\Scripts\python fgh.py

Zip fgh.py, run.bat and the requirements.txt files into a single zip. Below is the content of my zip.

Upload the zip for the webjob.
Run the job :)

Ignore the error "ModuleNotFoundError: No module named 'certifi'", not needed.

score -1 · Answer 2 · answered Oct 27 '20 at 07:30

-1

The key to solving the problem is that you need to create your venv environment on azure.

Step 1. Run successfully in local.

Step 2. Compress your webjob file.

Step 3. Upload webjob zip file.

Because the test environment has python1 before, I will create a webjob of python2 later.

Step 4. Log in kudu.

① cd ..

② find Python34, click it.

③ python -m venv D:\home\site\wwwroot\App_Data\jobs\continuous\python2\myenv

④ Find myenv folder.

⑤ active myenv, input .\activate.bat.

D:\home\site\wwwroot\App_Data\jobs\continuous\python2\myenv\Scripts>.\activate.bat

⑥ Back to python2 folder, and input pip install pandas.

⑦ Then input python aa.py.

answered Oct 27 '20 at 07:30

Jason Pan

15,263
1
14
29

Thanks, I have run through... How do I then get the wbjo going in the app? Went to check and there is no webjob created. – wwnde Oct 27 '20 at 08:36
You need to create webjob first(step3). – Jason Pan Oct 27 '20 at 08:38
And if have something wrong, you also need add `import sys sys.path.append('D:\\home\\site\\wwwroot\\App_Data\\jobs\\continuous\\python2\\myenv')` in your code, to use myenv. – Jason Pan Oct 27 '20 at 08:39
I think Microsoft officials still have problems with these details. We need to try. All operations are the results of our tests. If you have more questions, you can raise a support ticket for help. – Jason Pan Oct 27 '20 at 08:41
There are only so many attempts we developers can do. – Jason Pan Oct 27 '20 at 08:41
Do you mind sharing logs in the python app window after it executed? – wwnde Oct 27 '20 at 08:52
I also can saw the error msg. You need to find way to active myenv and use it. – Jason Pan Oct 27 '20 at 08:54
I am searching the ways to help you. – Jason Pan Oct 27 '20 at 08:54
So it was not executed in the app? – wwnde Oct 27 '20 at 08:54
Yes，we just can run scripts in kudu. That donnot we want. – Jason Pan Oct 27 '20 at 08:55
I was after execution in the webapp as webjobs, that what is expected of me – wwnde Oct 27 '20 at 08:57

Webjobs Running Error (3587fd: ERR ) from zipfile

2 Answers2

Linked