How to use tweepy python library as aws lambda layer?

Question

I am following this instructions to create an AWS Lambda layer:

mkdir my-lambda-layer && cd my-lambda-layer
mkdir -p aws-layer/python/lib/python3.8/site-packages
pip3 install tweepy --target aws-layer/python/lib/python3.8/site-packages
cd aws-layer

I zip then the folder "python" (zip -r tweepy_layer.zip python/) and upload it to s3. This is what I see when I unzip the folder to double check:

Unfortunately, I still get the following error though the pass should be the same as in the docs. I tried both from MacOs and Ubuntu though I do not think this should play a role for this particular library.

Is the library in the zip file? – doctorlove Dec 13 '21 at 15:33 — doctorlove, Dec 13 '21 at 15:33
yes - I see tweepy among site-packages – G. Macia Dec 13 '21 at 15:35 — G. Macia, Dec 13 '21 at 15:35

score 1 · Answer 1 · answered Dec 13 '21 at 15:50

Essentially the problem turned out to be the cache. Yes, all those __pycache__ and .pyc files. Thanks to this other question I cleared the cache after installing the libraries by doing

pip3 install pyclean
pyclean .

After cleaning the cache, re-doing the zip and uploading it to s3 the lambda setup works perfectly:

How to use tweepy python library as aws lambda layer?

1 Answers1