Download image from S3 bucket and store in a variable not in local (boto3)

Question

I want to download an image from a bucket S3 and store in a variable, not in my local pc, how can I do it?

I'm using this code to store in local:

BUCKET_NAME = 'mybucket' 
KEYFILE = 'myImage.jpg' 

try:
    s3.Bucket(BUCKET_NAME).download_file(KEYFILE, 'myImageInLocal.jpg')          
except botocore.exceptions.ClientError as e:
    if e.response['Error']['Code'] == "404":
        print("The object does not exist.")
    else:
        raise

[python - Read file content from S3 bucket with boto3 - Stack Overflow](https://stackoverflow.com/questions/36205481/read-file-content-from-s3-bucket-with-boto3) — John Rotenstein, Jun 30 '21 at 10:49

Marcin · Accepted Answer · 2021-07-01T07:41:16.143

5

You can download to BytesIO variable with download_fileobj:

from io import BytesIO

BUCKET_NAME = 'mybucket' 
KEYFILE = 'myImage.jpg' 

s3_file = BytesIO()

try:
    s3.Bucket(BUCKET_NAME).download_fileobj('myImageInLocal.jpg', s3_file)          
except botocore.exceptions.ClientError as e:
    if e.response['Error']['Code'] == "404":
        print("The object does not exist.")
    else:
        raise

edited Jul 01 '21 at 07:41

answered Jun 30 '21 at 09:23

Marcin

215,873
14
235
294

But, in this case, I'm not specifying what is the KEYFILE to insert into s3_file – Dharman son of beautiful b. Jun 30 '21 at 09:46
@Dharmansonofbeautifulb. Your keyfile is 'myImageInLocal.jpg' – Marcin Jun 30 '21 at 10:22
Your code doesn't work, I get this error: "Fileobj must implement write" – Dharman son of beautiful b. Jul 01 '21 at 07:39
@Dharmansonofbeautifulb It works now. The arguments were in the wrong order. – Marcin Jul 01 '21 at 07:41
@Dharmansonofbeautifulb. No porblem. Glad it worked out:-) – Marcin Jul 01 '21 at 07:55

score 0 · Answer 2 · answered Jun 30 '21 at 09:30

0

May be you can try with BytesIO()

import io
image_data = io.BytesIO()

in your try block

s3.Bucket(BUCKET_NAME).download_file(KEYFILE, image_data)

so image_data is the variable that should have the image in byte format.

answered Jun 30 '21 at 09:30

Giriraj Alagirisamy

13
8

Doesn't work because "Filename must be a string" – Dharman son of beautiful b. Jun 30 '21 at 09:40

Download image from S3 bucket and store in a variable not in local (boto3)

2 Answers2