Unable to get object metadata from S3. Check object key, region and/or access permissions in aws Rekognition

Question

import boto3

if __name__ == "__main__":

    bucket='MyBucketName'
sourceFile='pic1.jpg'
targetFile='pic2.jpg'

client=boto3.client('rekognition','us-east-1')

response=client.compare_faces(SimilarityThreshold=70,
                              SourceImage={'S3Object':{'Bucket':bucket,'Name':sourceFile}},
                              TargetImage={'S3Object':{'Bucket':bucket,'Name':targetFile}})

for faceMatch in response['FaceMatches']:
    position = faceMatch['Face']['BoundingBox']
    confidence = str(faceMatch['Face']['Confidence'])
    print('The face at ' +
           str(position['Left']) + ' ' +
           str(position['Top']) +
           ' matches with ' + confidence + '% confidence')

I am trying to compare two images present in my bucket but no matter which region i select i always get the following error:-

botocore.errorfactory.InvalidS3ObjectException: An error occurred (InvalidS3ObjectException) when calling the CompareFaces operation: Unable to get object metadata from S3. Check object key, region and/or access permissions.

My bucket's region is us-east-1 and I have configured the same in my code. what am I doing wrong?

Did you find a solution to this? I am getting same error with my bucket although same lambda work successfully with another bucket created by aws rekognition. — Noura, Jul 02 '18 at 16:12
This code is working for me now, i did not change anything it just started working when i deployed it. — Harsh Vardhan Parashar, Jul 05 '18 at 08:55
I figured the role was assigned to another bucket. It’s working now. — Noura, Jul 10 '18 at 14:39
Could you give more details on how you solved it? This is kind of a general problem — John, Nov 01 '18 at 17:57

score 12 · Accepted Answer · answered Nov 25 '18 at 20:45

12

I had the same problem. What I did to fix it was to rearrange my bucket and the folders. Make sure that your image is directly in your bucket and not in a folder in your bucket. Also double check that the name of the images are correct and that everything is on point.

answered Nov 25 '18 at 20:45

Sean Li

138
2
7

2

Yes, I found out that the names of the bucket, as well as the files stored in it, are case sensitive i.e "hello" != "Hello". Silly mistake. – Harsh Vardhan Parashar Jan 08 '19 at 07:59
3

Or if you have a folder, put the full path to the object: `path/to/my/object.ext` – Guillermo Gutiérrez Dec 10 '19 at 00:17

score 12 · Answer 2 · answered May 11 '20 at 20:02

12

Check if the S3 and Image Rekognition is in the same region, I know, it's not nice or documented (I guess), but this guys are talking about it here and here

answered May 11 '20 at 20:02

Italo José

1,558
1
17
50

score 4 · Answer 3 · edited Apr 23 '20 at 15:02

4

Ensure bucket region is same as calling region. If you are using AWS CLI then make sure to include profile with appropriate region.

edited Apr 23 '20 at 15:02

mohammed wazeem

1,310
1
10
26

answered Apr 23 '20 at 07:43

Tejas Mahale

61
1

yes i can second that. even though S3 is Global but it worked when i set the session to the same region as S3 – gurinder Nov 04 '21 at 16:25

score 3 · Answer 4 · answered Sep 28 '22 at 11:55

I faced a similar problem like

botocore.errorfactory.InvalidS3ObjectException: An error occurred (InvalidS3ObjectException) when calling the CompareFaces operation: Unable to > get object metadata from S3. Check object key, region and/or access permissions

It may be due to wrong AWS region, key or Permission was not given properly.

In my case the wrong region was set as an environment variable.

score 2 · Answer 5 · answered Sep 16 '20 at 13:38

It happened to me using the AWS rekognition sdk for android , the problem was that the region of the S3 bucket is not the same in my request , so I had to put the correct region in the request (same as S3 bucket ) :

 rekognitionClient.setRegion(Region.getRegion(Regions.US_WEST_1));//replace with your S3 region

score 1 · Answer 6 · answered May 04 '18 at 20:32

1

It seems to me that you dont have enough permissions with that access_key and secret_key! If the credentials are of an IAM user, make sure the IAM user has permission to perform Rekognition compare_faces read operations and s3 read operations! Also check if your s3 source and target object key are correct. And it is better to create roles with required permissions and assume that role to request temporary security credentials instead of using the permanent access keys.

answered May 04 '18 at 20:32

Manoj Acharya

1,331
2
15
27

1

i have provided Administrator and Rekognition access to the user. I have created roles but i am unsure about them. Please guide me – Harsh Vardhan Parashar May 04 '18 at 21:12

score 1 · Answer 7 · answered Sep 17 '21 at 07:45

1

For me the problem was the name of the file in s3 Bucket containing Spaces. So you have to make sure the key doesn't contain spaces while storing itself.

answered Sep 17 '21 at 07:45

Rajesh Kanna

113
6

score 1 · Answer 8 · answered Feb 11 '22 at 01:16

1

In my case I had the path to my object prefixed with a slash (/). Removing it did the trick.

answered Feb 11 '22 at 01:16

spaceemotion

1,404
4
24
32

score 1 · Answer 9 · answered Jul 31 '22 at 01:25

1

Same error mesagge but using Textract functions, no problem with permissions, but my files in s3 containing special caracters, once I renamed the files there was no problem.

answered Jul 31 '22 at 01:25

Hermann

11
2

It was your files or you filenames that had special chars causing this error @hermann? – weilandia May 03 '23 at 16:26
Sorry, I was referring to my filenames @weilandia – Hermann May 04 '23 at 19:05

score 1 · Answer 10 · answered Jan 04 '23 at 02:29

1

Ran into similar issue, and figured out it is due to having space in any of the folder name.

answered Jan 04 '23 at 02:29

SKN

11
1

This does not really answer the question. If you have a different question, you can ask it by clicking [Ask Question](https://stackoverflow.com/questions/ask). To get notified when this question gets new answers, you can [follow this question](https://meta.stackexchange.com/q/345661). Once you have enough [reputation](https://stackoverflow.com/help/whats-reputation), you can also [add a bounty](https://stackoverflow.com/help/privileges/set-bounties) to draw more attention to this question. - [From Review](/review/late-answers/33554019) – sim Jan 05 '23 at 13:18

score 0 · Answer 11 · answered May 04 '18 at 19:02

0

Please ensure the AWS environment variable configuration AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY in your script before compile

answered May 04 '18 at 19:02

Venkatesh Kuppusamy

43
11

can you please elaborate? i am a newbie – Harsh Vardhan Parashar May 04 '18 at 19:08
1

okay i have set the credentials by getting the right access keys from aws but it is still showing the same problem. – Harsh Vardhan Parashar May 04 '18 at 19:12
how do you run your python script.? What is output of your below lines..? Please check `print(os.environ['AWS_SECRET_ACCESS_KEY']) print(os.environ['AWS_ACCESS_KEY_ID'])` – Venkatesh Kuppusamy May 04 '18 at 20:00
i just changed the values of keys through command line using "aws configure" – Harsh Vardhan Parashar May 04 '18 at 20:04
1

That's good. Then check s3 roles in AWS console. [S3 Bucket Access to a Specific IAM Role](https://aws.amazon.com/blogs/security/how-to-restrict-amazon-s3-bucket-access-to-a-specific-iam-role/) – Venkatesh Kuppusamy May 04 '18 at 20:09

score 0 · Answer 12 · answered Mar 04 '20 at 20:19

0

Also ran into this issue, noticed my IAM role had the bucketname as the resource, i had to add a slash and a wildcard to the end. changed it to "Resource": "arn:aws:s3:::/*"

answered Mar 04 '20 at 20:19

Jeffrey DeMuth

131
1
3

score 0 · Answer 13 · answered Mar 15 '21 at 14:52

0

For me changing the file permissions in the S3 bucket worked.

answered Mar 15 '21 at 14:52

Gennaro

138
1
2
16

score 0 · Answer 14 · answered Jan 09 '22 at 10:00

0

I had the same error: I checked and found out that the image was present in some subfolder of the bucket. Make sure that the image is in the root bucket.

answered Jan 09 '22 at 10:00

yogender

496
4
7

score 0 · Answer 15 · answered Apr 29 '22 at 21:25

0

Although this is a very old question, but I also had the same issue. But In my case, I was using the Lambda and my Lambda role didn't had the access to S3, so if you are doing it through Lambda, you need to provide the S3 access to it in addition to Rekognition.

answered Apr 29 '22 at 21:25

Shipra Sahu

1

1

As it’s currently written, your answer is unclear. Please [edit] to add additional details that will help others understand how this addresses the question asked. You can find more information on how to write good answers [in the help center](/help/how-to-answer). – Community Apr 30 '22 at 14:48

Unable to get object metadata from S3. Check object key, region and/or access permissions in aws Rekognition

15 Answers15