Stack Overflow
Stack Overflow

Questions tagged [s3-bucket]

56 questions
8
votes
1 answer

How change S3 file ownership while cross-account uploading

I have an application which upload ( copy ) some files to a S3 bucket in another AWS account, I use copyObject command from AWS SDK ( Nodejs ) var params = { Bucket: "MyBucket_AccountB", CopySource:…
Emad Dehnavi
  • 3,262
  • 4
  • 19
  • 44
6
votes
3 answers

How to add tags to an S3 Bucket without deleting the existing tags using boto3?

I am using this function: s3 = boto3.resource('s3') bucket_tagging = s3.BucketTagging(bucket) Set_Tag = bucket_tagging.put(Tagging={'TagSet':[{'Key':'Owner', 'Value': owner}]}) It is deleting the existing tags and I can see only one tag.
New_to_work
  • 253
  • 2
  • 5
  • 16
6
votes
0 answers

How to count the total number of objects in an S3 bucket using Java?

I am trying to find a faster way to count all of the objects within an s3 bucket using Amazon's AWS SDK. private static int getBucketFileCount(AmazonS3 s3, ListObjectsV2Request req) { ListObjectsV2Result result; int fileCount = 0; …
Jordan
  • 75
  • 1
  • 5
5
votes
1 answer

pyspark List subfolder of a folder in s3 bucket

I have a s3 bucket in which i store datafiles that are to be processed by my pyspark code. the folder i want to access is: s3a://bucket_name/data/ this folder contains folder. my aim is to access the content of last added folder in this…
Jugraj Singh
  • 529
  • 1
  • 6
  • 22
4
votes
1 answer

Is there a limit on the number of versions of a file, that a versioned S3 bucket can store

We are using versioned s3 bucket for our use-case. We'll be frequently updating the same file. I would like to know how many versions of same file can the s3 bucket handle. I wonder whether the oldest version will be removed if there is a limit the…
aspdeepak
  • 2,640
  • 2
  • 32
  • 37
4
votes
2 answers

outputLocation is not a valid S3 path. Athena Exception

I am trying to execute athena query using c# athena driver. Amazon.Athena.Model.ResultConfiguration resultConfig = new Amazon.Athena.Model.ResultConfiguration(); resultConfig.OutputLocation =…
kaarthick raman
  • 41
  • 1
  • 1
  • 3
3
votes
1 answer

how can I download selective date range files from S3 bucket based on given date range like 08th aug to 15 Aug using AWS CLI?

I am able to filter a particular date's data but not the date range data. Like 12-09-2019 to 15-09-2019 using AWS CLI eg. to filter 2019 year's data i am using --recursive --exclude "*" --include "2019"
himanshika yaduvanshi
  • 31
  • 1
  • 3
3
votes
1 answer

Listing version enabled buckets in s3 using boto3

How do I list all s3 bucket names with versioning flag turned on? I have 100's of s3 buckets. Some of the buckets are having versioning flag turned on. I want to list all those bucket names using boto3. I have given my python code snippet…
Fuji Komalan
  • 1,979
  • 16
  • 25
3
votes
3 answers

Iam policy for s3 buckets

Can we write an iam policy to restrict the creation of s3 bucket only when tags are present. I,e user should be able to create s3 bucket only of he has certain tags are present.
Kevin
  • 41
  • 5
3
votes
0 answers

Downloading all files and folders from S3 bucket to local folder in node js

I need to download all files and folders from an s3 bucket to a local folder in sam hierarchy. Suppose my s3 bucket basepath is: myBucket/user1/ in which and user1 may have dynamic values. Every folder for users contains 3 sub folders image, audio,…
ReNiSh AR
  • 2,782
  • 2
  • 30
  • 42
2
votes
1 answer

How to delete a file from amazon S3 bucket using cURL

I was trying to delete a file from s3 bucket which is hosted in my client's in-house storage s3.fidapp.org. I used below command but it didn't work. I'm getting below error. SignatureDoesNotMatchThe request signature we…
Shanti
  • 15
  • 5
2
votes
1 answer

Amazon connect unable to save recording in s3 bucket

Amazon Connect is able to process the outbound calls and inbound calls, have an option to record calls in S3 bucket, I have made path settings in Data Storage administrator, but am still unable to see recordings in s3 bucket, is there any other…
sandeep kumar parukoti
  • 21
  • 2
2
votes
1 answer

How to display images from AWS S3 without downloading in the local storage

My android app shows images which is downloaded from AWS S3. For now I download the images to the local storage, and show images from the downloaded images. But, it would be annoying from the user's perspective. How can I display image from AWS…
JH Sean Kang
  • 87
  • 2
  • 14
2
votes
2 answers

Amazon S3 bucket file upload response is not available

I'm using multer ,aws-sdk and multer-s3 packages along with express. when users edit profile user may change profile picture /avatar or not. I've passed multer object multer({storage: multer.memoryStorage()}).single('profileHeroImageEdit') if…
FightForJustice
  • 335
  • 4
  • 16
2
votes
2 answers

restrict access to s3 bucket only to specific ec2 instances

I have generated the below policy but it still allows all other ec2 instances to access my bucket. what change should I make to this policy? what I want is my bucket to be accessible only to the instance I have mentioned and not to any other…
vishal
  • 1,646
  • 5
  • 28
  • 56
1
2 3 4