Questions tagged [aws-s3-client]

47 questions
3
votes
2 answers

How do I do S3 multipart upload from Android

Overview: I have an app that uploads images and small audio files to S3 using the following approach: Get a presigned URL from the backend using a secure API. Upload to the presigned URL using Retrofit. Problem: Now I need to support larger files…
ShahiM
  • 3,179
  • 1
  • 33
  • 58
3
votes
1 answer

Digital Ocean Spaces TypeError [ERR_INVALID_URL]: Invalid URL

I am creating a Shopify app in the express on the local and getting this error. The same code is working when I use this app on the server. I don't know why is this not working in the local environment. I am using Digital Ocean Spaces, Node.js…
2
votes
1 answer

How to delete multiple objects in an Amazon S3 bucket using Java V2

So I want to delete all the objects that could be inside a folder in s3 (basically with a certain prefix). How do I do that? I am currently using this while (true) loop, but I am told it is not a good approach to use while (true). This is what I am…
1
vote
0 answers

AWS S3 Async client download file impacting reactor netty event loop threads

I've a spring boot webflux application which connects to 5 different downstream services to get data using webclient, everything works well until I try to read a file from S3 periodically (using Spring scheduler) using aws-s3-async sdk, during the…
1
vote
1 answer

Do Rust S3 SDK Datetimes work with Chrono?

I am writing a CLI application to "restore" deleted and overwritten object versions in S3 using the SDK from AWS as my first "real" Rust Project. One part of this is allowing the user to pass in a start and end date between which file changes should…
Jonathan
  • 13
  • 4
1
vote
1 answer

I want upload files to AWS S3 bucket in Spring Boot web application

If you run the code below, the following error occurred. I want to know the solution. I want to see a sample of how to do the AWS S3 configuration part. Source code S3TransferManager transferManager = S3TransferManager.create(); UploadFileRequest…
이상빈
  • 11
  • 2
1
vote
1 answer

Unable to zip a .txt file using pyspark

I am trying to generate a file for a downstream consumer, for which we fetch data from an oracle table, and try to write a .txt.gz file into AWS S3. The idea is as follows - Generate multiple csv files, which get written into a single .txt…
1
vote
1 answer

Number of PUT requests for S3 folder upload

I am new to AWS. I am working with S3 PUT objects and trying to upload 10 files in a folder. To be more specific, I am uploading the folder. How many PUT requests does it take to complete uploading the files? Will it be 10 PUT requests because 10…
1
vote
1 answer

How to setup user policy for the minio bucket using s3Client?

We use Minio as our backend service but we communicate with it through software.amazon.awssdk.services.s3.S3Client I see that this class contains method putBucketPolicy but I don't see any method which allow to assign policy to user. Is there any…
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
1
vote
0 answers

Listing all directories from s3 using s3 client Java (Answer)

I wanted to list directories under a particular bucket but S3client does not return directories but objects I have been struggling with this I couldn't find anything on google but after some research i got my answers so i thought to put my solution…
maya
  • 21
  • 1
1
vote
1 answer

consume s3 getobjectcommand result in angular (open as pdf)

I am trying to open a file from a s3 bucket using angular as a pdf. To do this, I have a node service running which gets the object, which I call from angular. Then I'm trying to open in angular as a pdf. Is there something I am missing? When I open…
elesh.j
  • 192
  • 1
  • 3
  • 15
1
vote
0 answers

GetFile AWS S3 .NET 6 C#

I have these two types of method to get the file in S3. //method 1 var client = new AmazonS3Client(); var request = new GetPreSignedUrlRequest() { BucketName = BucketName, Key = fileName, …
0
votes
0 answers

Disk [test-s3] does not have not have a configured drivers

Storage::disk('test-s3')->put($fileName, fopen($file_s3, 'rb')); throws error Disk [test-s3] does not have not have a configured drivers3s Below is the file system configuration 'disks' => [ 'test-s3'=> [ 'driver' => 's3', 'key' =>…
0
votes
1 answer

@aws-sdk/client-s3, Why I got an unhandled error event when a step in pipeline throws an error?

I have a case when a transform stream throws an error in pipeline while the stream is handled by the method send of s3 client instance. The error thrown is not caught by the try catch in the code. I isolated the problem in a small example here:…
0
votes
0 answers

Gsutil perfdiag equivalent in AWS

We need to evaluate the latency/bandwidth while we try to upload/download an object from an EC2 instance to an S3 bucket. We did the same in GCP using the gsutil perfdiag command. However, I cannot find any official command in AWS. Is there any tool…
Amit
  • 109
  • 2
  • 2
  • 11
1
2 3 4