Stack Overflow
Stack Overflow

Questions tagged [jets3t]

JetS3t is a Java toolkit and application suite for Amazon S3/CloudFront and Google Storage

JetS3t (pronounced "jet-set") is a free, open-source Java toolkit and application suite for Amazon Simple Storage Service (Amazon S3), Amazon CloudFront content delivery network, and Google Storage for Developers.

JetS3t Home

JetS3t Development @ BitBucket.org

45 questions
15
votes
3 answers

EntityTooLarge error when uploading a 5G file to Amazon S3

Amazon S3 file size limit is supposed to be 5T according to this announcement, but I am getting the following error when uploading a 5G…
Daniel Mahler
  • 7,653
  • 5
  • 51
  • 90
13
votes
3 answers

Upload Directory with files to S3 using Java

I'm working on the application where user will upload ZIP file to my server, on the server that ZIP file will be expanded and then I need to upload it to the server. Now my questions is: how to upload directory with multiple files and sub-folders…
Maksim
  • 16,635
  • 27
  • 94
  • 135
12
votes
1 answer

JetS3t vs AWS Java SDK

I need to figure out between AWS SDK Java APIs and Jets3t APIs ? which is better in terms of throughput and performance? I am assuming connection is not reliable so i may need to upload/download data in chunks. There is API for multipart upload in…
vbh
  • 135
  • 5
5
votes
1 answer

Hadoop throwing java.lang.VerifyError after exporting jar file

I'm altering a hadoop map - reduce job that currently compiles and runs fine without my changes. As part of the job, I will now be connecting to S3 to deliver a file. I developed a (very simple) s3Connector class, tested and ran it in eclipse, then…
Zak
  • 24,947
  • 11
  • 38
  • 68
5
votes
2 answers

Multipart uploads to Amazon S3 from Apache Spark

How can I make Apache Spark use multipart uploads when saving data to Amazon S3. Spark writes data using RDD.saveAs...File methods. when the destination is start with s3n:// Spark automatically uses JetS3Tt to do the upload, but this fails for files…
Daniel Mahler
  • 7,653
  • 5
  • 51
  • 90
4
votes
1 answer

Deleting subdirectories from S3 from code, definition of 'delimiter' param, code in Groovy

I have an observation that may help others working with S3 and a question below. The example code here is in Groovy using JetS3t Java lib but the concepts are applicable to any programming language. I had found a lot of documentation here on…
Rich Sadowsky
  • 966
  • 1
  • 12
  • 22
4
votes
2 answers

JetS3t : Amazon S3 : How to dynamically change endpoints

My understanding is that before Jets3t 0.7.4 S3 endpoint was set statically at S3Service::setS3EndpointHost. So there was no way to use Jets3t to Get/Put content to S3 using different S3 endpoints in same application. In Jets3t 0.7.4 release notes…
Vivek
  • 41
  • 3
3
votes
1 answer

JetS3t and Server Side Encryption with Customer-Provided Keys

I'm exploring an option to store encrypted data to S3. My backend is build with Java and I'm already using JetS3t library for some simple S3 storage manipulations. So, my question is: How to use JetS3t with S3's Server Side Encryption with…
Maksim
  • 16,635
  • 27
  • 94
  • 135
3
votes
1 answer

error when reading from S3 using Spark/Hadoop

I am trying to read data from Amazon S3 using the Spark. but I am getting java.lang.NoClassDefFoundError: org/jets3t/service/S3ServiceException from inside a Hadoop call. I have tried dwnloading jets3t and adding all the included jars to my…
Daniel Mahler
  • 7,653
  • 5
  • 51
  • 90
3
votes
1 answer

IncompatibleClassChangeError exception is thrown when using JetS3t on Android

I'm working on an Android application, which is going to upload some files to Google Cloud Storage. To do this, I'm using JetS3t java toolkit 0.9. I tried to use it on standard Java project and worked fine, but when I want to use it on Android…
araujo
  • 101
  • 5
3
votes
0 answers

Using a "local" S3 as a replacement for HDFS?

I have been testing out the most recent Cloudera CDH4 hadoop-conf-pseudo (i.e. MRv2 or YARN) on a notebook, which has 4 cores, 8GB RAM, and an Intel X25MG2 SSD. The OS is Ubuntu 12.04LTS 64bit. So far so good. Looking at Setting up hadoop to use S3…
user183394
  • 1,033
  • 1
  • 11
  • 20
2
votes
1 answer

Fake S3 Service for testing

I have built a swing application that will upload a user's data onto S3. I am using the jets3t library to upload and interact with the S3 service. In order for me to do my testing, is there any way for me to stub out calls to S3 and make the jets3t…
sethu
  • 8,181
  • 7
  • 39
  • 65
2
votes
2 answers

how can I access S3 using jets3t?

Hi, I'm trying to access S3 using jets3t library. I just followed an sample code supported by AWS(here's url) here's my simple code import org.jets3t.service.S3Service; import org.jets3t.service.S3ServiceException; import…
truelifer
  • 23
  • 1
  • 4
2
votes
1 answer

Multiple Uploads of unknown number of files to S3 with JetS3t

from the sample code examples of jetS3t the code that follows: What to do if I don't know the number of files to be downloaded from the beginning? E.g an application with thumbnails in S3, and a client application that the user scrolls through a…
Antonis
  • 1,061
  • 3
  • 18
  • 36
2
votes
2 answers

Amazon s3a returns 400 Bad Request with Spark-redshift library

I am facing java.io.IOException: s3n://bucket-name : 400 : Bad Request error while loading Redshift data through spark-redshift library: The Redshift cluster and the s3 bucket both are in mumbai region. Here is the full error stack: 2017-01-13…
Amit Valse
  • 95
  • 10
1
2 3