Stack Overflow
Stack Overflow

Questions tagged [buckets]

96 questions
56
votes
23 answers

Delete Amazon S3 buckets?

I've been interacting with Amazon S3 through S3Fox and I can't seem to delete my buckets. I select a bucket, hit delete, confirm the delete in a popup, and... nothing happens. Is there another tool that I should use?
Kyle Cronin
  • 77,653
  • 43
  • 148
  • 164
26
votes
5 answers

Pre-allocating buckets in a C++ std::unordered_map

I'm using the std::unordered_map from gnu++0x to store a huge amount of data. I want to pre-allocate space for the large number of elements, since I can bound the total space used. What I would like to be able to do is call: std::unordered_map…
JAD
  • 263
  • 1
  • 3
  • 4
23
votes
1 answer

Elasticsearch terms aggregation by strings in an array

How can I write an Elasticsearch terms aggregation that splits the buckets by the entire term rather than individual tokens? For example, I would like to aggregate by state, but the following returns new, york, jersey and california as individual…
Marieke
  • 263
  • 1
  • 2
  • 7
23
votes
3 answers

How to access Aggregations result with elasticSearch java api in SearchResponse?

Is there a way to retrieve the aggregations' buckets in a search response, with the java API ? { "took" : 185, "timed_out" : false, "_shards" : { "total" : 5, "successful" : 5, "failed" : 0 }, "hits" : { "total" : 200, …
ThomasC
  • 7,915
  • 2
  • 26
  • 26
18
votes
5 answers

Ruby Amazon S3 Access Denied when listing buckets

Ruby newb here. I was given access creds to data on the amazon cloud. Im beginning to think the access keys are off but I could be wrong. Someone help! I have the aws folder as a plugin >> Version => "0.6.3" >>…
im_benton
  • 2,541
  • 4
  • 21
  • 30
15
votes
3 answers

CommandException: "mb" command does not support "file://" URLs. Did you mean to use a gs:// URL?

I am running Google Cloud Shell on my Windows 7, when trying to fire a new bucket on my PRJOECT I am getting an error. Command --> C:\Users********>gsutil mb gs://MY-PROJECT-ID -p MY-PROJECT-ID Error CommandException: "mb" command does not…
amine Moussaid
  • 163
  • 1
  • 1
  • 4
15
votes
3 answers

Hive - Efficient join of two tables

I am joining two large tables in Hive (one is over 1 billion rows, one is about 100 million rows) like so: create table joinedTable as select t1.id, ... from t1 join t2 ON (t1.id = t2.id); I have bucketed the two tables in the same way, clustering…
maia
  • 3,910
  • 4
  • 27
  • 34
15
votes
3 answers

Setting up bucket's name placed domain-style (bucket.s3.amazonaws.com) with Rails and Paperclip

Paperclip doc about url options: You can choose to have the bucket's name placed domain-style (bucket.s3.amazonaws.com) or path-style (s3.amazonaws.com/bucket). How would look like the setup to actually have bucket's name placed domain-style? I…
huoxito
  • 560
  • 6
  • 7
12
votes
2 answers

Python Pandas Create New Bin/Bucket Variable with pd.qcut

How do you create a new Bin/Bucket Variable using pd.qut in python? This might seem elementary to experienced users but I was not super clear on this and it was surprisingly unintuitive to search for on stack overflow/google. Some thorough searching…
sfortney
  • 2,075
  • 6
  • 23
  • 43
10
votes
4 answers

AWS S3 Bucket with Multiple Regions

I have an AWS S3 bucket which is set for the US Standard region but I want it to work in Singapore too. I have researched but could not find a way for the same bucket to work i multiple regions. It would be great if someone could find a…
Maanit
  • 316
  • 2
  • 4
  • 14
9
votes
2 answers

Copying a file inside an S3 bucket (ruby)

I'm using gem aws-sdk-ruby and I want to copy a file /images/image_a.png to /profile.png all resides inside the same bucket. How can I do that?
kambi
  • 3,291
  • 10
  • 37
  • 58
8
votes
1 answer

How to decide if the filename has a plus (+) sign in it?

So AWS converts a space into + for the bucket/file URL. But a filename that already has + in it is encoded as %2B. I am confused how to handle this case. When the input URL for an application is :…
user5735796
8
votes
2 answers

Hive clustered by on more than one column

I understand that when the hive table has clustered by on one column, then it performs a hash function of that bucketed column and then puts that row of data into one of the buckets. And there is a file for each bucket i.e. if there are 32 buckets…
Manikandan Kannan
  • 8,684
  • 15
  • 44
  • 65
5
votes
1 answer

how to handle two buckets in firebase storage when uploading files to firebase using angular

in app.module AngularFireModule.initializeApp(environment.firebaseConfig) I have two storage firebaseConfig: { apiKey: 'AIzaSyBHsAxVgiuM0_xLd3BunTG6Yf9x1nynxoA', authDomain: 'careerograph-e9963.firebaseapp.com', databaseURL:…
Mohamed Abo Elmagd
  • 1,077
  • 11
  • 17
5
votes
5 answers

How can we decide the total no. of buckets for a hive table

i am bit new to hadoop. As per my knowledge buckets are fixed no. of partitions in hive table and hive uses the no. of reducers same as the total no. of buckets defined while creating the table. So can anyone tell me how to calculate the total no.…
Biswa Bandana Nayak
  • 91
  • 2
  • 2
  • 5
1
2 3 4 5 6 7