Questions tagged [google-bucket]

64 questions
3
votes
2 answers

How to write raw json data [as pyhon Dictionary] to Google cloud storage using python?

My use case is very simple, I'm fetching raw JSON response form my REST API and keeping it as dictionary in python, i have to write this data into google cloud storage. is there any approach other than "upload_from_string" option ?
MJ029
  • 151
  • 1
  • 12
2
votes
1 answer

Django, google app engine, bucket No 'Access-Control-Allow-Origin'

Hello i've a problem that i can't solve. Now i've a simple django project and i'm close to finishing. a few days ago i upload my static files and media files to google cloud sql-bucket. Normally everything was fine for media files but when i upload…
2
votes
1 answer

How to generate a presigned URL with content-type disposition using GCS Ruby SDK

In the Amazon S3 SDK, when generating a presigned URL, I can generate a URL setting the content-disposition, but I cannot find a similar way of configuring these options using Google. The method call available to us…
BenKoshy
  • 33,477
  • 14
  • 111
  • 80
1
vote
0 answers

The 'Access-Control-Allow-Origin' header that is not equal to the supplied origin when swiching between 2 domains access same static files

in the context, I've an application that can access via 2 different URL like below backoffice.* backoffice-mfe.* Everything will be fine if I stick and use only one domain in whole time, but the issue appear whenever I start to change between…
1
vote
0 answers

Exporting file from Google Dataproc Job

I'm trying to export a png file using google bucket path but when I execute the job it tells me java.io.FileNotFoundException: gs://...//test.png I used the same code in local mode and it works. Here it is: val test = LinePlot.series(data, "WSSSE…
1
vote
1 answer

Python Weasyprint to Google Bucket

I am using Google Functions in order to generate PDFs. I want to store the PDFs in a Google Bucket. I know that I can store PDFs as a file using the following code: # Write PDF to HTML pdf =…
Europa
  • 974
  • 12
  • 40
1
vote
1 answer

How to download the folders from gcs bucket to local using python?

I have a model and other folders in the gcs bucket where I need to download into my local. I have the service account of that gcs bucket as well. gs bucket: gs://test_bucket/11100/e324vn241c9e4c4/artifacts Below is the code I am using to download…
merkle
  • 1,585
  • 4
  • 18
  • 33
1
vote
3 answers

Accessing private google bucket through google CDN w/o signed URLs

By requirement, the google bucket I use for file storage should be private. But I need to make the files on the bucket accessible over google CDN. Most of the documents I found describe the best practice involving signed URLs. But I need to make it…
1
vote
1 answer

TPU-VM gives access denied when accessing Bucket

I have a number of Google cloud TPU-VMs which need to write to a Bucket. Most of them work fine, but the one I created this morning is giving me Access Denied when I run gsutil -m cp test_file.txt gs://MY_BUCKET_NAME: "error": { "code": 403, …
1
vote
0 answers

Impossible upload a file to google bucket with a service account which has a condition

Has anyone worked with a google bucket + iam + condition? Created a service account with the Storage Admin role and added the condition: resource.type == "storage.googleapis.com/Bucket"…
Dmitry Zimin
  • 285
  • 4
  • 12
1
vote
0 answers

Google Storage signed URL: The request signature we calculated does not match the signature you provided

I have a python script that is responsible to sign images url to 150 days (v2) with gcs. My problem is the url works just fine but after 4 days when I try to enter the image I get The request signature we calculated does not match the signature you…
Ari
  • 216
  • 1
  • 10
1
vote
0 answers

Scala: copy and delete files in GCP bucket

I'm migrating spark job from private data center to GCP. Earlier I was using FileSystem from hadoop.fs to transfer and delete file within maprfs. But with GCP bucket, this is not working. I have to transfer files from directory A to directory B…
1
vote
1 answer

creating custom model on Google vertex ai

I should use Google’s managed ML platform Vertex AI to build an end-to-end machine learning workflow for an internship. Although I completely follow the tutorial, when I run a training job, I see this error message: Training pipeline failed with…
1
vote
2 answers

read google bucket files using python

I have to read google bucket files which are in xlsx format. The file structure in the bucket look like bucket_name folder_name_1 file_name_1 folder_name_2 folder_name_3 file_name_3 The python…
1
vote
3 answers

How To Chunk And Upload A Large File To Google Bucket

I am trying to upload larger files to a google bucket from nodejs. uploading any file under and around the 200MB size mark works perfectly fine. Anything greater than that returns an error Cannot create a string longer than 0x1fffffe8 characters By…
1
2 3 4 5