Questions tagged [google-cloud-ml]

Google Cloud ML Engine is a managed service that offers training and/or prediction services using Machine Learning models.

1007 questions
32
votes
4 answers

Google Dataflow vs Apache Spark

I am surveying Google Dataflow and Apache Spark to decide which one is more suitable solution for our bigdata analysis business needs. I found there are Spark SQL and MLlib in the spark platform to do structured data query and machine learning. I…
27
votes
0 answers

Installing error in Google Cloud using CloudML library in R

I'm trying Google Cloud for the first time for training a DNN model with using Keras in R. The use of the cloudml_train()-function try to install a lot of libraries on the Google Cloud server, and there is an error that I can't go…
Sándor Zsebők
  • 371
  • 2
  • 3
25
votes
6 answers

Which Google Cloud Platform service is the easiest for running Tensorflow?

While working on Udacity Deep Learning assignments, I encountered memory problem. I need to switch to a cloud platform. I worked with AWS EC2 before but now I would like to try Google Cloud Platform (GCP). I will need at least 8GB memory. I know how…
23
votes
5 answers

Permission "artifactregistry.repositories.downloadArtifacts" denied on resource

While the artifact repository was successfully creating, running a docker push to push the image to the google artifact registry fails with a permissions error even after granting all artifact permissions to the accounting I am using on gcloud…
23
votes
2 answers

gcloud components update permission denied

All of a sudden I started getting "Permission Denied" issues when trying to run any gcloud commands such as gcloud components update -- the issue was avoided if I ran sudo gcloud components update but it's not clear to my why the sudo command is…
reese0106
  • 2,011
  • 2
  • 16
  • 46
18
votes
3 answers

How to convert .ckpt to .pb?

I am new to deep learning and I want to use a pretrained (EAST) model to serve from the AI Platform Serving, I have these files made available by the…
16
votes
1 answer

What does google cloud ml-engine do when a Json request contains "_bytes" or "b64"?

The google cloud documentation (see Binary data in prediction input) states: Your encoded string must be formatted as a JSON object with a single key named b64. The following Python example encodes a buffer of raw JPEG data using the base64…
16
votes
3 answers

Google Storage (gs) wrapper file input/out for Cloud ML?

Google recently announced the Clould ML, https://cloud.google.com/ml/ and it's very useful. However, one limitation is that the input/out of a Tensorflow program should support gs://. If we use all tensorflow APIS to read/write files, it should OK,…
Sung Kim
  • 8,417
  • 9
  • 34
  • 42
15
votes
6 answers

How do I set up TensorFlow in the Google cloud?

How do I set up a TensorFlow in the Google cloud? I understand how to create a Google Compute Engine instance, and how to run TensorFlow locally; and a recent Google blog post suggests that there ought to be a way to create a Google Compute Engine…
13
votes
1 answer

Using Training TFRecords that are stored on Google Cloud

My goal is to use training data (format: tfrecords) stored on Google Cloud storage when I run my Tensorflow Training App, locally. (Why locally? : I am testing before I turn it into a training package for Cloud ML) Based on this thread I shouldn't…
7hacker
  • 1,928
  • 3
  • 19
  • 32
12
votes
1 answer

Google Cloud ML-engine scikit-learn prediction probability 'predict_proba()'

Google Cloud ML-engine supports the ability to deploy scikit-learn Pipeline objects. For example a text classification Pipeline could look like the following, classifier = Pipeline([ ('vect', CountVectorizer()), ('clf',…
12
votes
6 answers

gcloud ml-engine local predict RuntimeError: Bad magic number in .pyc file

My objective is to make predictions on google cloud ml engine. I installed gcloud sdk on linux ubuntu 16.04LT following Google instructions. I already have a machine learning trained model. I using python version anaconda python 3.5. I run: gcloud…
12
votes
2 answers

Convert a graph proto (pb/pbtxt) to a SavedModel for use in TensorFlow Serving or Cloud ML Engine

I've been following the TensorFlow for Poets 2 codelab on a model I've trained, and have created a frozen, quantized graph with embedded weights. It's captured in a single file - say my_quant_graph.pb. Since I can use that graph for inference with…
Mark McDonald
  • 7,571
  • 6
  • 46
  • 53
11
votes
3 answers

Cloud ML Service account cannot access Cloud Storage and is not listed in IAM & admin panel

When creating a new version of an ML Engine Model with the command gcloud ml-engine versions create 'v1' --model=model_name --origin=gs://path_to_model/1/ --runtime-version=1.4 I recieve the following error: ERROR:…
freeChris
  • 145
  • 1
  • 7
11
votes
4 answers

Deploying Keras Models via Google Cloud ML

I am looking to use Google Cloud ML to host my Keras models so that I can call the API and make some predictions. I am running into some issues from the Keras side of things. So far I have been able to build a model using TensorFlow and deploy it…
1
2 3
67 68