Questions tagged [google-cloud-datalab]

An online tool for data analysis provided by Google as part of its Cloud Platform.

An easy to use interactive tool for large-scale data exploration, analysis, and visualization.

See more at https://cloud.google.com/datalab.

468 questions
55
votes
3 answers

TypeError: string argument without an encoding

I want to upload compressed gzip of Json into Google Storage. I have this code: import datalab.storage as storage import gzip path = prefix +…
52
votes
10 answers

Write a Pandas DataFrame to Google Cloud Storage or BigQuery

Hello and thanks for your time and consideration. I am developing a Jupyter Notebook in the Google Cloud Platform / Datalab. I have created a Pandas DataFrame and would like to write this DataFrame to both Google Cloud Storage(GCS) and/or BigQuery.…
21
votes
2 answers

Google Colaboratory vs Google Datalab. How are they different?

I understand both are built over Jupyter noteboooks but run in cloud. Why do we have two then?
15
votes
1 answer

Why GCP's "Waiting for SSH key to propagate" takes so long?

I have encountered this kind of infamous "Waiting for SSH key to propagate." phrase in at least two cases: Connecting to a virtual box via browser Creating new DataLab instance The question I have is - what happens and what makes it take so long?…
Marcin
  • 4,080
  • 1
  • 27
  • 54
12
votes
2 answers

What is the difference between google cloud datalab and google cloud ai platform notebooks?

I'm looking into the best way to set up an end-to-end machine learning pipeline, and evaluating the data exploration component options. I'm trying to figure out the difference between google cloud datalab, and google cloud ai platform notebooks.…
10
votes
2 answers

Handling NaN values while inserting Pandas dataframes into BigQuery tables

I'm using the following code to insert a Pandas dataframe with multiple NaN values into a BigQuery table. The dataframe is prepared in cloud Datalab. import google.datalab.bigquery as bq bqtable = ('project_name', 'dataset_name',…
8
votes
1 answer

How can one use R within Google Cloud Datalab notebook

Is it possible (advisable) to use R within Google Cloud Datalab? How?
mohawkTrail
  • 606
  • 1
  • 7
  • 19
8
votes
3 answers

Reading in a file with Google datalab

I am trying to use Google Datalab to read in a file in ipython notebook, the basic pd.read_csv() as I can't find the path of the file. I have it locally and also uploaded it to google cloud storage in a bucket. I ran the following commands to…
vvv
  • 337
  • 3
  • 8
7
votes
2 answers

launching tensorboard from google cloud datalab

I need help in luanching tensorboard from tensorflow running on the datalab, My code is the followings (everything is on the datalab): import tensorflow as tf with tf.name_scope('input'): print ("X_np") X_np = tf.placeholder(tf.float32,…
eilalan
  • 669
  • 4
  • 20
7
votes
2 answers

How would I loop through all the file names in a subdirectory on Google Cloud Storage with python?

Say I have some bucket/subdirectory on Google Cloud Storage and this bucket's address is: gs://test-monkeys-example/training_data/cats In this cats subdirectory I have a bunch of images of cats, all of which are jpgs. How would I in python loop…
7
votes
4 answers

Access Google BigQuery Data from local Jupyter Notebooks

I have gotten a few Notebooks up and going on DataLab. I'd like, for a variety of reasons to access the same data from a local Jupyter notebook on my machine. This question suggested a few approaches which so far I can't get working. Specifically…
dartdog
  • 10,432
  • 21
  • 72
  • 121
6
votes
1 answer

"debconf: delaying package configuration, since apt-utils is not installed" :> google notebooks bash error

When trying to install basemap package on google cloud datalab's Notebook I get following error. I want to plot a graph but it seems basemap is not installed. %bash echo 'Y' | apt-get install python-mpltoolkits.basemap
6
votes
3 answers

How can i load my csv from google dataLab to a pandas data frame?

Here is what i tried: (ipython notebook, with python2.7) import gcp import gcp.storage as storage import gcp.bigquery as bq import matplotlib.pyplot as plt import pandas as pd import numpy as np sample_bucket_name =…
Cy Bu
  • 1,401
  • 2
  • 22
  • 33
6
votes
1 answer

Deploying a custom build of Datalab to Google Cloud platform

For a project we are trying to expand Google Cloud Datalab and deploy the modified version to the Google Cloud platform. As I understand it, the deploying process normally consists of the following steps: Build the Docker image Push it to the…
Byvar
  • 91
  • 6
6
votes
2 answers

Using persistent disks with google Datalab

I use google cloud for a hpc project. I have multiple instances writing and reading from from the same persistent disk (mounted using sshfs). I want to analyze some data using Datalab, and I'm not sure how to mount the persistent disk from Datalab…
1
2 3
31 32