Questions tagged [tpu]

Use this tag for Tensor Processing Unit (TPU). TPU is an application-specific integrated circuit developed by Google.

421 questions
16
votes
2 answers

Is there any limitations for google colab other than the session timeout after 12 hours?

one of the limitations is that we can get only 12 continuous hours per session. Is there any limitations for the usage for GPU and TPU?
Vineetha Vijayan
  • 188
  • 1
  • 1
  • 13
15
votes
2 answers

File system scheme '[local]' not implemented in Google Colab TPU

I am using TPU runtime in Google Colab, but having problems in reading files (not sure). I initialized TPU using: import tensorflow as tf import os import tensorflow_datasets as tfds resolver =…
14
votes
3 answers

Using TPUs with PyTorch

I am trying to use Google Cloud's TPU from Colab. I was able to do it following the tutorial by using Tensorflow. Does anybody know if it is possible to make use of the TPUs using PyTorch? If so how can I do it? Do you have any example?
10
votes
2 answers

Missing XLA configuration when running pytorch/xla

I am trying to run GCP TPU with Pytorch/XLA, I am using a VM with debian-9-torch-xla-v20200818 image, I initiate the TPU and check it is running using ctpu status which shows that both the CPU and TPU are running, I then activate the…
flybrain
  • 119
  • 2
  • 7
9
votes
4 answers

Edge TPU Compiler: ERROR: quantized_dimension must be in range [0, 1). Was 3

I'm trying to get a Mobilenetv2 model (retrained last layers to my data) to run on the Google edge TPU Coral. I've followed this tuturial https://www.tensorflow.org/lite/performance/post_training_quantization?hl=en to do the post-training…
9
votes
2 answers

TPU: Is there a way to use a Coral USB Accelerator in android device?

I want to use USB Coral accelerator in Android Device to use CNN in my Android applications. Is it available to use? If you guys to know it. Please Let me know. Thanks.
Jonghoon
  • 91
  • 4
8
votes
2 answers

How to free up space in disk on Colab TPU?

I am training a few deep learning models on Google Colab with runtime type set to TPU. The RAM and disk status shows that I have used most of my disk storage on Colab. Is there a way to reset it? Or to delete something to free up some more disk…
classyflyer
  • 81
  • 1
  • 1
  • 4
8
votes
2 answers

How long will it take to train the VGG-16 model on IMAGENET using GOOGLE COLAB TPU?

Just curious, on how long will it take to train the VGG16 model on IMAGENET using GOOGLE COLAB TPU? If someone can explain me the calcuations they did to get to the answer, that would be great!
8
votes
0 answers

Keras model not works well on TPU since June 14

I notice that this code cannot work since June 14 as it says: 'Model' object has no attribute 'target_tensors'. I change another way to use the TPU distribution strategy following…
6
votes
1 answer

Test jax.pmap before deploying on multi-device hardware

My question is fairly simple: I am coding on a single-device small laptop and I am using jax.pmap because my code will run on multiple TPUs. I would like to "fake" having multiple devices to test my code and try different things. Is there any way to…
Valentin Macé
  • 1,150
  • 1
  • 10
  • 25
6
votes
2 answers

How to use TPUs with PyTorch?

I am trying to use TPU using pytorch_xla, but it shows import error in _XLAC. !curl https://raw.githubusercontent.com/pytorch/xla/master/contrib/scripts/env-setup.py -o pytorch-xla-env-setup.py !python pytorch-xla-env-setup.py --version…
sharma.37
  • 77
  • 1
  • 2
6
votes
1 answer

Connect Colab to paid TPU

I'd like to connect Colab to a PAID TPU (upgrading from the free TPU). I created a JSON key using this guide: https://cloud.google.com/docs/authentication/production#auth-cloud-explicit-python, then uploaded it to Colab. I'm able to connect to my…
6
votes
1 answer

Keras: TPU models must have constant shapes for all operations

I am working with a pretrained keras model and I want to run it on TPU by Google Colaboratory, but I get the following error: ValueError: Layer has a variable shape in a non-batch dimension. TPU models must have constant shapes for all…
chefhose
  • 2,399
  • 1
  • 21
  • 32
6
votes
3 answers

Colab TPU error - InvalidArgumentError: Unsupported data type for TPU: double, caused by output cond_8/Merge:0

I'm trying to do some basic character classification on google colab with a TPU. I'm getting the following error: InvalidArgumentError: Unsupported data type for TPU: double, caused by output cond_8/Merge:0 I don't know what the issue is since I'm…
user3413723
  • 11,147
  • 6
  • 55
  • 64
5
votes
4 answers

Unable to import name '_TPU_AVAILABLE' from 'pytorch_lightning.utilities'

I'm trying to import aitexten package to work on a GPT-2 solution. But I'm encountering an error:ImportError: cannot import name '_TPU_AVAILABLE' from 'pytorch_lightning.utilities'…
1
2 3
28 29