I am running some edge tpu model on edge tpu devices. Is there anyway I can read how much memory from TPU is consuming during the run?
Asked
Active
Viewed 95 times
2
-
:))) I didnt mean that, I just let it all caps for attention :( – dtlam26 Nov 23 '20 at 06:59
-
sorry for bothering :( – dtlam26 Nov 23 '20 at 07:08
-
Your model will consume the same amount of memory each time it is run. The edgetpu_compiler can give some hints about how much memory you are using: https://coral.ai/docs/edgetpu/compiler/#performance-considerations If your model is too big, it won't fit in the edge TPU all at once, and the performance will suffer, but it can still run. If your model is much larger, it can be split across multiple edge TPUs by pipelining: https://coral.ai/docs/edgetpu/pipeline/ – usbguru Dec 06 '20 at 00:38