0

I want to run a quick GPU ML process from Cloud Run. I can't use Anthos (too expensive) nor Batch (too slow) but can I somehow have Cloud Run call a GPU enabled Compute Engine VM? And how would the VM scale?

schoon
  • 2,858
  • 3
  • 46
  • 78
  • 2
    `can I somehow have Cloud Run call a GPU enabled Compute Engine VM`. Yes, you can but why use Cloud Run, which would just be a middleman? Just publish the API from the VM. To enable autoscaling you would need to set up a load balancer, Managed Instance Group, and autoscaling. – John Hanley Apr 18 '23 at 18:08

1 Answers1

2

Posting this as a community wiki so that others can benefit from it.

As mentioned by @John Hanley:

While it is possible to use Cloud Run to call a GPU-enabled Compute Engine VM, it may be more efficient to publish the API from the VM directly. To enable autoscaling, you would need to set up a load balancer, Managed Instance Group, and autoscaling. This approach can simplify management and reduce costs by eliminating the need for a middleman.

Chanpols
  • 1,184
  • 1
  • 3
  • 13