Questions tagged [amazon-sagemaker-neo]
2 questions
2
votes
1 answer
AWS SageMaker Neo v.s. Native Optimized Runtimes
What is the advantage of SageMaker Neo vs the specialized native runtimes that every ML accelerator provides, such as NVIDIA TensorRT, Intel OpenVINO, DeepView RT, CoreML, ArmNN, etc.? I understand that Neo uses some of these frameworks, like…

juvchan
- 6,113
- 2
- 22
- 35
2
votes
0 answers
SageMaker Neo compilation for PyTorch BERT
I'm trying to optimize a BERT model with SageMaker Neo that is pre-trained using PyTorch, but I'm getting the following error:
ClientError: InputConfiguration: Exactly one .pt or .pth file is allowed for PyTorch models.
My model.tar.gz is only…

juvchan
- 6,113
- 2
- 22
- 35