Questions tagged [amazon-sagemaker-neo]

2 questions
2
votes
1 answer

AWS SageMaker Neo v.s. Native Optimized Runtimes

What is the advantage of SageMaker Neo vs the specialized native runtimes that every ML accelerator provides, such as NVIDIA TensorRT, Intel OpenVINO, DeepView RT, CoreML, ArmNN, etc.? I understand that Neo uses some of these frameworks, like…
2
votes
0 answers

SageMaker Neo compilation for PyTorch BERT

I'm trying to optimize a BERT model with SageMaker Neo that is pre-trained using PyTorch, but I'm getting the following error: ClientError: InputConfiguration: Exactly one .pt or .pth file is allowed for PyTorch models. My model.tar.gz is only…