Questions tagged [amazon-sagemaker-debugger]

18 questions
9
votes
4 answers

get_execution_role() sagemaker: UnknownServiceError: Unknown service: 'sagemaker-metrics'. Valid service names are: accessanalyzer

I am trying this code to get iam role programmatically. from sagemaker import get_execution_role get_execution_role() It's giving the following error. UnknownServiceError Traceback (most recent call…
3
votes
1 answer

What is the correct configuration AWS SageMaker-Python-SDK to achieve local debugging/training with Apple M1 Pro

I want to run an RL training job on AWS SageMaker(script given below). But since the project is complex I was hoping to do a test run using SageMaker Local Mode (In my M1 MacBook Pro) before submitting to paid instances. However, I am struggling to…
2
votes
0 answers

Call AWS-SageMaker API in flutter

I'm trying to call a SageMaker API in flutter but the header has some issues related to Signature. Map signRequest(String param) { var method = "POST"; var uri = endpoint; var secretKey = secretKey; var accessKey = accessKey; var…
1
vote
0 answers

Unknown collections in SageMaker Debugger

In the code I have asked for 4 collections as you see below: But when I see the JSON file in S3, generated by debugger I have more collections like this: Why more than what I have asked is generated? Is that for future if I change my mind and I…
1
vote
2 answers

How can you use PyTorch Profiler on SageMaker?

Is there a way to use the PyTorch profiler when using Amazon SageMaker? Or can we call PyTorch profiler in the profiler config for SageMaker debugger
0
votes
0 answers

ValueError: Message smdebug.Event exceeds maximum protobuf size of 2GB: 2663116783

I am training a sagemaker XGBoost model and i want to get the feature importance of each feature, so i am using smdebug to collect the feature importance while training.But, during training i am facing "ValueError: Message smdebug.Event exceeds…
0
votes
0 answers

SageMaker API Header signature issue in flutter

here is my code if anyone can help me this I would be grateful Map signRequest(String param) { var method = "POST"; var uri = endpoint; var secretKey = secretKey; var accessKey = accessKey; var region = awsRegion; var service =…
0
votes
0 answers

SageMaker PyTorch estimator.fit freezes when running in local mode from EC2

I am trying to train a PyTorch model through SageMaker. I am running a script main.py (which I have posted a minimum working example of below) which calls a PyTorch Estimator. I have the code for training my model saved as a separate script,…
0
votes
0 answers

Collections in SageMaker Debugger

In the code I have asked for 4 collections as you see below: But when I see the JSON file in S3, generated by debugger I have more collections like this: Why more than what I have asked is generated? Is that for future if I change my mind and I…
0
votes
0 answers

SageMaker Debugger and CloudWatch

I have a question based on the architecture in the following URL: https://docs.aws.amazon.com/sagemaker/latest/dg/debugger-how-it-works.html I am able to see the tensors in the S3 and I see for each rule I have created a new processing job has been…
0
votes
0 answers

SageMaker ProfilerReport stopped saying InternalServerError but the training job is successful

When running a simple training job on Amazon SageMaker, ProfilerReport (not configured by me) is also enabled by default and a processing job appears parallel to the training job. The training job runs successfully, but a few times (so I don't know…
0
votes
0 answers

Get raw outputs from SageMaker debugger

I have been trying to find where to collect the output from Sagemaker Debugger, coming from my own dataset. I do not know where to find the raw outputs. Is it possible to get the raw outputs of your dataset from Debugger?
0
votes
0 answers

SageMaker smdebug generating AttributeError with Pytorch container

I am training a PyTorch model. I am able to run the training script successfully on GPU instances (for instance on EC2 instances with pytorch_p36 conda evnrionment activated). Here is the script for…
juvchan
  • 6,113
  • 2
  • 22
  • 35
0
votes
1 answer

Are there associated costs with SageMaker Debugger?

Are there associated costs with SageMaker Debugger? Everywhere I look it says that there are no additional costs, but this has me curious as to what underlying resources the service uses.
0
votes
1 answer

Facing an Error while trying to Import ModelStep

I am trying to import ModelStep using the code from sagemaker.workflow.model_step import ModelStep But it is throwing the error ModuleNotFoundError: No module named 'sagemaker.workflow.model_step' How can I resolve this issue?
1
2