Stack Overflow
Stack Overflow

Questions tagged [amazon-ground-truth]

22 questions
4
votes
0 answers

AWS GroundTruth text labeling - hide columns in the data, and checking quality of answers

I am new to SageMaker. I have a large csv dataset which I would like labelled: sentence_id sentence pre_agreed_label 148392 A sentence 0 383294 Another sentence 1 For each sentence, I would like a) a yes/no binary classification in…
ks123321
  • 51
  • 8
3
votes
1 answer

Unable to parse a custom AWS Ground Truth labeling job manifest JSONL file

Due to restrictions in my AWS account, I need to create the labeling job manifest file manually for GroundTruth labeling job. However the manifest file fails parsing even though the file seems to be as per JSONL standards -…
Nithu
  • 83
  • 1
  • 6
1
vote
0 answers

SageMaker groundtruth - seeing time it took to complete annotation?

When I use SageMaker A2i I get timeSpentInSeconds in the object returned, which is useful as we can get stats on how long it takes for workers to complete certain tasks and plan around it. However for sagemaker groundtruth, I receive a list of…
L Xandor
  • 1,659
  • 4
  • 24
  • 48
1
vote
0 answers

When should you use AWS SageMaker GroundTruth (SMGT) vs AWS Sagemaker Augmented AI (A2I)?

I'm working on building an annotation workflow for my data science team. I see there are conflicting AWS products and it's not clear which one to use for what purpose.
sP_
  • 1,738
  • 2
  • 15
  • 29
1
vote
1 answer

Error in AWS SageMaker Ground Truth labeled job creation

I'm using AWS SageMaker Ground Truth for labeling images. I have uploaded the data into s3 bucket, create the IAM role to access 'S3,SageMaker,Groundtruth, and IAM'. When I am trying to create labeling job, it give me this error: NetworkingError:…
Maryam Pahlavan Nodeh
  • 21
  • 1
1
vote
0 answers

How to Edit Sagemaker Labeling Shortcut Tab?

I'm able to change the instructions in the SageMaker GroundTruth labeling user interface as in the picture, but I can't edit the shortcuts tab. I can simply edit inside the 'full-instructions' or 'short-instructions' tags in the html template, but…
blueseal
  • 355
  • 3
  • 5
  • 15
1
vote
0 answers

How to label a text with multiple paragraphs in AWS Ground Truth?

I was trying setup a single label labeling task in AWS Groundtruth through the console. My goal is to match some users in social media and for each user I have several possible candidates out of which one should be selected (label). My CSV looks…
G. Macia
  • 1,204
  • 3
  • 23
  • 38
1
vote
0 answers

AWS SageMaker Groun Truth Invalid s3

Goal: I'm trying to deploy a simple labeling job inside SM Grount Truth where users can basically classify objects inside images. Step-by-step problem: Create a fresh new s3 bucket in sa-east-1; Create a private workforce; While ensuring you're…
Marco Antonio
  • 143
  • 1
  • 14
1
vote
1 answer

How does Amazon Sagemaker Ground Truth work?

Is there a publication that explains how they evaluate how "sure" the automatic system is for the label it assigns? I understand part of the labelling process is done by humans but I'm interested in how they evaluate the confidence of the…
barabanga
  • 11
  • 1
1
vote
1 answer

Labeling texts with Amazon Sagemaker Ground Truth using Amazon Mechanical Turk workforce

Using Amazon SageMaker Ground Truth, is it possible to specify a spanish language fluency for Mechanical Turk workers in order to label texts written in spanish language? If not, how does SageMaker Ground Truth select Mechanical Turk workers to…
Mike_X
  • 11
  • 1
0
votes
0 answers

Querying intermediate results in SageMaker GroundTruth

Can I somehow query the results of a labeling job in SageMaker Ground Truth while the job isn't completed? When I select a labeling job, the "Query output" button is greyed out until the job is completed: It feels ridiculous to have to wait for the…
Alcibiades
  • 335
  • 5
  • 16
0
votes
1 answer

Impact of confidence "0" from AWS GroundTruth on model building?

Context: Building an object-detection model with AWS SageMaker and GroundTruth labeled data. All my labeled pics appear to have a confidence of zero and this is (I think) because I am the only person who labeled the pic. Does this may have a…
FrancoisHawaii
  • 351
  • 3
  • 4
0
votes
0 answers

Linking groundtruth worker metadata back to the actual task?

As far as I can tell there's no identifier being passed with the GT worker metadata (see below from documentation https://docs.aws.amazon.com/sagemaker/latest/dg/sms-data-output.html)? How would I link this information back to the actual labeling…
L Xandor
  • 1,659
  • 4
  • 24
  • 48
0
votes
0 answers

AWS Ground Truth authorization errors on SOME images

I've followed these tutorials: Amazon's - https://docs.aws.amazon.com/sagemaker/latest/dg/sms-getting-started.html Medium.com -…
user1209675
  • 296
  • 7
  • 18
0
votes
1 answer

How to prevent Amazon SageMaker from splitting my .txt file into lines?

I want to create a labeling job for workers to label my text data. Each text file should be labeled as an entity. SageMaker seems to split my text into lines, so each line can be labeled, which does not make any sense for my project. I used…
dummy_variable
  • 1
  • 1
1
2